-- Logs begin at Tue 2022-07-19 19:49:41 UTC, end at Tue 2022-07-19 21:07:27 UTC. -- Jul 19 20:33:09.284273 dv-cinder-749155-8-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 19 20:33:09.292889 dv-cinder-749155-8-smb devstack@keystone.service[92076]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 19 20:33:09.294887 dv-cinder-749155-8-smb devstack@keystone.service[92076]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 20:33:09 2022] *** Jul 19 20:33:09.294887 dv-cinder-749155-8-smb devstack@keystone.service[92076]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 20:33:09.294887 dv-cinder-749155-8-smb devstack@keystone.service[92076]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 20:33:09.294887 dv-cinder-749155-8-smb devstack@keystone.service[92076]: nodename: dv-cinder-749155-8-smb Jul 19 20:33:09.294887 dv-cinder-749155-8-smb devstack@keystone.service[92076]: machine: x86_64 Jul 19 20:33:09.294887 dv-cinder-749155-8-smb devstack@keystone.service[92076]: clock source: unix Jul 19 20:33:09.294887 dv-cinder-749155-8-smb devstack@keystone.service[92076]: pcre jit disabled Jul 19 20:33:09.294887 dv-cinder-749155-8-smb devstack@keystone.service[92076]: detected number of CPU cores: 4 Jul 19 20:33:09.294887 dv-cinder-749155-8-smb devstack@keystone.service[92076]: current working directory: / Jul 19 20:33:09.294887 dv-cinder-749155-8-smb devstack@keystone.service[92076]: detected binary path: /usr/bin/uwsgi-core Jul 19 20:33:09.294887 dv-cinder-749155-8-smb devstack@keystone.service[92076]: your processes number limit is 47680 Jul 19 20:33:09.295501 dv-cinder-749155-8-smb devstack@keystone.service[92076]: your memory page size is 4096 bytes Jul 19 20:33:09.295501 dv-cinder-749155-8-smb devstack@keystone.service[92076]: detected max file descriptor number: 2048 Jul 19 20:33:09.295501 dv-cinder-749155-8-smb devstack@keystone.service[92076]: lock engine: pthread robust mutexes Jul 19 20:33:09.295501 dv-cinder-749155-8-smb devstack@keystone.service[92076]: thunder lock: enabled Jul 19 20:33:09.295501 dv-cinder-749155-8-smb devstack@keystone.service[92076]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 19 20:33:09.295501 dv-cinder-749155-8-smb devstack@keystone.service[92076]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 20:33:09.340716 dv-cinder-749155-8-smb devstack@keystone.service[92076]: Python main interpreter initialized at 0x5634c51769c0 Jul 19 20:33:09.340716 dv-cinder-749155-8-smb devstack@keystone.service[92076]: python threads support enabled Jul 19 20:33:09.340716 dv-cinder-749155-8-smb devstack@keystone.service[92076]: your server socket listen backlog is limited to 100 connections Jul 19 20:33:09.340716 dv-cinder-749155-8-smb devstack@keystone.service[92076]: your mercy for graceful operations on workers is 90 seconds Jul 19 20:33:09.341206 dv-cinder-749155-8-smb devstack@keystone.service[92076]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 20:33:09.341206 dv-cinder-749155-8-smb devstack@keystone.service[92076]: *** Operational MODE: preforking *** Jul 19 20:33:09.341418 dv-cinder-749155-8-smb devstack@keystone.service[92076]: *** uWSGI is running in multiple interpreter mode *** Jul 19 20:33:09.341418 dv-cinder-749155-8-smb devstack@keystone.service[92076]: spawned uWSGI master process (pid: 92076) Jul 19 20:33:09.341622 dv-cinder-749155-8-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 19 20:33:09.342698 dv-cinder-749155-8-smb devstack@keystone.service[92076]: spawned uWSGI worker 1 (pid: 92087, cores: 1) Jul 19 20:33:09.342698 dv-cinder-749155-8-smb devstack@keystone.service[92076]: spawned uWSGI worker 2 (pid: 92088, cores: 1) Jul 19 20:33:09.342698 dv-cinder-749155-8-smb devstack@keystone.service[92076]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 20:33:14.800599 dv-cinder-749155-8-smb devstack@keystone.service[92087]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 20:33:14.800599 dv-cinder-749155-8-smb devstack@keystone.service[92087]: from cryptography.utils import int_from_bytes Jul 19 20:33:14.801409 dv-cinder-749155-8-smb devstack@keystone.service[92087]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 20:33:14.801409 dv-cinder-749155-8-smb devstack@keystone.service[92087]: from cryptography.utils import int_from_bytes Jul 19 20:33:14.811791 dv-cinder-749155-8-smb devstack@keystone.service[92088]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 20:33:14.811791 dv-cinder-749155-8-smb devstack@keystone.service[92088]: from cryptography.utils import int_from_bytes Jul 19 20:33:14.812278 dv-cinder-749155-8-smb devstack@keystone.service[92088]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 20:33:14.812278 dv-cinder-749155-8-smb devstack@keystone.service[92088]: from cryptography.utils import int_from_bytes Jul 19 20:33:14.850605 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 20:33:14.850805 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 20:33:14.851001 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] command line args: [] {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 20:33:14.851292 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 20:33:14.851483 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ================================================================================ {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 20:33:14.851736 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] admin_token = **** {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.851980 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] config_dir = [] {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.852169 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.852355 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] config_source = [] {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.852544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] debug = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.852745 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.853922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.853922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.853922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.853922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.854176 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] list_limit = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.854176 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] log_config_append = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.854297 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.854485 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] log_dir = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.854651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] log_file = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.854891 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.855138 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.855410 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.855659 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.855839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.856036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.856265 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.856510 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.856747 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.856982 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.857218 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.857455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.857703 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.857946 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.858222 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.858734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.858927 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] publish_errors = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.859136 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 20:33:14.859227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.859374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 20:33:14.859456 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.859573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] command line args: [] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 20:33:14.859660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.859846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 20:33:14.859936 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.860047 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ================================================================================ {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 20:33:14.860796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.860911 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] admin_token = **** {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.861097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] config_dir = [] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.861230 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] standard_threads = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.861365 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.861493 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.861626 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] config_source = [] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.861626 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] debug = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.861853 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.861853 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.862083 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.862233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] use_journal = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.862439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.862576 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] use_json = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.862681 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] insecure_debug = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.862774 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] use_stderr = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.862774 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] use_syslog = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.863012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.863012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.863299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.863429 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] list_limit = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.863573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.863745 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] log_config_append = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.863745 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.863946 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.864024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] log_dir = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.864142 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.864231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] log_file = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.864312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.864390 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.864390 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.864572 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.864649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.864776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.864854 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.864936 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.865094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.865094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.865353 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.865353 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.865604 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.865604 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.865798 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.865931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.866007 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.866132 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.866216 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.866333 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.866333 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.866525 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.866604 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.866720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.866842 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] notification_format = cadf {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.867054 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.867149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.867369 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.867569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.77/identity {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.867757 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] publish_errors = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.867907 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.868046 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.868173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.868310 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.868431 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.868561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.868696 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.868830 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.868830 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.869069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.869156 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] standard_threads = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.869230 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.869370 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] strict_password_check = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.869488 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.869570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.869697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] use_eventlog = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.869774 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.869891 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] use_journal = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.869978 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] use_json = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.870058 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.870184 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] use_stderr = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.870312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.870399 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] use_syslog = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.870546 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] watch_log_file = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 20:33:14.870681 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.870804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.870887 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.871046 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.871133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.871328 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.871492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.871576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.871700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.871809 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.871962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.872042 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.872229 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.872311 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.872505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.872586 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.872760 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.872839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.873016 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.873098 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.873266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.873354 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.873502 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.873583 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.873753 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.873869 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.873991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.874109 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.874239 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.874341 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.874488 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.874570 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.874727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.874814 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.874995 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.875076 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.875232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.875347 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.875506 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.875647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.876352 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.876443 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.876614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.876695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.876881 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.876961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.877118 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.877205 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.877357 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.877449 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.877596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.877681 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.877830 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.877981 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.878058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.878129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.878285 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.878366 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.878519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.878606 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.878757 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.878838 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.878990 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.879069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.879219 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.879426 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.879510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.879582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.879716 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.879795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.879953 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.880040 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.880185 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.880256 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.880420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.880496 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.880660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.880738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.880889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.880958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.881121 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.881255 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.881389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.881531 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.881641 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.881744 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.881874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.881977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.882078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.882376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.882517 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.882621 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.882724 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.882826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.882955 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.883075 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.883188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.883326 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.883469 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.883577 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.883680 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.883782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.883922 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.884027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.884151 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.884289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.884391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.884493 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.884630 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.884743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.884847 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.884955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.885084 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.885195 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.885305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.885408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.885546 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.885655 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.885655 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.886357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.886507 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.886586 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.886660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.886733 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.886805 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.886891 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.886971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.887057 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.887137 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.887274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.887355 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.887428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.887514 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.887595 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.887675 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.887753 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.887832 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.887832 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.887974 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.888047 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.888126 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.888199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.888277 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.888410 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.888493 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.888659 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.888744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.888898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.888980 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.889155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.889239 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.889414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.enabled = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.889493 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.889652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.889731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.889885 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] auth.external = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.889977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.890330 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.890420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.890420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.890559 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.890639 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.890713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.890793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.890867 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] auth.password = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.891033 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.891116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] auth.token = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.891316 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.891405 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.891552 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.891634 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.891799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.891880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.892030 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.892120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.892269 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.892390 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.892515 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.892597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.892745 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.892832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.892981 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] credential.caching = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.893064 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.893218 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.893297 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.893452 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.893544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.893687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.893782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.893920 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.894003 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.894158 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.894240 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.894390 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.894506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.894617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.894725 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.894854 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.894965 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.895115 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.895232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.895362 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.895475 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.895626 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.895736 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.895889 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.896007 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.896134 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.896244 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.896369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] auth.external = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.896479 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.896604 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] auth.mapped = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.896721 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.896847 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] federation.caching = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.896967 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.897071 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.897170 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.897315 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.897434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] auth.password = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.897560 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.897671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] auth.token = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.897796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.897905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.898030 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] catalog.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.898145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.898249 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.898346 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.898501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.898623 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.898726 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.898834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.898986 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.899101 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.899224 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.899339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.899504 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] credential.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.899641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.899758 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] identity.caching = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.899885 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] credential.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.899980 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.900055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.900193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.900286 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.900430 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.900514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.900667 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.900751 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.901027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.901116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.901270 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.901351 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.901521 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.901651 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.901850 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.901942 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.902109 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.902192 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.902344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.902425 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.902579 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.902714 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.902799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.903028 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.903113 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.903296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.903385 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.903539 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.903629 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.903789 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] federation.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.903887 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.904032 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.904127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.904282 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] federation.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.904366 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.904533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.904619 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.904766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.904860 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.905251 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.905335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.905494 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.905579 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.905729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.905825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.905964 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.906053 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.906205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.906288 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.906443 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.906533 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.906689 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.906770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.907463 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.907550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.907716 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.907812 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.907964 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.908047 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.908202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.908300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.908455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.908555 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.908702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.908795 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.908933 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.909028 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.909173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.909277 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.909404 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.909609 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.909693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.909867 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.909954 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.910114 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.910203 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.910353 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.910447 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.910592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.910674 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.910842 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.910926 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.911092 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.911175 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.911350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.911443 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.911583 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.911667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.911832 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.911939 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.912080 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.912220 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.912311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.912502 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.912584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.912760 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.912843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.912990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.user = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.913083 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.913231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.913315 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.913486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.913568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.913716 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.913806 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.913961 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.914042 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.914207 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.914290 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.914449 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.914541 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.914683 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.914763 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.914911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.914990 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.915147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.915239 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.915414 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.915488 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.915629 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.915712 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.915861 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.915954 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.916106 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.916189 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.916352 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.916434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.916582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.password = **** {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.916671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.916826 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.916915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.917068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.917156 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.917319 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.917423 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.917559 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.917642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.917800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.917882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.918052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.918135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.918304 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.918385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.918538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.918618 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.918773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.918856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.919019 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.919098 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.919274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.919360 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.919532 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.919614 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.919761 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.919841 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.920003 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.920130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.920242 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.920323 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.920477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.920559 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.920715 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.920798 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.920959 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.921041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.921198 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.921278 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.921431 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.921514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.921669 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.921753 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.921905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.921985 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] resource.caching = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.922139 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.922221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.922377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.922461 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.922652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.922738 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.922907 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.922991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.923139 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.923220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.923414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.923498 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.923662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.923743 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.923901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.923986 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.924140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.924222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.924375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] role.caching = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.924457 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.924624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] role.driver = sql {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.924707 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.924855 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.924937 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.925105 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.925187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.925344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.925426 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.925585 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.925675 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.925825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.925908 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.926067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.926148 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.926312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.926395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.926558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.926672 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.926806 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.926972 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] policy.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.927055 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.927210 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.927346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.927530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.927690 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.927769 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.927874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.928011 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.928116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] receipt.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.928357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.928449 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.928607 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.928689 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.928853 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.928934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.929088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.929172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.929328 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.929408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.929570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] resource.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.929653 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.929819 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.929902 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.930068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] resource.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.930148 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.930307 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.930389 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.930541 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.930622 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.930773 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.930856 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.931005 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.931088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] revoke.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.931238 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.931386 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.931505 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.931586 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.931747 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] role.cache_time = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.931829 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.931985 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] role.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.932069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.932232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.932312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] role.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.932464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] role.list_limit = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.932544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.932693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.932774 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.932960 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.933041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] token.caching = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.933212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.933293 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.933470 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.933553 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.933706 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.933785 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.933954 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.934035 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.934200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.934285 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.934439 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.934522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.934674 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.934754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.934915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.934996 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.935163 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.935243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.935425 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.935505 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.935665 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.935749 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.935900 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.936080 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.936163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.936320 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.936411 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.936571 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.936654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.936822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.936904 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.937072 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.937163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.937324 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.937407 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] database.connection = **** {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.937564 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.937656 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.937821 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.937904 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.938058 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.938642 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.938830 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.938913 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.939066 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.939149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.939320 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.939405 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.939557 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.939638 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.939796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.939878 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.940042 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.940435 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.940511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.940579 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.940640 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.940712 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.940800 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.940964 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.941046 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.941199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.941281 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] token.cache_time = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.941443 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.941524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] token.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.941672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.941756 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.941910 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.941992 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] token.provider = fernet {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.942145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.942236 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.942306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92087) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 20:33:14.942507 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.942762 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.943005 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.943319 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.943612 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.943907 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] trust.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.944196 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.944446 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.944687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.944935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.945185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.945418 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.945664 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.945963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.946237 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.connection = **** {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.946486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.946738 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.946980 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.947225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.947527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.947810 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.948090 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.948342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.948628 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.948917 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.949216 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.949498 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.949754 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.949996 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.950244 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.950478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.950721 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.950958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 20:33:14.951133 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=92088) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 20:33:14.973484 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:14.973717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:14.973946 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:14.977484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:14.977723 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:14.977962 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:14.982271 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:14.987074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.010480 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.010714 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.012896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.013134 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.153404 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.153585 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.202959 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.203100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.203192 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.203306 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.267239 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.267481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.267580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.267703 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.267808 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.267924 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.268011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.268144 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.268227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.268359 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.268444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.268577 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.293082 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.293341 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.293536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.293733 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.293828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.293967 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.294323 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.294425 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.294504 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.294579 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.294654 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.294654 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.294815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.295035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.305903 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.306971 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.318552 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.318814 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.319005 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.319168 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.319254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.319431 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.319516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.319648 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.319733 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.319864 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92087) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.320014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.320099 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.320279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.320496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=92088) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 20:33:15.337573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.337780 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 20:33:15.338114 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.338297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.338449 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 20:33:15.338590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 20:33:15.338720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.338848 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.338972 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.339113 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.339250 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 20:33:15.339402 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.339531 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.339660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.339955 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.340259 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.350381 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.350661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.350932 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.351213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.351970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.352254 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.352530 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.352818 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.359297 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=92087) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.361472 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.363120 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=92087) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.363438 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.363726 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.364117 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.364405 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.364672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.364799 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.364949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.365077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.365227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.365434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.365562 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.365727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.365853 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.366018 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.366154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.366297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.366548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.366837 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.367116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.367427 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.367704 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.392870 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.394480 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92087) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.394763 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.395317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.396692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.396977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.400023 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=92087) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.400304 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.400588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.402259 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.402544 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.402828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.408204 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=92087) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.408447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.410462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.410751 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.413060 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92087) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.413351 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.413634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.413920 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.414199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.414475 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.414743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.415009 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.415388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.415682 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.415967 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.416255 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.416537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.416813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.417084 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.418033 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.434061 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.434336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.437262 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.437543 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.439068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92087) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.442293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.442713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.443011 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.445953 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.446255 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.448036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92087) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.451330 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.451670 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92087) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.455537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.456030 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.456330 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.456626 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.456914 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.457201 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.457481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.459328 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.459636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.459929 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.460260 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.460592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.460921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.476398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92087) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.476776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.477051 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.477319 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.480169 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.480549 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.480828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.481100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.485763 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.487502 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.487780 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.489746 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.490819 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=92087) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.491101 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.491407 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.491571 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.491701 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.491861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.491990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.494930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.495214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.495522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.495861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.496150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.505358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=92087) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.505651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.505934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.506224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.506506 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.506791 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.507070 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.510353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.510638 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.510931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.511218 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.511527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.511852 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.512186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.526868 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=92087) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.530425 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92087) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.532610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.533802 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.535441 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.536028 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.537065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=92087) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.537348 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.537638 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.539988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.541610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.543423 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.543749 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.544089 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.545048 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.546648 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=92087) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.550497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.550789 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.551074 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.551389 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.552137 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.553753 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.556997 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.557310 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.557605 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.557884 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.560640 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92087) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.560929 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.561207 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.567186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.567498 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.567790 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.569079 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=92087) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.569360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.569643 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.569923 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.570197 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.570476 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.570749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.571030 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.571334 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.571609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.571880 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.572142 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.572406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.572683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92087) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.575635 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=92088) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 20:33:15.575921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.576207 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.576487 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.576765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.577041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.577326 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.577613 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.577892 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.578165 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.578439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.579232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.579537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.579821 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=92088) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 20:33:15.611673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5634c51769c0 pid: 92087 (default app) Jul 19 20:33:15.614971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d62b3-be95-4d92-9bb4-33d23be311f0 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:15.615279 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d62b3-be95-4d92-9bb4-33d23be311f0 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:15.615574 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d62b3-be95-4d92-9bb4-33d23be311f0 None None] PATH_INFO: `/v3` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:15.618311 dv-cinder-749155-8-smb devstack@keystone.service[92088]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5634c51769c0 pid: 92088 (default app) Jul 19 20:33:15.619749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 791 bytes} [Tue Jul 19 20:33:15 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:23.259022 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9140ce-4982-4903-8b79-3b68a7367a2e None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:23.259606 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9140ce-4982-4903-8b79-3b68a7367a2e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:23.259606 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9140ce-4982-4903-8b79-3b68a7367a2e None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:23.264012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1/2] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:33:23.269117 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4efbf5-9eb7-4dc1-90ce-560a09158fb4 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:23.269550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4efbf5-9eb7-4dc1-90ce-560a09158fb4 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:23.269650 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4efbf5-9eb7-4dc1-90ce-560a09158fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:23.342637 dv-cinder-749155-8-smb devstack@keystone.service[92087]: INFO dbcounter [None req-df4efbf5-9eb7-4dc1-90ce-560a09158fb4 None None] Registered counter for database keystone Jul 19 20:33:23.365074 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG oslo_db.sqlalchemy.engines [None req-df4efbf5-9eb7-4dc1-90ce-560a09158fb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92087) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:33:23.371234 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writer thread running {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:33:23.550744 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG passlib.handlers.bcrypt [None req-df4efbf5-9eb7-4dc1-90ce-560a09158fb4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=92087) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 19 20:33:23.551082 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG passlib.handlers.bcrypt [None req-df4efbf5-9eb7-4dc1-90ce-560a09158fb4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92087) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 19 20:33:23.606115 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-df4efbf5-9eb7-4dc1-90ce-560a09158fb4 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:23.607795 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-df4efbf5-9eb7-4dc1-90ce-560a09158fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:23.730345 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 2/3] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 19 20:33:23.943830 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9140ce-4982-4903-8b79-3b68a7367a2e None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:24.012567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: INFO dbcounter [None req-fc9140ce-4982-4903-8b79-3b68a7367a2e None None] Registered counter for database keystone Jul 19 20:33:24.032394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG oslo_db.sqlalchemy.engines [None req-fc9140ce-4982-4903-8b79-3b68a7367a2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92088) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 20:33:24.038618 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writer thread running {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 20:33:24.156581 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9140ce-4982-4903-8b79-3b68a7367a2e None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:24.160832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6b86c-5ad6-40be-9268-86172bbcd9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:24.161490 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6b86c-5ad6-40be-9268-86172bbcd9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:24.161774 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6b86c-5ad6-40be-9268-86172bbcd9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:24.162050 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6b86c-5ad6-40be-9268-86172bbcd9c7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:24.170183 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6b86c-5ad6-40be-9268-86172bbcd9c7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:24.221455 dv-cinder-749155-8-smb devstack@keystone.service[92088]: WARNING keystone.common.rbac_enforcer.enforcer [None req-78c6b86c-5ad6-40be-9268-86172bbcd9c7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 19 20:33:24.221798 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6b86c-5ad6-40be-9268-86172bbcd9c7 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:24.231317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 2/4] 10.222.0.77 () {58 vars in 1324 bytes} [Tue Jul 19 20:33:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 20:33:24.237519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4efbf5-9eb7-4dc1-90ce-560a09158fb4 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:24.251835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4efbf5-9eb7-4dc1-90ce-560a09158fb4 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:24.256221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507608b-8d51-4009-83dd-4d0502ea5d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:24.257334 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507608b-8d51-4009-83dd-4d0502ea5d0e admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:24.257620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507608b-8d51-4009-83dd-4d0502ea5d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:24.257895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507608b-8d51-4009-83dd-4d0502ea5d0e admin admin] PATH_INFO: `/v3/projects/f4e53da4f0744609812a487b0656c7b7` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:24.261963 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507608b-8d51-4009-83dd-4d0502ea5d0e admin admin] RBAC: Authorizing `identity:get_project(project_id=f4e53da4f0744609812a487b0656c7b7)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:24.312865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0507608b-8d51-4009-83dd-4d0502ea5d0e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 19 20:33:24.313488 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507608b-8d51-4009-83dd-4d0502ea5d0e admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:24.317766 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 3/5] 10.222.0.77 () {56 vars in 1207 bytes} [Tue Jul 19 20:33:24 2022] GET /identity/v3/projects/f4e53da4f0744609812a487b0656c7b7 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:33:26.310722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24b79a-c870-43eb-8e05-dc98bc2f3d9c None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:26.311255 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24b79a-c870-43eb-8e05-dc98bc2f3d9c None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:26.311255 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24b79a-c870-43eb-8e05-dc98bc2f3d9c None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:26.315382 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 3/6] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:26.320838 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b77f7c-290e-45b5-b730-38098150826e None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:26.321219 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b77f7c-290e-45b5-b730-38098150826e None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:26.321400 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b77f7c-290e-45b5-b730-38098150826e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:26.339970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-56b77f7c-290e-45b5-b730-38098150826e None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:26.341469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-56b77f7c-290e-45b5-b730-38098150826e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:26.349844 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 4/7] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 19 20:33:26.373484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24b79a-c870-43eb-8e05-dc98bc2f3d9c None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:26.385681 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24b79a-c870-43eb-8e05-dc98bc2f3d9c None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:26.389926 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966eb65-c611-4ff6-8803-1e188c4cd14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:26.390559 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966eb65-c611-4ff6-8803-1e188c4cd14d admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:26.390844 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966eb65-c611-4ff6-8803-1e188c4cd14d admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:26.391145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966eb65-c611-4ff6-8803-1e188c4cd14d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:26.398886 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966eb65-c611-4ff6-8803-1e188c4cd14d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:26.400688 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966eb65-c611-4ff6-8803-1e188c4cd14d admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:26.410772 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 4/8] 10.222.0.77 () {58 vars in 1324 bytes} [Tue Jul 19 20:33:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 20:33:26.416113 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b77f7c-290e-45b5-b730-38098150826e None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:26.425783 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b77f7c-290e-45b5-b730-38098150826e None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:26.430237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94656c11-2ae4-41e7-bca9-0c0eeddda0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:26.431096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94656c11-2ae4-41e7-bca9-0c0eeddda0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:26.431416 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94656c11-2ae4-41e7-bca9-0c0eeddda0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:26.431694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94656c11-2ae4-41e7-bca9-0c0eeddda0a3 admin admin] PATH_INFO: `/v3/users/70a97f9c967d4ba3819e7f4712b48b9e` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:26.433078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94656c11-2ae4-41e7-bca9-0c0eeddda0a3 admin admin] RBAC: Authorizing `identity:get_user(user_id=70a97f9c967d4ba3819e7f4712b48b9e)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:26.434875 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94656c11-2ae4-41e7-bca9-0c0eeddda0a3 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:26.436466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 5/9] 10.222.0.77 () {56 vars in 1198 bytes} [Tue Jul 19 20:33:26 2022] GET /identity/v3/users/70a97f9c967d4ba3819e7f4712b48b9e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:28.522714 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f40864-e037-46b7-a674-fdfeb8925624 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:28.523609 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f40864-e037-46b7-a674-fdfeb8925624 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:28.523904 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f40864-e037-46b7-a674-fdfeb8925624 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:28.525326 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 5/10] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:28.531462 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cacc3-fe24-450d-9f71-c6bbb2eedecb None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:28.531907 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cacc3-fe24-450d-9f71-c6bbb2eedecb None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:28.532156 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cacc3-fe24-450d-9f71-c6bbb2eedecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:28.535395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015a5e4-ae27-458d-8aae-3e20dcf1bcfa None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:28.535684 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015a5e4-ae27-458d-8aae-3e20dcf1bcfa None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:28.535962 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015a5e4-ae27-458d-8aae-3e20dcf1bcfa None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:28.537223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 6/11] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:33:28.542205 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18348c0b-0b5e-465b-b0cc-8ef10b827607 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:28.542494 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18348c0b-0b5e-465b-b0cc-8ef10b827607 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:28.542776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18348c0b-0b5e-465b-b0cc-8ef10b827607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:28.549311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-9a0cacc3-fe24-450d-9f71-c6bbb2eedecb None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:28.550487 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9a0cacc3-fe24-450d-9f71-c6bbb2eedecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:28.583184 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG passlib.handlers.bcrypt [None req-18348c0b-0b5e-465b-b0cc-8ef10b827607 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=92088) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 19 20:33:28.583633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG passlib.handlers.bcrypt [None req-18348c0b-0b5e-465b-b0cc-8ef10b827607 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=92088) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 19 20:33:28.628957 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-18348c0b-0b5e-465b-b0cc-8ef10b827607 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:28.630555 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-18348c0b-0b5e-465b-b0cc-8ef10b827607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:28.630714 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 6/12] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:33:28.653437 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cacc3-fe24-450d-9f71-c6bbb2eedecb None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:28.676860 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:28.734656 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 7/13] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:33:28.757081 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18348c0b-0b5e-465b-b0cc-8ef10b827607 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:28.757667 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cacc3-fe24-450d-9f71-c6bbb2eedecb None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:28.794970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86870fa6-d43d-4012-bda1-c97c79f6788d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:28.795719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86870fa6-d43d-4012-bda1-c97c79f6788d None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:28.796002 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86870fa6-d43d-4012-bda1-c97c79f6788d None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:28.796277 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86870fa6-d43d-4012-bda1-c97c79f6788d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:28.807825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86870fa6-d43d-4012-bda1-c97c79f6788d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:33:28.819168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-86870fa6-d43d-4012-bda1-c97c79f6788d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:33:28.819168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:33:28.819168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:33:28.819168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:33:28.819168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:33:28.819168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:33:28.819168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:33:28.819168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:33:28.819168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:33:28.819168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:33:28.819168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:33:28.819168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:33:28.819168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:33:28.819168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:33:28.819168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:33:28.819168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:33:28.820116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:33:28.820116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:33:28.820116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:33:28.820116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:33:28.820116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:33:28.820116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:33:28.820116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:33:28.820116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:33:28.820116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:33:28.820116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:33:28.820116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:33:28.820116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:33:28.820116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:33:28.820116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:33:28.820116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:33:28.820116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:33:28.820933 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:33:28.820933 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:33:28.820933 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:33:28.820933 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:33:28.820933 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:33:28.820933 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:33:28.820933 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:33:28.820933 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:33:28.820933 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:33:28.820933 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:33:28.820933 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:33:28.820933 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:33:28.820933 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 7/14] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:33:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:33:28.826132 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86870fa6-d43d-4012-bda1-c97c79f6788d None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:28.861044 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18348c0b-0b5e-465b-b0cc-8ef10b827607 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:28.863362 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:28.903458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aca437-c8f5-450e-b993-4e0b72e0d169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:28.904344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aca437-c8f5-450e-b993-4e0b72e0d169 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:28.904628 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aca437-c8f5-450e-b993-4e0b72e0d169 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:28.905319 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aca437-c8f5-450e-b993-4e0b72e0d169 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:28.911801 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:28.931869 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86870fa6-d43d-4012-bda1-c97c79f6788d None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:28.965049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda8555-16f3-4a32-879a-f910d90ec041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:28.965714 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda8555-16f3-4a32-879a-f910d90ec041 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:28.965996 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda8555-16f3-4a32-879a-f910d90ec041 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:28.966274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda8555-16f3-4a32-879a-f910d90ec041 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:28.967026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda8555-16f3-4a32-879a-f910d90ec041 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:28.967357 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda8555-16f3-4a32-879a-f910d90ec041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:28.968742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda8555-16f3-4a32-879a-f910d90ec041 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:28.974326 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aca437-c8f5-450e-b993-4e0b72e0d169 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:28.976902 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aca437-c8f5-450e-b993-4e0b72e0d169 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:28.982817 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 8/15] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:33:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:28.989135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda8555-16f3-4a32-879a-f910d90ec041 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:29.082055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 8/16] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:33:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 20:33:29.088140 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aca437-c8f5-450e-b993-4e0b72e0d169 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:29.090853 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:29.095323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda8555-16f3-4a32-879a-f910d90ec041 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:29.132637 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d021b68-7864-41e1-b2d5-e8c2aa5cccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:29.133517 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d021b68-7864-41e1-b2d5-e8c2aa5cccee None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:29.133805 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d021b68-7864-41e1-b2d5-e8c2aa5cccee None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:29.134075 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d021b68-7864-41e1-b2d5-e8c2aa5cccee None admin] PATH_INFO: `/v3/users/70a97f9c967d4ba3819e7f4712b48b9e` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:29.135328 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d021b68-7864-41e1-b2d5-e8c2aa5cccee None admin] RBAC: Authorizing `identity:get_user(user_id=70a97f9c967d4ba3819e7f4712b48b9e)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:29.136783 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d021b68-7864-41e1-b2d5-e8c2aa5cccee None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:29.138414 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 9/17] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:33:28 2022] GET /identity/v3/users/70a97f9c967d4ba3819e7f4712b48b9e => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:33:29.143707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d021b68-7864-41e1-b2d5-e8c2aa5cccee None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:29.158354 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:29.188064 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aca437-c8f5-450e-b993-4e0b72e0d169 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:29.221876 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a561e-9910-4903-b59c-179485274c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:29.222668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a561e-9910-4903-b59c-179485274c98 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:29.222962 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a561e-9910-4903-b59c-179485274c98 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:29.223243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a561e-9910-4903-b59c-179485274c98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:29.242052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a561e-9910-4903-b59c-179485274c98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:29.243515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d021b68-7864-41e1-b2d5-e8c2aa5cccee None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:29.243635 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a561e-9910-4903-b59c-179485274c98 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:29.267300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-a32a561e-9910-4903-b59c-179485274c98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:33:29.267300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:33:29.267300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:33:29.267300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:33:29.267300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:33:29.267300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:33:29.267300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:33:29.267300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:33:29.267300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:33:29.267300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:33:29.267300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:33:29.267300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:33:29.267300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:33:29.267300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:33:29.267300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:33:29.268273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:33:29.268273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:33:29.268273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:33:29.268273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:33:29.268273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:33:29.268273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:33:29.268273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:33:29.268273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:33:29.268273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:33:29.268273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:33:29.268273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:33:29.268273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:33:29.268273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:33:29.268273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:33:29.268273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:33:29.268273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:33:29.268273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:33:29.269080 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:33:29.269080 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:33:29.269080 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:33:29.269080 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:33:29.269080 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 9/18] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:33:29.274177 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a561e-9910-4903-b59c-179485274c98 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:29.278841 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3998d0-ab54-42b5-b70e-c4192d4adb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:29.279689 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3998d0-ab54-42b5-b70e-c4192d4adb57 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:29.279974 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3998d0-ab54-42b5-b70e-c4192d4adb57 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:29.280511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3998d0-ab54-42b5-b70e-c4192d4adb57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:29.281725 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3998d0-ab54-42b5-b70e-c4192d4adb57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:29.283178 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3998d0-ab54-42b5-b70e-c4192d4adb57 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:29.284957 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 10/19] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:33:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:33:29.290348 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3998d0-ab54-42b5-b70e-c4192d4adb57 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:29.332399 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:29.398204 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a561e-9910-4903-b59c-179485274c98 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:29.400673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:29.425488 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3998d0-ab54-42b5-b70e-c4192d4adb57 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:29.445881 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb5f2d-42fb-493c-92e3-49345aa89e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:29.446550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb5f2d-42fb-493c-92e3-49345aa89e65 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:29.446830 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb5f2d-42fb-493c-92e3-49345aa89e65 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:29.447108 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb5f2d-42fb-493c-92e3-49345aa89e65 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:29.447868 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb5f2d-42fb-493c-92e3-49345aa89e65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:29.448172 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb5f2d-42fb-493c-92e3-49345aa89e65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:29.449559 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb5f2d-42fb-493c-92e3-49345aa89e65 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:29.463745 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaa35a-0404-401d-8dbb-f75aadeea7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:29.464400 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaa35a-0404-401d-8dbb-f75aadeea7a4 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:29.464680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaa35a-0404-401d-8dbb-f75aadeea7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:29.464952 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaa35a-0404-401d-8dbb-f75aadeea7a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:29.465785 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaaa35a-0404-401d-8dbb-f75aadeea7a4 None admin] RBAC: Adding query filter params (role.id=b30f01ef95004a1b84fc029830bdf053, scope.domain.id=default, user.id=70a97f9c967d4ba3819e7f4712b48b9e) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:29.466090 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaaa35a-0404-401d-8dbb-f75aadeea7a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:29.467148 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 10/20] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:33:29.467549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaaa35a-0404-401d-8dbb-f75aadeea7a4 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:29.474594 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 11/21] 10.222.0.77 () {56 vars in 1322 bytes} [Tue Jul 19 20:33:29 2022] GET /identity/v3/role_assignments?user.id=70a97f9c967d4ba3819e7f4712b48b9e&scope.domain.id=default&role.id=b30f01ef95004a1b84fc029830bdf053 => generated 233 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:33:31.793907 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30736906-bee4-4a97-b170-cfbe1b66ed2e None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:31.794937 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30736906-bee4-4a97-b170-cfbe1b66ed2e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:31.795462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30736906-bee4-4a97-b170-cfbe1b66ed2e None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:31.797118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 11/22] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:31.813401 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba2a3f-b8c2-457f-b86c-f66aca304901 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:31.814275 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba2a3f-b8c2-457f-b86c-f66aca304901 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:31.814731 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba2a3f-b8c2-457f-b86c-f66aca304901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:31.844492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-60ba2a3f-b8c2-457f-b86c-f66aca304901 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:31.845977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-60ba2a3f-b8c2-457f-b86c-f66aca304901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:31.947574 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 12/23] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:31.974034 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30736906-bee4-4a97-b170-cfbe1b66ed2e None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:32.044169 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5964d-c616-4e0e-942d-9bd1190dd279 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:32.044803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5964d-c616-4e0e-942d-9bd1190dd279 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:32.045283 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5964d-c616-4e0e-942d-9bd1190dd279 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:32.047163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 13/24] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:32.052699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef9d5c-b21a-4c2f-8830-47998971f7ed None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:32.053207 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef9d5c-b21a-4c2f-8830-47998971f7ed None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:32.053703 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef9d5c-b21a-4c2f-8830-47998971f7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:32.088327 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-33ef9d5c-b21a-4c2f-8830-47998971f7ed None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:32.089870 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-33ef9d5c-b21a-4c2f-8830-47998971f7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:32.151991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30736906-bee4-4a97-b170-cfbe1b66ed2e None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:32.207664 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:32.217631 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74f500-bc9b-4f9b-a73b-cbc1dcf8bf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:32.218450 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74f500-bc9b-4f9b-a73b-cbc1dcf8bf1b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:32.218740 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74f500-bc9b-4f9b-a73b-cbc1dcf8bf1b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:32.219027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74f500-bc9b-4f9b-a73b-cbc1dcf8bf1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:32.230334 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 14/25] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:32.231468 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825b7fc-54fd-4904-bab2-e985032532fc None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:32.231757 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825b7fc-54fd-4904-bab2-e985032532fc None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:32.232034 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825b7fc-54fd-4904-bab2-e985032532fc None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:32.232716 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74f500-bc9b-4f9b-a73b-cbc1dcf8bf1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:33:32.233289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 15/26] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:32.246676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-3b74f500-bc9b-4f9b-a73b-cbc1dcf8bf1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:33:32.246676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:33:32.246676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:33:32.246676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:33:32.246676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:33:32.246676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:33:32.246676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:33:32.246676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:33:32.246676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:33:32.246676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:33:32.246676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:33:32.246676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:33:32.246676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:33:32.246676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:33:32.246676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:33:32.246676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:33:32.247616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:33:32.247616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:33:32.247616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:33:32.247616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:33:32.247616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:33:32.247616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:33:32.247616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:33:32.247616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:33:32.247616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:33:32.247616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:33:32.247616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:33:32.247616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:33:32.247616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:33:32.247616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:33:32.247616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:33:32.247616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:33:32.248389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:33:32.248389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:33:32.248389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:33:32.248389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:33:32.248389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:33:32.248389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:33:32.248389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:33:32.248389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:33:32.248389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:33:32.248389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:33:32.248389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:33:32.248389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:33:32.248970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57df2e3-b818-4844-ad97-663dc9223992 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:32.248970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57df2e3-b818-4844-ad97-663dc9223992 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:32.248970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57df2e3-b818-4844-ad97-663dc9223992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:32.251607 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 12/27] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:33:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:33:32.261458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74f500-bc9b-4f9b-a73b-cbc1dcf8bf1b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:32.263231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:32.285909 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-b57df2e3-b818-4844-ad97-663dc9223992 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:32.287147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b57df2e3-b818-4844-ad97-663dc9223992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:32.424972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 16/28] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:33:32.425717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57df2e3-b818-4844-ad97-663dc9223992 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:32.471544 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74f500-bc9b-4f9b-a73b-cbc1dcf8bf1b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:32.542938 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e756e-ba4f-4fa3-ab3c-00cbf9a30785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:32.543645 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e756e-ba4f-4fa3-ab3c-00cbf9a30785 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:32.543931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e756e-ba4f-4fa3-ab3c-00cbf9a30785 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:32.544209 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e756e-ba4f-4fa3-ab3c-00cbf9a30785 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:32.544966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e756e-ba4f-4fa3-ab3c-00cbf9a30785 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:32.545272 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e756e-ba4f-4fa3-ab3c-00cbf9a30785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:32.546659 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e756e-ba4f-4fa3-ab3c-00cbf9a30785 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:32.576661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 13/29] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:33:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:32.580031 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e756e-ba4f-4fa3-ab3c-00cbf9a30785 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:32.583354 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57df2e3-b818-4844-ad97-663dc9223992 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:32.627307 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:32.666071 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c58fb7-211e-499e-bf04-343e173fd419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:32.666806 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c58fb7-211e-499e-bf04-343e173fd419 None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:32.667104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c58fb7-211e-499e-bf04-343e173fd419 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:32.667455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c58fb7-211e-499e-bf04-343e173fd419 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:32.668220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c58fb7-211e-499e-bf04-343e173fd419 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:32.669629 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c58fb7-211e-499e-bf04-343e173fd419 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:32.679732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:32.696097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e756e-ba4f-4fa3-ab3c-00cbf9a30785 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:32.740265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d3c65-e384-40f6-9a11-d18506165a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:32.741309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d3c65-e384-40f6-9a11-d18506165a1f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:32.741733 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d3c65-e384-40f6-9a11-d18506165a1f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:32.742147 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d3c65-e384-40f6-9a11-d18506165a1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:32.760607 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d3c65-e384-40f6-9a11-d18506165a1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:32.762094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d3c65-e384-40f6-9a11-d18506165a1f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:32.782855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-5a7d3c65-e384-40f6-9a11-d18506165a1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:33:32.782855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:33:32.782855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:33:32.782855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:33:32.782855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:33:32.782855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:33:32.782855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:33:32.782855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:33:32.782855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:33:32.782855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:33:32.782855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:33:32.782855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:33:32.782855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:33:32.782855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:33:32.782855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:33:32.784051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:33:32.784051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:33:32.784051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:33:32.784051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:33:32.784051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:33:32.784051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:33:32.784051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:33:32.784051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:33:32.784051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:33:32.784051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:33:32.784051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:33:32.784051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:33:32.784051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:33:32.784051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:33:32.784051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:33:32.784051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:33:32.784051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:33:32.785116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:33:32.785116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:33:32.785116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:33:32.785116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:33:32.787054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 14/30] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:33:32.788074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d3c65-e384-40f6-9a11-d18506165a1f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:32.825429 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 17/31] 10.222.0.77 () {60 vars in 1131 bytes} [Tue Jul 19 20:33:32 2022] POST /identity/v3/roles => generated 219 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:33:32.826520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0afae-660e-41b0-a54f-59df33646621 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:32.826816 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0afae-660e-41b0-a54f-59df33646621 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:32.827108 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0afae-660e-41b0-a54f-59df33646621 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:32.839333 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 18/32] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:32 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:32.839333 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0afae-660e-41b0-a54f-59df33646621 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:32.907302 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:32.923294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d3c65-e384-40f6-9a11-d18506165a1f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:33.005539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691c6e6-0f8e-4e57-9257-89671fcd3b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:33.006445 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691c6e6-0f8e-4e57-9257-89671fcd3b82 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:33.006735 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691c6e6-0f8e-4e57-9257-89671fcd3b82 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:33.007016 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691c6e6-0f8e-4e57-9257-89671fcd3b82 None admin] PATH_INFO: `/v3/users/70a97f9c967d4ba3819e7f4712b48b9e` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:33.009781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d691c6e6-0f8e-4e57-9257-89671fcd3b82 None admin] RBAC: Authorizing `identity:get_user(user_id=70a97f9c967d4ba3819e7f4712b48b9e)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:33.011579 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d691c6e6-0f8e-4e57-9257-89671fcd3b82 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:33.013599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 15/33] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:33:32 2022] GET /identity/v3/users/70a97f9c967d4ba3819e7f4712b48b9e => generated 247 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:33.018041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dc2d4-cb60-40d4-96f8-54c621aa1673 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:33.018502 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dc2d4-cb60-40d4-96f8-54c621aa1673 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:33.018944 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dc2d4-cb60-40d4-96f8-54c621aa1673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:33.040284 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-0f5dc2d4-cb60-40d4-96f8-54c621aa1673 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:33.041732 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-0f5dc2d4-cb60-40d4-96f8-54c621aa1673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:33.051916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0afae-660e-41b0-a54f-59df33646621 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:33.097538 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655da8eb-0414-4946-a4fe-6f4dac714889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:33.098219 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655da8eb-0414-4946-a4fe-6f4dac714889 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:33.098511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655da8eb-0414-4946-a4fe-6f4dac714889 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:33.098796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655da8eb-0414-4946-a4fe-6f4dac714889 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:33.099593 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655da8eb-0414-4946-a4fe-6f4dac714889 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:33.100147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655da8eb-0414-4946-a4fe-6f4dac714889 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:33.101944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655da8eb-0414-4946-a4fe-6f4dac714889 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:33.121047 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 16/34] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:33.122341 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dc2d4-cb60-40d4-96f8-54c621aa1673 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:33.128188 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 19/35] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:33.133686 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655da8eb-0414-4946-a4fe-6f4dac714889 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:33.211639 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:33.249223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:33.267739 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dc2d4-cb60-40d4-96f8-54c621aa1673 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:33.268081 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655da8eb-0414-4946-a4fe-6f4dac714889 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:33.304733 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b1eb2-e5e6-4d78-95ca-cf1fd4396ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:33.305818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b1eb2-e5e6-4d78-95ca-cf1fd4396ab8 None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:33.306272 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b1eb2-e5e6-4d78-95ca-cf1fd4396ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:33.306693 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40963d-c2a3-497d-832a-2536aafe4e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:33.306827 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b1eb2-e5e6-4d78-95ca-cf1fd4396ab8 None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:33.307727 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b1eb2-e5e6-4d78-95ca-cf1fd4396ab8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:33.307835 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40963d-c2a3-497d-832a-2536aafe4e97 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:33.308244 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40963d-c2a3-497d-832a-2536aafe4e97 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:33.308625 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40963d-c2a3-497d-832a-2536aafe4e97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:33.309735 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b1eb2-e5e6-4d78-95ca-cf1fd4396ab8 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:33.310011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40963d-c2a3-497d-832a-2536aafe4e97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:33.311592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40963d-c2a3-497d-832a-2536aafe4e97 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:33.313681 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 17/36] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:33:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:33.314309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40963d-c2a3-497d-832a-2536aafe4e97 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:33.345888 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 20/37] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jul 19 20:33:33 2022] POST /identity/v3/projects => generated 301 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:33:33.347201 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b1eb2-e5e6-4d78-95ca-cf1fd4396ab8 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:33.449492 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40963d-c2a3-497d-832a-2536aafe4e97 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:33.477474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b1eb2-e5e6-4d78-95ca-cf1fd4396ab8 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:33.486241 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:33.495343 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38018c-6b36-4a1e-ad2f-608b6251f3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:33.496490 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38018c-6b36-4a1e-ad2f-608b6251f3e9 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:33.496777 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38018c-6b36-4a1e-ad2f-608b6251f3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:33.497054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38018c-6b36-4a1e-ad2f-608b6251f3e9 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:33.498108 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38018c-6b36-4a1e-ad2f-608b6251f3e9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:33.500064 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38018c-6b36-4a1e-ad2f-608b6251f3e9 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:33.518686 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d19e7-ce95-402e-a8b5-f420b7eca2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:33.519897 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d19e7-ce95-402e-a8b5-f420b7eca2d0 None admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:33.520368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d19e7-ce95-402e-a8b5-f420b7eca2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:33.520793 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d19e7-ce95-402e-a8b5-f420b7eca2d0 None admin] PATH_INFO: `/v3/domains/default/users/70a97f9c967d4ba3819e7f4712b48b9e/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:33.523057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d19e7-ce95-402e-a8b5-f420b7eca2d0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=70a97f9c967d4ba3819e7f4712b48b9e, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:33.524952 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d19e7-ce95-402e-a8b5-f420b7eca2d0 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:33.543783 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 21/38] 10.222.0.77 () {58 vars in 1361 bytes} [Tue Jul 19 20:33:33 2022] PUT /identity/v3/domains/default/users/70a97f9c967d4ba3819e7f4712b48b9e/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:33:33.546163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c26f4-0034-4e79-8844-f1f2641e58af None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:33.546163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c26f4-0034-4e79-8844-f1f2641e58af None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:33.546163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c26f4-0034-4e79-8844-f1f2641e58af None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:33.548205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 22/39] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:33.549287 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8535174-e85c-4d71-bd59-c9fed738deb5 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:33.549579 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8535174-e85c-4d71-bd59-c9fed738deb5 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:33.549861 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8535174-e85c-4d71-bd59-c9fed738deb5 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:33.551352 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 23/40] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:33.557686 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4bdaa-6c30-41f8-8dfb-b5634062984b None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:33.557983 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4bdaa-6c30-41f8-8dfb-b5634062984b None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:33.558270 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4bdaa-6c30-41f8-8dfb-b5634062984b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:33.578136 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-c2d4bdaa-6c30-41f8-8dfb-b5634062984b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:33.580939 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-c2d4bdaa-6c30-41f8-8dfb-b5634062984b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:33.630376 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 18/41] 10.222.0.77 () {60 vars in 1131 bytes} [Tue Jul 19 20:33:33 2022] POST /identity/v3/roles => generated 225 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:33:33.632014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1644292-9ab2-434e-a860-34a8ce781e73 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:33.632315 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1644292-9ab2-434e-a860-34a8ce781e73 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:33.632603 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1644292-9ab2-434e-a860-34a8ce781e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:33.659440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-a1644292-9ab2-434e-a860-34a8ce781e73 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:33.661484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a1644292-9ab2-434e-a860-34a8ce781e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:33.678065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:33.759577 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 19/42] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:33.785365 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1644292-9ab2-434e-a860-34a8ce781e73 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:33.805042 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 24/43] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:33.827631 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4bdaa-6c30-41f8-8dfb-b5634062984b None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:33.915971 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1644292-9ab2-434e-a860-34a8ce781e73 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:33.950269 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:33.956498 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fc4d3-21fc-4e82-990a-cbf9deaf0ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:33.957418 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fc4d3-21fc-4e82-990a-cbf9deaf0ac2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:33.957522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4bdaa-6c30-41f8-8dfb-b5634062984b None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:33.957708 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fc4d3-21fc-4e82-990a-cbf9deaf0ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:33.957986 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fc4d3-21fc-4e82-990a-cbf9deaf0ac2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:33.959213 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9fc4d3-21fc-4e82-990a-cbf9deaf0ac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:33.960816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9fc4d3-21fc-4e82-990a-cbf9deaf0ac2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:33.962593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 20/44] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:33:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:33:33.968173 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fc4d3-21fc-4e82-990a-cbf9deaf0ac2 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:33.984739 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:33.996585 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27c824-af46-4aad-a2d8-26bd01540c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:33.997588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27c824-af46-4aad-a2d8-26bd01540c82 None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:33.997884 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27c824-af46-4aad-a2d8-26bd01540c82 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:33.998358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27c824-af46-4aad-a2d8-26bd01540c82 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:33.999477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27c824-af46-4aad-a2d8-26bd01540c82 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:34.001398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27c824-af46-4aad-a2d8-26bd01540c82 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:34.017009 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 25/45] 10.222.0.77 () {60 vars in 1131 bytes} [Tue Jul 19 20:33:33 2022] POST /identity/v3/roles => generated 223 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:33:34.086813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9fc4d3-21fc-4e82-990a-cbf9deaf0ac2 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:34.124814 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eea04e-af68-449c-8480-2b1a86ea1ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:34.125576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eea04e-af68-449c-8480-2b1a86ea1ba8 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:34.126481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eea04e-af68-449c-8480-2b1a86ea1ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:34.126707 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eea04e-af68-449c-8480-2b1a86ea1ba8 None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:34.127481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eea04e-af68-449c-8480-2b1a86ea1ba8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:34.128981 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eea04e-af68-449c-8480-2b1a86ea1ba8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:34.167298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 21/46] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jul 19 20:33:33 2022] POST /identity/v3/projects => generated 312 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:33:35.714032 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d4287-d964-4cd9-b9ea-a805f7ef46a9 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:35.714577 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d4287-d964-4cd9-b9ea-a805f7ef46a9 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:35.714577 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d4287-d964-4cd9-b9ea-a805f7ef46a9 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:35.716021 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 26/47] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:35.722274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd2432-8476-4f11-987d-f4d17ee66f02 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:35.722662 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd2432-8476-4f11-987d-f4d17ee66f02 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:35.722841 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd2432-8476-4f11-987d-f4d17ee66f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:35.739348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-38bd2432-8476-4f11-987d-f4d17ee66f02 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:35.740554 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-38bd2432-8476-4f11-987d-f4d17ee66f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:35.800023 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:35.811289 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 22/48] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:35.831369 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d4287-d964-4cd9-b9ea-a805f7ef46a9 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:35.937609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d4287-d964-4cd9-b9ea-a805f7ef46a9 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:35.970915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fe393-6615-4518-b272-1b62f5f22c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:35.971676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fe393-6615-4518-b272-1b62f5f22c98 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:35.971968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fe393-6615-4518-b272-1b62f5f22c98 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:35.972250 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32fe393-6615-4518-b272-1b62f5f22c98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:35.982239 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32fe393-6615-4518-b272-1b62f5f22c98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:33:35.990661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-d32fe393-6615-4518-b272-1b62f5f22c98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:33:35.990661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:33:35.990661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:33:35.990661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:33:35.990661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:33:35.990661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:33:35.990661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:33:35.990661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:33:35.990661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:33:35.990661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:33:35.990661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:33:35.990661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:33:35.990661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:33:35.990661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:33:35.990661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:33:35.990661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:33:35.991536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:33:35.991536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:33:35.991536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:33:35.991536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:33:35.991536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:33:35.991536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:33:35.991536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:33:35.991536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:33:35.991536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:33:35.991536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:33:35.991536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:33:35.991536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:33:35.991536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:33:35.991536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:33:35.991536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:33:35.991536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:33:35.992383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:33:35.992383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:33:35.992383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:33:35.992383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:33:35.992383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:33:35.992383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:33:35.992383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:33:35.992383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:33:35.992383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:33:35.992383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:33:35.992383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:33:35.992383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:33:35.992383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 27/49] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:33:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:33:35.998012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd2432-8476-4f11-987d-f4d17ee66f02 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:36.098899 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd2432-8476-4f11-987d-f4d17ee66f02 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:36.134334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f358316-1c70-4f2d-a1ab-042935edf12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:36.135008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f358316-1c70-4f2d-a1ab-042935edf12b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:36.135324 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f358316-1c70-4f2d-a1ab-042935edf12b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:36.135607 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f358316-1c70-4f2d-a1ab-042935edf12b None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:36.136366 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f358316-1c70-4f2d-a1ab-042935edf12b None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:36.136679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f358316-1c70-4f2d-a1ab-042935edf12b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:36.138051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f358316-1c70-4f2d-a1ab-042935edf12b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:36.147035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 23/50] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:33:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:36.152754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fe393-6615-4518-b272-1b62f5f22c98 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:36.172060 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:36.197056 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcba78-35f2-46a1-80fb-67e42c4a416b None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:36.197348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcba78-35f2-46a1-80fb-67e42c4a416b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:36.197696 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fcba78-35f2-46a1-80fb-67e42c4a416b None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:36.199208 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 24/51] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:33:36.204939 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5c773-3604-4826-88f1-a893b4c1b97c None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:36.205232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5c773-3604-4826-88f1-a893b4c1b97c None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:36.205514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5c773-3604-4826-88f1-a893b4c1b97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:36.258906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32fe393-6615-4518-b272-1b62f5f22c98 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:36.295924 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11554bfb-3077-4313-a780-582d6031bcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:36.296826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11554bfb-3077-4313-a780-582d6031bcf5 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:36.297112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11554bfb-3077-4313-a780-582d6031bcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:36.297878 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11554bfb-3077-4313-a780-582d6031bcf5 None admin] PATH_INFO: `/v3/users/70a97f9c967d4ba3819e7f4712b48b9e` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:36.299160 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11554bfb-3077-4313-a780-582d6031bcf5 None admin] RBAC: Authorizing `identity:get_user(user_id=70a97f9c967d4ba3819e7f4712b48b9e)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:36.300673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11554bfb-3077-4313-a780-582d6031bcf5 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:36.302405 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 28/52] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:33:36 2022] GET /identity/v3/users/70a97f9c967d4ba3819e7f4712b48b9e => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:36.307964 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11554bfb-3077-4313-a780-582d6031bcf5 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:36.327507 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-65c5c773-3604-4826-88f1-a893b4c1b97c None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:36.328759 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-65c5c773-3604-4826-88f1-a893b4c1b97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:36.381540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:36.393724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:36.396100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 25/53] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:36.410012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11554bfb-3077-4313-a780-582d6031bcf5 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:36.419047 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5c773-3604-4826-88f1-a893b4c1b97c None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:36.444178 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc67f7f-222b-4d80-8fb5-f0b1e6a4140b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:36.444984 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc67f7f-222b-4d80-8fb5-f0b1e6a4140b None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:36.445273 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc67f7f-222b-4d80-8fb5-f0b1e6a4140b None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:36.445550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc67f7f-222b-4d80-8fb5-f0b1e6a4140b None admin] PATH_INFO: `/v3/domains/default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:36.446749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc67f7f-222b-4d80-8fb5-f0b1e6a4140b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:36.448238 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc67f7f-222b-4d80-8fb5-f0b1e6a4140b None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:36.449865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 29/54] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:33:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:33:36.456153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc67f7f-222b-4d80-8fb5-f0b1e6a4140b None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:36.519754 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5c773-3604-4826-88f1-a893b4c1b97c None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:36.556640 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455e22e-2eb1-4d84-a37a-61ffdb4290b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:36.557441 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455e22e-2eb1-4d84-a37a-61ffdb4290b1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:36.557727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455e22e-2eb1-4d84-a37a-61ffdb4290b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:36.558011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455e22e-2eb1-4d84-a37a-61ffdb4290b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:36.559181 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455e22e-2eb1-4d84-a37a-61ffdb4290b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:36.560655 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455e22e-2eb1-4d84-a37a-61ffdb4290b1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:36.562268 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 26/55] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:33:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:33:36.563762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc67f7f-222b-4d80-8fb5-f0b1e6a4140b None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:36.567776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455e22e-2eb1-4d84-a37a-61ffdb4290b1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:36.600090 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b341c48-a798-4b59-b058-be4c4b38bc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:36.600753 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b341c48-a798-4b59-b058-be4c4b38bc6b None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:36.601042 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b341c48-a798-4b59-b058-be4c4b38bc6b None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:36.601324 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b341c48-a798-4b59-b058-be4c4b38bc6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:36.602170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b341c48-a798-4b59-b058-be4c4b38bc6b None admin] RBAC: Adding query filter params (role.id=b30f01ef95004a1b84fc029830bdf053, scope.domain.id=default, user.id=70a97f9c967d4ba3819e7f4712b48b9e) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:36.602489 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b341c48-a798-4b59-b058-be4c4b38bc6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:36.604061 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b341c48-a798-4b59-b058-be4c4b38bc6b None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:36.610449 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 30/56] 10.222.0.77 () {56 vars in 1322 bytes} [Tue Jul 19 20:33:36 2022] GET /identity/v3/role_assignments?user.id=70a97f9c967d4ba3819e7f4712b48b9e&scope.domain.id=default&role.id=b30f01ef95004a1b84fc029830bdf053 => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:33:36.625615 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:36.682189 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455e22e-2eb1-4d84-a37a-61ffdb4290b1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:36.717678 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce68cb-4cdf-4067-a9f7-d12e329d8b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:36.718368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce68cb-4cdf-4067-a9f7-d12e329d8b84 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:36.718660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce68cb-4cdf-4067-a9f7-d12e329d8b84 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:36.718945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce68cb-4cdf-4067-a9f7-d12e329d8b84 None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:36.720279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce68cb-4cdf-4067-a9f7-d12e329d8b84 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:36.721866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce68cb-4cdf-4067-a9f7-d12e329d8b84 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:36.748508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 27/57] 10.222.0.77 () {60 vars in 1140 bytes} [Tue Jul 19 20:33:36 2022] POST /identity/v3/projects => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:33:38.844676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a8070-aa06-4146-a992-222d5c317ba0 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:38.845199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a8070-aa06-4146-a992-222d5c317ba0 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:38.845287 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a8070-aa06-4146-a992-222d5c317ba0 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:38.846631 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 31/58] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:38.852351 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929af9af-fb27-4053-8a89-0e765e6bc1f0 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:38.852753 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929af9af-fb27-4053-8a89-0e765e6bc1f0 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:38.852928 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929af9af-fb27-4053-8a89-0e765e6bc1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:38.869947 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-929af9af-fb27-4053-8a89-0e765e6bc1f0 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:38.871209 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-929af9af-fb27-4053-8a89-0e765e6bc1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:38.937338 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 28/59] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:33:38.961837 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a8070-aa06-4146-a992-222d5c317ba0 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:38.980193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:39.067448 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a8070-aa06-4146-a992-222d5c317ba0 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:39.100436 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db3b71-02e2-4263-bdc8-3050230aa962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:39.101164 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db3b71-02e2-4263-bdc8-3050230aa962 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:39.101454 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db3b71-02e2-4263-bdc8-3050230aa962 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:39.101728 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db3b71-02e2-4263-bdc8-3050230aa962 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:39.102901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db3b71-02e2-4263-bdc8-3050230aa962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:39.104365 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db3b71-02e2-4263-bdc8-3050230aa962 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:39.105980 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 32/60] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:33:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:39.111678 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929af9af-fb27-4053-8a89-0e765e6bc1f0 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:39.150651 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:39.211741 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929af9af-fb27-4053-8a89-0e765e6bc1f0 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:39.246578 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6d9c2-0bad-4929-a47b-f23703e347c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:39.247246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6d9c2-0bad-4929-a47b-f23703e347c1 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:39.247570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6d9c2-0bad-4929-a47b-f23703e347c1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:39.247854 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6d9c2-0bad-4929-a47b-f23703e347c1 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:39.248581 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6d9c2-0bad-4929-a47b-f23703e347c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:39.250051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6d9c2-0bad-4929-a47b-f23703e347c1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:39.276075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 29/61] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jul 19 20:33:39 2022] POST /identity/v3/users => generated 275 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:33:42.556684 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188890f-c303-46bc-8f4d-34d376b6fcdf None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:42.557558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188890f-c303-46bc-8f4d-34d376b6fcdf None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:42.558141 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188890f-c303-46bc-8f4d-34d376b6fcdf None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:42.559945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 33/62] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:42.576089 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71773606-49d8-40c3-99b9-4e16b2269d42 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:42.576575 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71773606-49d8-40c3-99b9-4e16b2269d42 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:42.576677 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71773606-49d8-40c3-99b9-4e16b2269d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:42.586529 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb959e-5e0c-4bfc-85bc-c5779b4849f9 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:42.587181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb959e-5e0c-4bfc-85bc-c5779b4849f9 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:42.587701 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb959e-5e0c-4bfc-85bc-c5779b4849f9 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:42.589282 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 34/63] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:42.594724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ab171-64ed-4ef7-98d0-76e945978dca None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:42.595240 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ab171-64ed-4ef7-98d0-76e945978dca None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:42.595745 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ab171-64ed-4ef7-98d0-76e945978dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:42.597574 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-71773606-49d8-40c3-99b9-4e16b2269d42 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:42.599070 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-71773606-49d8-40c3-99b9-4e16b2269d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:42.626080 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-894ab171-64ed-4ef7-98d0-76e945978dca None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:42.627312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-894ab171-64ed-4ef7-98d0-76e945978dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:42.686186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 30/64] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:42.688859 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb5a2d-d51d-4e9c-807a-400cace3645a None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:42.689576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb5a2d-d51d-4e9c-807a-400cace3645a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:42.690548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb5a2d-d51d-4e9c-807a-400cace3645a None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:42.692349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 31/65] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:42.700528 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675833d-54c5-4128-8d53-98fbb331d5bc None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:42.701170 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675833d-54c5-4128-8d53-98fbb331d5bc None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:42.701170 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675833d-54c5-4128-8d53-98fbb331d5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:42.720876 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 35/66] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:33:42.721736 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ab171-64ed-4ef7-98d0-76e945978dca None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:42.727282 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-0675833d-54c5-4128-8d53-98fbb331d5bc None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:42.728716 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-0675833d-54c5-4128-8d53-98fbb331d5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:42.737098 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:42.766334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:42.825910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 32/67] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:42.827620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675833d-54c5-4128-8d53-98fbb331d5bc None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:42.830009 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ab171-64ed-4ef7-98d0-76e945978dca None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:42.883428 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e6fc3-23cb-4dbd-92bc-d19336834b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:42.884510 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6fc3-23cb-4dbd-92bc-d19336834b9c None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:42.884974 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6fc3-23cb-4dbd-92bc-d19336834b9c None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:42.887354 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6fc3-23cb-4dbd-92bc-d19336834b9c None admin] PATH_INFO: `/v3/roles/member` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:42.908309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e6fc3-23cb-4dbd-92bc-d19336834b9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:33:42.916676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-fb9e6fc3-23cb-4dbd-92bc-d19336834b9c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:33:42.916676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:33:42.916676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:33:42.916676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:33:42.916676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:33:42.916676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:33:42.916676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:33:42.916676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:33:42.916676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:33:42.916676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:33:42.916676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:33:42.916676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:33:42.916676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:33:42.916676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:33:42.916676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:33:42.916676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:33:42.917961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:33:42.917961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:33:42.917961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:33:42.917961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:33:42.917961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:33:42.917961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:33:42.917961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:33:42.917961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:33:42.917961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:33:42.917961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:33:42.917961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:33:42.917961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:33:42.917961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:33:42.917961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:33:42.917961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:33:42.917961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:33:42.918859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:33:42.918859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:33:42.918859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:33:42.918859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:33:42.918859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:33:42.918859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:33:42.918859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:33:42.918859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:33:42.918859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:33:42.918859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:33:42.918859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:33:42.918859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:33:42.920949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 36/68] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:33:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:33:42.926393 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e6fc3-23cb-4dbd-92bc-d19336834b9c None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:42.963464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675833d-54c5-4128-8d53-98fbb331d5bc None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:43.002501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:43.007094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3083b7-2740-496d-91d4-0ce054e8a076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:43.007935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3083b7-2740-496d-91d4-0ce054e8a076 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:43.008216 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3083b7-2740-496d-91d4-0ce054e8a076 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:43.008674 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3083b7-2740-496d-91d4-0ce054e8a076 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:43.021188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3083b7-2740-496d-91d4-0ce054e8a076 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:33:43.028709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-3c3083b7-2740-496d-91d4-0ce054e8a076 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:33:43.028709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:33:43.028709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:33:43.028709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:33:43.028709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:33:43.028709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:33:43.028709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:33:43.028709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:33:43.028709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:33:43.028709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:33:43.028709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:33:43.028709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:33:43.028709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:33:43.028709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:33:43.028709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:33:43.028709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:33:43.029592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:33:43.029592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:33:43.029592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:33:43.029592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:33:43.029592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:33:43.029592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:33:43.029592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:33:43.029592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:33:43.029592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:33:43.029592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:33:43.029592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:33:43.029592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:33:43.029592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:33:43.029592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:33:43.029592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:33:43.029592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:33:43.030348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:33:43.030348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:33:43.030348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:33:43.030348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:33:43.030348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:33:43.030348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:33:43.030348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:33:43.030348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:33:43.030348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:33:43.030348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:33:43.030348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:33:43.030348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:33:43.030348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 33/69] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:33:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:33:43.031854 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ad851-d567-401f-9402-0365de207be2 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:43.031854 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ad851-d567-401f-9402-0365de207be2 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:43.032159 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ad851-d567-401f-9402-0365de207be2 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:43.033344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 34/70] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:43.034054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ad851-d567-401f-9402-0365de207be2 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:43.040478 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e6fc3-23cb-4dbd-92bc-d19336834b9c None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:43.054923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:43.083831 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eae3ab-eaff-4a4c-8c78-6544202221c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:43.084586 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eae3ab-eaff-4a4c-8c78-6544202221c6 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:43.084867 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eae3ab-eaff-4a4c-8c78-6544202221c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:43.085144 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eae3ab-eaff-4a4c-8c78-6544202221c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:43.095998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eae3ab-eaff-4a4c-8c78-6544202221c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:33:43.104284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-44eae3ab-eaff-4a4c-8c78-6544202221c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:33:43.104284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:33:43.104284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:33:43.104284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:33:43.104284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:33:43.104284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:33:43.104284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:33:43.104284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:33:43.104284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:33:43.104284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:33:43.104284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:33:43.104284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:33:43.104284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:33:43.104284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:33:43.104284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:33:43.104284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:33:43.105133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:33:43.105133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:33:43.105133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:33:43.105133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:33:43.105133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:33:43.105133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:33:43.105133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:33:43.105133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:33:43.105133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:33:43.105133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:33:43.105133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:33:43.105133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:33:43.105133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:33:43.105133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:33:43.105133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:33:43.105133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:33:43.105895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:33:43.105895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:33:43.105895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:33:43.105895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:33:43.105895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:33:43.105895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:33:43.105895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:33:43.105895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:33:43.105895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:33:43.105895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:33:43.105895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:33:43.105895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:33:43.105895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 37/71] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jul 19 20:33:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:33:43.106536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eae3ab-eaff-4a4c-8c78-6544202221c6 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:43.153971 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ad851-d567-401f-9402-0365de207be2 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:43.190690 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85bef42-9a3e-4f58-828d-e86d3063f536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:43.191396 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bef42-9a3e-4f58-828d-e86d3063f536 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:43.191692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bef42-9a3e-4f58-828d-e86d3063f536 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:43.191977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85bef42-9a3e-4f58-828d-e86d3063f536 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:43.192732 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85bef42-9a3e-4f58-828d-e86d3063f536 None admin] RBAC: Adding query filter params (name=member) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:43.193049 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85bef42-9a3e-4f58-828d-e86d3063f536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:43.194449 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85bef42-9a3e-4f58-828d-e86d3063f536 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:43.203514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 35/72] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:33:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:43.204866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fe725-bda7-42cd-b14a-10de531ff9c2 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:43.205211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fe725-bda7-42cd-b14a-10de531ff9c2 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:43.205534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fe725-bda7-42cd-b14a-10de531ff9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:43.218006 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eae3ab-eaff-4a4c-8c78-6544202221c6 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:43.222225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-b28fe725-bda7-42cd-b14a-10de531ff9c2 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:43.223461 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b28fe725-bda7-42cd-b14a-10de531ff9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:43.251948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569a05a-8794-4692-9a92-a434638881f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:43.252619 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569a05a-8794-4692-9a92-a434638881f3 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:43.252924 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569a05a-8794-4692-9a92-a434638881f3 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:43.253273 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569a05a-8794-4692-9a92-a434638881f3 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:43.254277 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569a05a-8794-4692-9a92-a434638881f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:43.254814 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569a05a-8794-4692-9a92-a434638881f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:43.257116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569a05a-8794-4692-9a92-a434638881f3 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:43.259128 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:43.269225 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 38/73] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:33:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:43.270031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569a05a-8794-4692-9a92-a434638881f3 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:43.293169 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 36/74] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:43.307682 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83cdac-fe6b-45ae-9b12-69f9bff3e5d6 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:43.307682 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83cdac-fe6b-45ae-9b12-69f9bff3e5d6 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:43.307682 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83cdac-fe6b-45ae-9b12-69f9bff3e5d6 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:43.307682 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 37/75] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:43.307682 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83cdac-fe6b-45ae-9b12-69f9bff3e5d6 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:43.307682 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:43.377829 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569a05a-8794-4692-9a92-a434638881f3 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:43.398853 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83cdac-fe6b-45ae-9b12-69f9bff3e5d6 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:43.413459 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfd9f2-8542-4edf-bbeb-f675f8b37960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:43.414127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfd9f2-8542-4edf-bbeb-f675f8b37960 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:43.414410 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfd9f2-8542-4edf-bbeb-f675f8b37960 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:43.414687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfd9f2-8542-4edf-bbeb-f675f8b37960 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:43.415488 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfd9f2-8542-4edf-bbeb-f675f8b37960 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:43.415778 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfd9f2-8542-4edf-bbeb-f675f8b37960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:43.417258 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfd9f2-8542-4edf-bbeb-f675f8b37960 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:43.425357 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 39/76] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:33:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:43.426140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfd9f2-8542-4edf-bbeb-f675f8b37960 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:43.439130 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdacd4-b1cd-4a26-865d-441c88083b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:43.440039 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdacd4-b1cd-4a26-865d-441c88083b32 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:43.440329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdacd4-b1cd-4a26-865d-441c88083b32 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:43.440616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdacd4-b1cd-4a26-865d-441c88083b32 None admin] PATH_INFO: `/v3/users/474d7a7ff49c4da4ad22b9479082adda` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:43.456301 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdacd4-b1cd-4a26-865d-441c88083b32 None admin] RBAC: Authorizing `identity:get_user(user_id=474d7a7ff49c4da4ad22b9479082adda)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:43.457811 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdacd4-b1cd-4a26-865d-441c88083b32 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:43.459614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 38/77] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:33:43 2022] GET /identity/v3/users/474d7a7ff49c4da4ad22b9479082adda => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:43.460784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc59af5-1346-4b45-be88-9392f1e83855 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:43.461073 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc59af5-1346-4b45-be88-9392f1e83855 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:43.461355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc59af5-1346-4b45-be88-9392f1e83855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:43.477467 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-4dc59af5-1346-4b45-be88-9392f1e83855 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:43.478674 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-4dc59af5-1346-4b45-be88-9392f1e83855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:43.489533 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:43.532869 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfd9f2-8542-4edf-bbeb-f675f8b37960 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:43.536060 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:43.544461 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 39/78] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:43.545268 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc59af5-1346-4b45-be88-9392f1e83855 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:43.584257 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49337705-c794-41b4-8a5f-262c97d6c5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:43.585274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49337705-c794-41b4-8a5f-262c97d6c5a0 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:43.585560 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49337705-c794-41b4-8a5f-262c97d6c5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:43.585834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49337705-c794-41b4-8a5f-262c97d6c5a0 None admin] PATH_INFO: `/v3/users/70a97f9c967d4ba3819e7f4712b48b9e` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:43.587052 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49337705-c794-41b4-8a5f-262c97d6c5a0 None admin] RBAC: Authorizing `identity:get_user(user_id=70a97f9c967d4ba3819e7f4712b48b9e)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:43.588548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49337705-c794-41b4-8a5f-262c97d6c5a0 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:43.590183 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 40/79] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:33:43 2022] GET /identity/v3/users/70a97f9c967d4ba3819e7f4712b48b9e => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:43.590939 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49337705-c794-41b4-8a5f-262c97d6c5a0 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:43.644495 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc59af5-1346-4b45-be88-9392f1e83855 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:43.681168 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3051ca7-36ed-4bc5-b345-545d0576f2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:43.681973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3051ca7-36ed-4bc5-b345-545d0576f2a1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:43.682260 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3051ca7-36ed-4bc5-b345-545d0576f2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:43.682546 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3051ca7-36ed-4bc5-b345-545d0576f2a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:43.693124 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3051ca7-36ed-4bc5-b345-545d0576f2a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:33:43.694748 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49337705-c794-41b4-8a5f-262c97d6c5a0 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:43.701011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-b3051ca7-36ed-4bc5-b345-545d0576f2a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:33:43.701011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:33:43.701011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:33:43.701011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:33:43.701011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:33:43.701011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:33:43.701011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:33:43.701011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:33:43.701011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:33:43.701011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:33:43.701011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:33:43.701011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:33:43.701011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:33:43.701011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:33:43.701011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:33:43.701011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:33:43.701849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:33:43.701849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:33:43.701849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:33:43.701849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:33:43.701849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:33:43.701849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:33:43.701849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:33:43.701849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:33:43.701849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:33:43.701849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:33:43.701849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:33:43.701849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:33:43.701849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:33:43.701849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:33:43.701849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:33:43.701849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:33:43.702620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:33:43.702620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:33:43.702620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:33:43.702620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:33:43.702620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:33:43.702620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:33:43.702620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:33:43.702620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:33:43.702620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:33:43.702620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:33:43.702620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:33:43.702620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:33:43.702620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 40/80] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:33:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:33:43.703254 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3051ca7-36ed-4bc5-b345-545d0576f2a1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:43.724639 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:43.733755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f561d-4877-4e62-8d37-8b0df6f36a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:43.734633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f561d-4877-4e62-8d37-8b0df6f36a8a None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:43.734917 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f561d-4877-4e62-8d37-8b0df6f36a8a None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:43.735202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f561d-4877-4e62-8d37-8b0df6f36a8a None admin] PATH_INFO: `/v3/users/474d7a7ff49c4da4ad22b9479082adda` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:43.737013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f561d-4877-4e62-8d37-8b0df6f36a8a None admin] RBAC: Authorizing `identity:get_user(user_id=474d7a7ff49c4da4ad22b9479082adda)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:43.738463 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f561d-4877-4e62-8d37-8b0df6f36a8a None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:43.740276 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 41/81] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:33:43 2022] GET /identity/v3/users/474d7a7ff49c4da4ad22b9479082adda => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:43.740879 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f561d-4877-4e62-8d37-8b0df6f36a8a None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:43.764784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:43.811654 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3051ca7-36ed-4bc5-b345-545d0576f2a1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:43.839937 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f561d-4877-4e62-8d37-8b0df6f36a8a None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:43.845103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9254c-9e18-4641-aa40-8c3b1ff42a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:43.845749 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9254c-9e18-4641-aa40-8c3b1ff42a95 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:43.846035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9254c-9e18-4641-aa40-8c3b1ff42a95 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:43.846315 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9254c-9e18-4641-aa40-8c3b1ff42a95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:43.873666 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e921c-a285-4df8-b965-c4692b47af4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:43.874469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e921c-a285-4df8-b965-c4692b47af4c None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:43.874760 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e921c-a285-4df8-b965-c4692b47af4c None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:43.875045 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e921c-a285-4df8-b965-c4692b47af4c None admin] PATH_INFO: `/v3/domains/default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:43.876335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e921c-a285-4df8-b965-c4692b47af4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:43.877794 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e921c-a285-4df8-b965-c4692b47af4c None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:43.879453 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 42/82] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:33:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:43.880220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e921c-a285-4df8-b965-c4692b47af4c None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:43.918734 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9254c-9e18-4641-aa40-8c3b1ff42a95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:43.920193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f9254c-9e18-4641-aa40-8c3b1ff42a95 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:43.942999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:43.973827 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:43.981896 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e921c-a285-4df8-b965-c4692b47af4c None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:44.015765 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0198965-5021-4675-839f-497dc6d89ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:44.016965 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0198965-5021-4675-839f-497dc6d89ff4 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:44.017229 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0198965-5021-4675-839f-497dc6d89ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:44.017503 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0198965-5021-4675-839f-497dc6d89ff4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:44.020694 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 41/83] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:33:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:44.021526 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9254c-9e18-4641-aa40-8c3b1ff42a95 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:44.089730 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0198965-5021-4675-839f-497dc6d89ff4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:44.091202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0198965-5021-4675-839f-497dc6d89ff4 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:44.119552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9254c-9e18-4641-aa40-8c3b1ff42a95 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:44.150562 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:44.153292 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12247772-96ec-4732-80ff-d1beae3963ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:44.153966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12247772-96ec-4732-80ff-d1beae3963ee None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:44.154256 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12247772-96ec-4732-80ff-d1beae3963ee None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:44.154537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12247772-96ec-4732-80ff-d1beae3963ee None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:44.155347 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12247772-96ec-4732-80ff-d1beae3963ee None admin] RBAC: Adding query filter params (name=member) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:44.155908 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12247772-96ec-4732-80ff-d1beae3963ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:44.157809 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12247772-96ec-4732-80ff-d1beae3963ee None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:44.166644 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 42/84] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:33:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:44.167483 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12247772-96ec-4732-80ff-d1beae3963ee None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:44.186684 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:44.195906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 43/85] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:33:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:44.201543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0198965-5021-4675-839f-497dc6d89ff4 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:44.268478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12247772-96ec-4732-80ff-d1beae3963ee None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:44.298598 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0198965-5021-4675-839f-497dc6d89ff4 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:44.302024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e587c8-f017-4c66-902c-437edffb124d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:44.302680 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e587c8-f017-4c66-902c-437edffb124d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:44.302971 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e587c8-f017-4c66-902c-437edffb124d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:44.303276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e587c8-f017-4c66-902c-437edffb124d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:44.331511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead3729-ed97-4e7f-b2fd-1e7281b8e5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:44.332186 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead3729-ed97-4e7f-b2fd-1e7281b8e5cf None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:44.332481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead3729-ed97-4e7f-b2fd-1e7281b8e5cf None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:44.332757 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead3729-ed97-4e7f-b2fd-1e7281b8e5cf None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:44.333477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead3729-ed97-4e7f-b2fd-1e7281b8e5cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:44.334936 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead3729-ed97-4e7f-b2fd-1e7281b8e5cf None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:44.361187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 44/86] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jul 19 20:33:44 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:33:44.362266 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead3729-ed97-4e7f-b2fd-1e7281b8e5cf None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:44.382332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:44.382882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e587c8-f017-4c66-902c-437edffb124d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:44.384519 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e587c8-f017-4c66-902c-437edffb124d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:44.403492 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:44.481484 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead3729-ed97-4e7f-b2fd-1e7281b8e5cf None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:44.502728 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 43/87] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:33:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:44.503442 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e587c8-f017-4c66-902c-437edffb124d None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:44.531255 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa00209-c076-471a-b036-fd439e10ec72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:44.532281 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa00209-c076-471a-b036-fd439e10ec72 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:44.532568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa00209-c076-471a-b036-fd439e10ec72 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:44.532848 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa00209-c076-471a-b036-fd439e10ec72 None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:44.534180 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa00209-c076-471a-b036-fd439e10ec72 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf9c36dd93649fb92ed3e7f9f20258d)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:44.535584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa00209-c076-471a-b036-fd439e10ec72 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:44.537323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 45/88] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:33:44 2022] GET /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:44.538094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa00209-c076-471a-b036-fd439e10ec72 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:44.620152 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e587c8-f017-4c66-902c-437edffb124d None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:44.646581 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:44.649201 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:44.666556 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa00209-c076-471a-b036-fd439e10ec72 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:44.673714 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cabece-a40d-4db0-bbf6-dcc920d2a393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:44.674595 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cabece-a40d-4db0-bbf6-dcc920d2a393 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:44.674873 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cabece-a40d-4db0-bbf6-dcc920d2a393 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:44.675489 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cabece-a40d-4db0-bbf6-dcc920d2a393 None admin] PATH_INFO: `/v3/users/474d7a7ff49c4da4ad22b9479082adda` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:44.676458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cabece-a40d-4db0-bbf6-dcc920d2a393 None admin] RBAC: Authorizing `identity:get_user(user_id=474d7a7ff49c4da4ad22b9479082adda)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:44.677999 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cabece-a40d-4db0-bbf6-dcc920d2a393 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:44.679648 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 44/89] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:33:44 2022] GET /identity/v3/users/474d7a7ff49c4da4ad22b9479082adda => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:44.680376 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cabece-a40d-4db0-bbf6-dcc920d2a393 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:44.714996 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cb757-b950-44b5-bd51-35c2401b5cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:44.715983 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cb757-b950-44b5-bd51-35c2401b5cd2 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:44.716270 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cb757-b950-44b5-bd51-35c2401b5cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:44.716549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cb757-b950-44b5-bd51-35c2401b5cd2 None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:44.717834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cb757-b950-44b5-bd51-35c2401b5cd2 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf9c36dd93649fb92ed3e7f9f20258d)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:44.719997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cb757-b950-44b5-bd51-35c2401b5cd2 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:44.721535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 46/90] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:33:44 2022] GET /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:44.722095 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cb757-b950-44b5-bd51-35c2401b5cd2 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:44.828779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cabece-a40d-4db0-bbf6-dcc920d2a393 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:44.857356 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cb757-b950-44b5-bd51-35c2401b5cd2 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:44.869934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99631a15-5baa-4907-99e2-234ee3b88e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:44.870996 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99631a15-5baa-4907-99e2-234ee3b88e04 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:44.871401 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99631a15-5baa-4907-99e2-234ee3b88e04 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:44.871756 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99631a15-5baa-4907-99e2-234ee3b88e04 None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:44.873051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99631a15-5baa-4907-99e2-234ee3b88e04 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf9c36dd93649fb92ed3e7f9f20258d)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:44.874569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99631a15-5baa-4907-99e2-234ee3b88e04 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:44.876964 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 45/91] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:33:44 2022] GET /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:44.877885 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99631a15-5baa-4907-99e2-234ee3b88e04 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:44.903401 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c9a76-5380-4c9d-88cd-c66331b4b8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:44.905050 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c9a76-5380-4c9d-88cd-c66331b4b8b6 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:44.906070 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c9a76-5380-4c9d-88cd-c66331b4b8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:44.906830 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c9a76-5380-4c9d-88cd-c66331b4b8b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:44.909186 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c9a76-5380-4c9d-88cd-c66331b4b8b6 None admin] RBAC: Adding query filter params (role.id=a2021efb2e4e459cbfa73f6987297bca, scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d, user.id=474d7a7ff49c4da4ad22b9479082adda) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:44.910012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c9a76-5380-4c9d-88cd-c66331b4b8b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:44.912389 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c9a76-5380-4c9d-88cd-c66331b4b8b6 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:44.920961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 47/92] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:33:44 2022] GET /identity/v3/role_assignments?user.id=474d7a7ff49c4da4ad22b9479082adda&scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d&role.id=a2021efb2e4e459cbfa73f6987297bca => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:44.921793 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c9a76-5380-4c9d-88cd-c66331b4b8b6 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:44.948135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:44.959418 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:45.067384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c9a76-5380-4c9d-88cd-c66331b4b8b6 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:45.093866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99631a15-5baa-4907-99e2-234ee3b88e04 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:45.135593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02deb901-e2c8-44c4-befd-11c6b90279ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:45.136455 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02deb901-e2c8-44c4-befd-11c6b90279ee None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:45.136759 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02deb901-e2c8-44c4-befd-11c6b90279ee None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:45.137148 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02deb901-e2c8-44c4-befd-11c6b90279ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:45.144726 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c813ca-f9ec-411d-9d05-0420f042ab9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:45.145411 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c813ca-f9ec-411d-9d05-0420f042ab9d None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:45.145710 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c813ca-f9ec-411d-9d05-0420f042ab9d None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:45.145985 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c813ca-f9ec-411d-9d05-0420f042ab9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:45.146849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c813ca-f9ec-411d-9d05-0420f042ab9d None admin] RBAC: Adding query filter params (role.id=b30f01ef95004a1b84fc029830bdf053, scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d, user.id=70a97f9c967d4ba3819e7f4712b48b9e) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:45.147167 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c813ca-f9ec-411d-9d05-0420f042ab9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:45.150517 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c813ca-f9ec-411d-9d05-0420f042ab9d None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:45.155245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 48/93] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:33:44 2022] GET /identity/v3/role_assignments?user.id=70a97f9c967d4ba3819e7f4712b48b9e&scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d&role.id=b30f01ef95004a1b84fc029830bdf053 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:45.160202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c813ca-f9ec-411d-9d05-0420f042ab9d None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:45.217911 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02deb901-e2c8-44c4-befd-11c6b90279ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:45.219640 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02deb901-e2c8-44c4-befd-11c6b90279ee None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:45.279213 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:45.320656 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:45.334622 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 46/94] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:33:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:45.338031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c813ca-f9ec-411d-9d05-0420f042ab9d None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:45.346195 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02deb901-e2c8-44c4-befd-11c6b90279ee None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:45.465911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c7e52-528d-491d-880a-9975afb19b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:45.466575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c7e52-528d-491d-880a-9975afb19b34 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:45.466860 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c7e52-528d-491d-880a-9975afb19b34 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:45.467136 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c7e52-528d-491d-880a-9975afb19b34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:45.468047 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c7e52-528d-491d-880a-9975afb19b34 None admin] RBAC: Adding query filter params (role.id=92567de587bf40dab488cc1eb666b221, scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d, user.id=474d7a7ff49c4da4ad22b9479082adda) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:45.468347 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c7e52-528d-491d-880a-9975afb19b34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:45.470357 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0c7e52-528d-491d-880a-9975afb19b34 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:45.480406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 49/95] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:33:45 2022] GET /identity/v3/role_assignments?user.id=474d7a7ff49c4da4ad22b9479082adda&scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d&role.id=92567de587bf40dab488cc1eb666b221 => generated 259 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:45.547019 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02deb901-e2c8-44c4-befd-11c6b90279ee None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:45.605116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349ad41-9420-4588-b629-62cf6ea6541b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:45.606427 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349ad41-9420-4588-b629-62cf6ea6541b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:45.606917 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349ad41-9420-4588-b629-62cf6ea6541b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:45.607451 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349ad41-9420-4588-b629-62cf6ea6541b None admin] PATH_INFO: `/v3/projects/cc13fa98a78e4965afbd5771a048b274` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:45.612037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349ad41-9420-4588-b629-62cf6ea6541b None admin] RBAC: Authorizing `identity:get_project(project_id=cc13fa98a78e4965afbd5771a048b274)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:45.614024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349ad41-9420-4588-b629-62cf6ea6541b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:45.616300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 47/96] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:33:45 2022] GET /identity/v3/projects/cc13fa98a78e4965afbd5771a048b274 => generated 312 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:45.622695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c7e52-528d-491d-880a-9975afb19b34 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:45.765831 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c7e52-528d-491d-880a-9975afb19b34 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:45.807302 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf093c17-5570-40c9-a8e8-b67d1fcb0012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:45.808002 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf093c17-5570-40c9-a8e8-b67d1fcb0012 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:45.808295 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf093c17-5570-40c9-a8e8-b67d1fcb0012 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:45.808581 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf093c17-5570-40c9-a8e8-b67d1fcb0012 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:45.809578 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf093c17-5570-40c9-a8e8-b67d1fcb0012 None admin] RBAC: Adding query filter params (role.id=a2021efb2e4e459cbfa73f6987297bca, scope.project.id=cc13fa98a78e4965afbd5771a048b274, user.id=474d7a7ff49c4da4ad22b9479082adda) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:45.809950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf093c17-5570-40c9-a8e8-b67d1fcb0012 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:45.811600 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf093c17-5570-40c9-a8e8-b67d1fcb0012 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:45.819016 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 50/97] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:33:45 2022] GET /identity/v3/role_assignments?user.id=474d7a7ff49c4da4ad22b9479082adda&scope.project.id=cc13fa98a78e4965afbd5771a048b274&role.id=a2021efb2e4e459cbfa73f6987297bca => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:47.017344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cff530-daed-453a-8351-da25b2b4a91b None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:47.018667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cff530-daed-453a-8351-da25b2b4a91b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:47.019381 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cff530-daed-453a-8351-da25b2b4a91b None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:47.021040 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 48/98] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:47.026637 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f211e-8b55-4bed-b437-a7b773d142fd None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:47.027790 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f211e-8b55-4bed-b437-a7b773d142fd None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:47.028274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f211e-8b55-4bed-b437-a7b773d142fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:47.050338 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-be3f211e-8b55-4bed-b437-a7b773d142fd None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:47.051968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-be3f211e-8b55-4bed-b437-a7b773d142fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:47.060792 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:47.149142 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 51/99] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:47.188758 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cff530-daed-453a-8351-da25b2b4a91b None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:47.211841 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:47.309932 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74026f-7551-4ac2-abcb-81a264a5b1b8 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:47.310763 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74026f-7551-4ac2-abcb-81a264a5b1b8 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:47.311491 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74026f-7551-4ac2-abcb-81a264a5b1b8 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:47.313861 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 52/100] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:47.321920 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6e683-c559-4e78-933c-71242f0b238d None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:47.322417 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6e683-c559-4e78-933c-71242f0b238d None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:47.322901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6e683-c559-4e78-933c-71242f0b238d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:47.338525 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cff530-daed-453a-8351-da25b2b4a91b None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:47.361302 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-45f6e683-c559-4e78-933c-71242f0b238d None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:47.362521 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-45f6e683-c559-4e78-933c-71242f0b238d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:47.430797 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8385793-2ab8-4c5f-94b4-2d0186a97ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:47.431849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8385793-2ab8-4c5f-94b4-2d0186a97ed5 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:47.432140 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8385793-2ab8-4c5f-94b4-2d0186a97ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:47.432421 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8385793-2ab8-4c5f-94b4-2d0186a97ed5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:47.436068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8385793-2ab8-4c5f-94b4-2d0186a97ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:47.437530 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8385793-2ab8-4c5f-94b4-2d0186a97ed5 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:47.439469 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 49/101] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:33:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:47.450371 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8385793-2ab8-4c5f-94b4-2d0186a97ed5 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:47.483805 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 53/102] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:47.522721 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6e683-c559-4e78-933c-71242f0b238d None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:47.618162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:47.641545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8385793-2ab8-4c5f-94b4-2d0186a97ed5 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:47.668566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:47.705698 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d545ad8-7b0d-4b4a-8a6c-0b0c48cc9eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:47.706666 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d545ad8-7b0d-4b4a-8a6c-0b0c48cc9eeb None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:47.707127 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d545ad8-7b0d-4b4a-8a6c-0b0c48cc9eeb None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:47.707594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d545ad8-7b0d-4b4a-8a6c-0b0c48cc9eeb None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:47.708650 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d545ad8-7b0d-4b4a-8a6c-0b0c48cc9eeb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:47.711291 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d545ad8-7b0d-4b4a-8a6c-0b0c48cc9eeb None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:47.731019 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6e683-c559-4e78-933c-71242f0b238d None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:47.757713 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 50/103] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jul 19 20:33:47 2022] POST /identity/v3/projects => generated 302 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:33:47.784832 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd85e32-d294-4ff2-b6a1-9c13e2b4f5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:47.786056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd85e32-d294-4ff2-b6a1-9c13e2b4f5c3 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:47.786619 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd85e32-d294-4ff2-b6a1-9c13e2b4f5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:47.787108 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd85e32-d294-4ff2-b6a1-9c13e2b4f5c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:47.800265 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd85e32-d294-4ff2-b6a1-9c13e2b4f5c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:33:47.809193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-7cd85e32-d294-4ff2-b6a1-9c13e2b4f5c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 20:33:47.809193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:33:47.809193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:33:47.809193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:33:47.809193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:33:47.809193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:33:47.809193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:33:47.809193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:33:47.809193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:33:47.809193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:33:47.809193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:33:47.809193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:33:47.809193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:33:47.809193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:33:47.809193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:33:47.809193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:33:47.810129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:33:47.810129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:33:47.810129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:33:47.810129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:33:47.810129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:33:47.810129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:33:47.810129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:33:47.810129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:33:47.810129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:33:47.810129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:33:47.810129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:33:47.810129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:33:47.810129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:33:47.810129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:33:47.810129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:33:47.810129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:33:47.810881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:33:47.810881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:33:47.810881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:33:47.810881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:33:47.810881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:33:47.810881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:33:47.810881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:33:47.810881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:33:47.810881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:33:47.810881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:33:47.810881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 20:33:47.810881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:33:47.813088 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 54/104] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:33:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:33:47.819500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d545ad8-7b0d-4b4a-8a6c-0b0c48cc9eeb None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:47.933590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d545ad8-7b0d-4b4a-8a6c-0b0c48cc9eeb None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:47.973030 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079e337-760c-451e-932a-2dcc026b6542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:47.974048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079e337-760c-451e-932a-2dcc026b6542 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:47.974500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079e337-760c-451e-932a-2dcc026b6542 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:47.974940 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079e337-760c-451e-932a-2dcc026b6542 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:47.975936 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079e337-760c-451e-932a-2dcc026b6542 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:47.976421 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079e337-760c-451e-932a-2dcc026b6542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:47.978021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079e337-760c-451e-932a-2dcc026b6542 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:47.988105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 51/105] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:33:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:47.995212 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd85e32-d294-4ff2-b6a1-9c13e2b4f5c3 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:48.128869 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd85e32-d294-4ff2-b6a1-9c13e2b4f5c3 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:48.160168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:48.167680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b053dd-4a63-42f5-9dc3-0ab6b771f679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:48.168843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b053dd-4a63-42f5-9dc3-0ab6b771f679 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:48.169281 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b053dd-4a63-42f5-9dc3-0ab6b771f679 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:48.169708 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b053dd-4a63-42f5-9dc3-0ab6b771f679 None admin] PATH_INFO: `/v3/users/05f408571928466da681732ae00a680c` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:48.186582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b053dd-4a63-42f5-9dc3-0ab6b771f679 None admin] RBAC: Authorizing `identity:get_user(user_id=05f408571928466da681732ae00a680c)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:48.188341 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b053dd-4a63-42f5-9dc3-0ab6b771f679 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:48.190803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 55/106] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:33:47 2022] GET /identity/v3/users/05f408571928466da681732ae00a680c => generated 289 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:48.200363 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079e337-760c-451e-932a-2dcc026b6542 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:48.203955 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:48.231878 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cb056-1973-4d7b-b1e1-8d429c7a4f4a None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:48.232385 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cb056-1973-4d7b-b1e1-8d429c7a4f4a None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:48.232826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cb056-1973-4d7b-b1e1-8d429c7a4f4a None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:48.234410 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 56/107] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:48.239540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfb8b6-02d1-4e07-b943-cce00676c234 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:48.240011 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfb8b6-02d1-4e07-b943-cce00676c234 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:48.240442 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfb8b6-02d1-4e07-b943-cce00676c234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:48.269837 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-27cfb8b6-02d1-4e07-b943-cce00676c234 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:48.274925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-27cfb8b6-02d1-4e07-b943-cce00676c234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:48.345546 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079e337-760c-451e-932a-2dcc026b6542 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:48.374980 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 57/108] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:48.377680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b38907-ab09-4c0e-adff-e83bcabb05cf None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:48.378123 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b38907-ab09-4c0e-adff-e83bcabb05cf None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:48.379022 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b38907-ab09-4c0e-adff-e83bcabb05cf None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:48.380861 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 58/109] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:48.387284 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d33958-e4fc-47b5-9d4c-f860fad3a815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:48.387284 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d33958-e4fc-47b5-9d4c-f860fad3a815 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:48.387284 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d33958-e4fc-47b5-9d4c-f860fad3a815 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:48.387284 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d33958-e4fc-47b5-9d4c-f860fad3a815 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:48.390366 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8a5ca-0a1c-4f3b-96c1-4d641765042e None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:48.390822 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8a5ca-0a1c-4f3b-96c1-4d641765042e None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:48.391284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8a5ca-0a1c-4f3b-96c1-4d641765042e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:48.426792 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-dec8a5ca-0a1c-4f3b-96c1-4d641765042e None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:48.428241 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-dec8a5ca-0a1c-4f3b-96c1-4d641765042e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:48.495196 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d33958-e4fc-47b5-9d4c-f860fad3a815 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:48.497105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d33958-e4fc-47b5-9d4c-f860fad3a815 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:48.513795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:48.577569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 59/110] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:48.578487 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8a5ca-0a1c-4f3b-96c1-4d641765042e None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:48.632346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:48.691279 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8a5ca-0a1c-4f3b-96c1-4d641765042e None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:48.692798 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 52/111] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:33:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:48.693656 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d33958-e4fc-47b5-9d4c-f860fad3a815 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:48.728352 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec9d53-f2a5-4fa2-8ca7-a3e7821ebbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:48.729170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec9d53-f2a5-4fa2-8ca7-a3e7821ebbf0 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:48.729463 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec9d53-f2a5-4fa2-8ca7-a3e7821ebbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:48.729746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec9d53-f2a5-4fa2-8ca7-a3e7821ebbf0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:48.741037 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec9d53-f2a5-4fa2-8ca7-a3e7821ebbf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:33:48.749155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-f5ec9d53-f2a5-4fa2-8ca7-a3e7821ebbf0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:33:48.749155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:33:48.749155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:33:48.749155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:33:48.749155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:33:48.749155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:33:48.749155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:33:48.749155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:33:48.749155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:33:48.749155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:33:48.749155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:33:48.749155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:33:48.749155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:33:48.749155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:33:48.749155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:33:48.749155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:33:48.750069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:33:48.750069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:33:48.750069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:33:48.750069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:33:48.750069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:33:48.750069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:33:48.750069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:33:48.750069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:33:48.750069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:33:48.750069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:33:48.750069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:33:48.750069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:33:48.750069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:33:48.750069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:33:48.750069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:33:48.750069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:33:48.751856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:33:48.751856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:33:48.751856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:33:48.751856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:33:48.751856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:33:48.751856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:33:48.751856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:33:48.751856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:33:48.751856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:33:48.751856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:33:48.751856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:33:48.751856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:33:48.751856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 60/112] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:33:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:33:48.751856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec9d53-f2a5-4fa2-8ca7-a3e7821ebbf0 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:48.842898 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d33958-e4fc-47b5-9d4c-f860fad3a815 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:48.845375 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:48.867934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec9d53-f2a5-4fa2-8ca7-a3e7821ebbf0 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:48.878592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:48.884562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539871e-749c-4f29-9676-9f998431d398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:48.887054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539871e-749c-4f29-9676-9f998431d398 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:48.888358 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539871e-749c-4f29-9676-9f998431d398 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:48.888617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539871e-749c-4f29-9676-9f998431d398 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:48.907018 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539871e-749c-4f29-9676-9f998431d398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:33:48.915608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-5539871e-749c-4f29-9676-9f998431d398 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:33:48.915608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:33:48.915608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:33:48.915608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:33:48.915608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:33:48.915608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:33:48.915608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:33:48.915608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:33:48.915608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:33:48.915608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:33:48.915608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:33:48.915608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:33:48.915608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:33:48.915608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:33:48.915608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:33:48.915608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:33:48.916500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:33:48.916500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:33:48.916500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:33:48.916500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:33:48.916500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:33:48.916500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:33:48.916500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:33:48.916500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:33:48.916500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:33:48.916500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:33:48.916500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:33:48.916500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:33:48.916500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:33:48.916500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:33:48.916500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:33:48.916500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:33:48.917253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:33:48.917253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:33:48.917253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:33:48.917253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:33:48.917253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:33:48.917253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:33:48.917253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:33:48.917253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:33:48.917253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:33:48.917253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:33:48.917253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:33:48.917253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:33:48.917253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 53/113] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:33:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:33:48.917916 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539871e-749c-4f29-9676-9f998431d398 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:48.920836 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86607ba-bd89-4a41-9483-5556a33d3d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:48.922170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86607ba-bd89-4a41-9483-5556a33d3d26 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:48.922657 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86607ba-bd89-4a41-9483-5556a33d3d26 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:48.923297 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86607ba-bd89-4a41-9483-5556a33d3d26 None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:48.924806 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86607ba-bd89-4a41-9483-5556a33d3d26 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf9c36dd93649fb92ed3e7f9f20258d)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:48.926533 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86607ba-bd89-4a41-9483-5556a33d3d26 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:48.928693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 61/114] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:33:48 2022] GET /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:48.930256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d8bf5-bf10-428d-b964-b2682926a6ef None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:48.930754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d8bf5-bf10-428d-b964-b2682926a6ef None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:48.931358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d8bf5-bf10-428d-b964-b2682926a6ef None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:48.932885 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 62/115] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:48.937621 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d8bf5-bf10-428d-b964-b2682926a6ef None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:49.023589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539871e-749c-4f29-9676-9f998431d398 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:49.055219 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d8bf5-bf10-428d-b964-b2682926a6ef None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:49.059956 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66609d65-0fec-4d12-b279-d3cb915aec8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:49.060643 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66609d65-0fec-4d12-b279-d3cb915aec8f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:49.060935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66609d65-0fec-4d12-b279-d3cb915aec8f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:49.061217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66609d65-0fec-4d12-b279-d3cb915aec8f None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:49.061979 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66609d65-0fec-4d12-b279-d3cb915aec8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:49.062291 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66609d65-0fec-4d12-b279-d3cb915aec8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:49.063851 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66609d65-0fec-4d12-b279-d3cb915aec8f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:49.072973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 54/116] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:33:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:49.073881 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66609d65-0fec-4d12-b279-d3cb915aec8f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:49.096768 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd9482-3097-4a98-84cf-7c1c203e17a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:49.097900 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd9482-3097-4a98-84cf-7c1c203e17a3 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:49.098397 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd9482-3097-4a98-84cf-7c1c203e17a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:49.098891 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd9482-3097-4a98-84cf-7c1c203e17a3 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:49.100069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd9482-3097-4a98-84cf-7c1c203e17a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:49.100530 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:49.101114 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd9482-3097-4a98-84cf-7c1c203e17a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:49.104472 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd9482-3097-4a98-84cf-7c1c203e17a3 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:49.118149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 63/117] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:33:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:49.120994 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f53b1-5b9d-40a7-b647-69744aabfec3 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:49.121517 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f53b1-5b9d-40a7-b647-69744aabfec3 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:49.122058 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f53b1-5b9d-40a7-b647-69744aabfec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:49.141591 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-844f53b1-5b9d-40a7-b647-69744aabfec3 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:49.144263 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-844f53b1-5b9d-40a7-b647-69744aabfec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:49.178785 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:49.181597 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66609d65-0fec-4d12-b279-d3cb915aec8f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:49.215928 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c055c-75bb-4107-a8e9-ee4287a3cc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:49.216578 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c055c-75bb-4107-a8e9-ee4287a3cc66 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:49.216854 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c055c-75bb-4107-a8e9-ee4287a3cc66 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:49.217133 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c055c-75bb-4107-a8e9-ee4287a3cc66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:49.217959 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c055c-75bb-4107-a8e9-ee4287a3cc66 None admin] RBAC: Adding query filter params (role.id=61e37a77948648d989c2ba2222b6fe6f, scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d, user.id=05f408571928466da681732ae00a680c) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:49.218272 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c055c-75bb-4107-a8e9-ee4287a3cc66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:49.219736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c055c-75bb-4107-a8e9-ee4287a3cc66 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:49.227631 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 64/118] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:49.227631 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f53b1-5b9d-40a7-b647-69744aabfec3 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:49.235673 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 55/119] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:33:49 2022] GET /identity/v3/role_assignments?user.id=05f408571928466da681732ae00a680c&scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d&role.id=61e37a77948648d989c2ba2222b6fe6f => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:49.235673 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c055c-75bb-4107-a8e9-ee4287a3cc66 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:49.352122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:49.362176 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f53b1-5b9d-40a7-b647-69744aabfec3 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:49.368895 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c055c-75bb-4107-a8e9-ee4287a3cc66 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:49.404633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41ca88-7ebd-4d1a-a47e-f2761576f9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:49.406866 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41ca88-7ebd-4d1a-a47e-f2761576f9dc None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:49.407254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41ca88-7ebd-4d1a-a47e-f2761576f9dc None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:49.408177 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41ca88-7ebd-4d1a-a47e-f2761576f9dc None admin] PATH_INFO: `/v3/users/70a97f9c967d4ba3819e7f4712b48b9e` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:49.409349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b9b59-2fb7-44f9-8c15-a6205e94e3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:49.409671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41ca88-7ebd-4d1a-a47e-f2761576f9dc None admin] RBAC: Authorizing `identity:get_user(user_id=70a97f9c967d4ba3819e7f4712b48b9e)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:49.410560 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b9b59-2fb7-44f9-8c15-a6205e94e3a0 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:49.411001 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b9b59-2fb7-44f9-8c15-a6205e94e3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:49.411459 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41ca88-7ebd-4d1a-a47e-f2761576f9dc None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:49.411581 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b9b59-2fb7-44f9-8c15-a6205e94e3a0 None admin] PATH_INFO: `/v3/users/474d7a7ff49c4da4ad22b9479082adda` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:49.413157 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b9b59-2fb7-44f9-8c15-a6205e94e3a0 None admin] RBAC: Authorizing `identity:get_user(user_id=474d7a7ff49c4da4ad22b9479082adda)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:49.413422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 65/120] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:33:49 2022] GET /identity/v3/users/70a97f9c967d4ba3819e7f4712b48b9e => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:49.414890 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278459ea-66d4-4e98-9e1b-b1e3e00a1556 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:49.415226 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b9b59-2fb7-44f9-8c15-a6205e94e3a0 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:49.415367 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278459ea-66d4-4e98-9e1b-b1e3e00a1556 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:49.415735 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278459ea-66d4-4e98-9e1b-b1e3e00a1556 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:49.417275 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 66/121] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:49.418051 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278459ea-66d4-4e98-9e1b-b1e3e00a1556 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:49.418401 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 56/122] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:33:49 2022] GET /identity/v3/users/474d7a7ff49c4da4ad22b9479082adda => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:49.419641 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b9b59-2fb7-44f9-8c15-a6205e94e3a0 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:49.466080 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:49.535794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b9b59-2fb7-44f9-8c15-a6205e94e3a0 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:49.542832 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278459ea-66d4-4e98-9e1b-b1e3e00a1556 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:49.572150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ce16d-3f79-432c-9cc4-035aa170698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:49.573271 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ce16d-3f79-432c-9cc4-035aa170698e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:49.573693 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ce16d-3f79-432c-9cc4-035aa170698e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:49.574277 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ce16d-3f79-432c-9cc4-035aa170698e None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:49.575649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ce16d-3f79-432c-9cc4-035aa170698e None admin] RBAC: Authorizing `identity:get_project(project_id=8bf9c36dd93649fb92ed3e7f9f20258d)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:49.577223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ce16d-3f79-432c-9cc4-035aa170698e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:49.579928 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 57/123] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:33:49 2022] GET /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:49.581217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826fd5e-1988-4527-944c-d4fdebf712e1 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:49.581717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826fd5e-1988-4527-944c-d4fdebf712e1 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:49.582153 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826fd5e-1988-4527-944c-d4fdebf712e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:49.585852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab22809-da4c-4c5f-b314-03cf94aeea10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:49.586782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab22809-da4c-4c5f-b314-03cf94aeea10 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:49.587076 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab22809-da4c-4c5f-b314-03cf94aeea10 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:49.587386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab22809-da4c-4c5f-b314-03cf94aeea10 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:49.600113 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab22809-da4c-4c5f-b314-03cf94aeea10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:33:49.601401 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-0826fd5e-1988-4527-944c-d4fdebf712e1 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:49.602794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-0826fd5e-1988-4527-944c-d4fdebf712e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:49.609099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-7ab22809-da4c-4c5f-b314-03cf94aeea10 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:33:49.609099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:33:49.609099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:33:49.609099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:33:49.609099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:33:49.609099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:33:49.609099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:33:49.609099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:33:49.609099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:33:49.609099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:33:49.609099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:33:49.609099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:33:49.609099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:33:49.609099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:33:49.609099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:33:49.609099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:33:49.610161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:33:49.610161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:33:49.610161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:33:49.610161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:33:49.610161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:33:49.610161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:33:49.610161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:33:49.610161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:33:49.610161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:33:49.610161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:33:49.610161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:33:49.610161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:33:49.610161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:33:49.610161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:33:49.610161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:33:49.610161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:33:49.611130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:33:49.611130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:33:49.611130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:33:49.611130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:33:49.611130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:33:49.611130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:33:49.611130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:33:49.611130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:33:49.611130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:33:49.611130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:33:49.611130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:33:49.611130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:33:49.611130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 67/124] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jul 19 20:33:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:33:49.611856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab22809-da4c-4c5f-b314-03cf94aeea10 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:49.631019 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:49.688183 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 58/125] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:49.689925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826fd5e-1988-4527-944c-d4fdebf712e1 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:49.739252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:49.745978 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab22809-da4c-4c5f-b314-03cf94aeea10 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:49.781671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70910d2-b8a7-43c5-9cc5-3d60675b7902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:49.782611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70910d2-b8a7-43c5-9cc5-3d60675b7902 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:49.782903 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70910d2-b8a7-43c5-9cc5-3d60675b7902 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:49.783191 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70910d2-b8a7-43c5-9cc5-3d60675b7902 None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:49.784471 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70910d2-b8a7-43c5-9cc5-3d60675b7902 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf9c36dd93649fb92ed3e7f9f20258d)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:49.785936 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70910d2-b8a7-43c5-9cc5-3d60675b7902 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:49.787868 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 68/126] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:33:49 2022] GET /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:49.788478 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70910d2-b8a7-43c5-9cc5-3d60675b7902 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:49.813516 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826fd5e-1988-4527-944c-d4fdebf712e1 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:49.859472 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf959c-8966-445b-916f-ecb749a6c463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:49.861956 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf959c-8966-445b-916f-ecb749a6c463 None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:49.862425 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf959c-8966-445b-916f-ecb749a6c463 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:49.862847 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf959c-8966-445b-916f-ecb749a6c463 None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d/users/70a97f9c967d4ba3819e7f4712b48b9e/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:49.866207 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf959c-8966-445b-916f-ecb749a6c463 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bf9c36dd93649fb92ed3e7f9f20258d, user_id=70a97f9c967d4ba3819e7f4712b48b9e, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:49.869024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf959c-8966-445b-916f-ecb749a6c463 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:49.900036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 59/127] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:33:49 2022] PUT /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d/users/70a97f9c967d4ba3819e7f4712b48b9e/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:33:49.900036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf959c-8966-445b-916f-ecb749a6c463 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:49.925344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70910d2-b8a7-43c5-9cc5-3d60675b7902 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:49.948906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:49.978386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9a00a-10d1-4ab5-a430-403f515a8bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:49.979426 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9a00a-10d1-4ab5-a430-403f515a8bcc None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:49.980076 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9a00a-10d1-4ab5-a430-403f515a8bcc None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:49.980717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9a00a-10d1-4ab5-a430-403f515a8bcc None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:49.981701 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9a00a-10d1-4ab5-a430-403f515a8bcc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:49.982211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9a00a-10d1-4ab5-a430-403f515a8bcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:49.983869 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9a00a-10d1-4ab5-a430-403f515a8bcc None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:49.996221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 69/128] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:33:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:49.997343 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9a00a-10d1-4ab5-a430-403f515a8bcc None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:50.037812 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:50.132825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9a00a-10d1-4ab5-a430-403f515a8bcc None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:50.174317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf959c-8966-445b-916f-ecb749a6c463 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:50.174735 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61b379-7ddd-462e-8df8-aeab29df3b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:50.175684 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61b379-7ddd-462e-8df8-aeab29df3b04 None admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:50.175975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61b379-7ddd-462e-8df8-aeab29df3b04 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:50.176257 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61b379-7ddd-462e-8df8-aeab29df3b04 None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d/users/474d7a7ff49c4da4ad22b9479082adda/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:50.178562 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61b379-7ddd-462e-8df8-aeab29df3b04 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bf9c36dd93649fb92ed3e7f9f20258d, user_id=474d7a7ff49c4da4ad22b9479082adda, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:50.179853 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61b379-7ddd-462e-8df8-aeab29df3b04 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:50.197818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 70/129] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:33:49 2022] PUT /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d/users/474d7a7ff49c4da4ad22b9479082adda/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:33:50.198713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61b379-7ddd-462e-8df8-aeab29df3b04 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:50.219409 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cce4c4-9a3a-4ce0-bde1-6e9ace3527c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:50.221355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cce4c4-9a3a-4ce0-bde1-6e9ace3527c8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:50.221783 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cce4c4-9a3a-4ce0-bde1-6e9ace3527c8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:50.222380 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cce4c4-9a3a-4ce0-bde1-6e9ace3527c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:50.245490 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cce4c4-9a3a-4ce0-bde1-6e9ace3527c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:33:50.259773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-88cce4c4-9a3a-4ce0-bde1-6e9ace3527c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:33:50.259773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:33:50.259773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:33:50.259773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:33:50.259773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:33:50.259773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:33:50.259773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:33:50.259773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:33:50.259773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:33:50.259773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:33:50.259773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:33:50.259773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:33:50.259773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:33:50.259773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:33:50.259773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:33:50.259773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:33:50.260843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:33:50.260843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:33:50.260843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:33:50.260843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:33:50.260843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:33:50.260843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:33:50.260843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:33:50.260843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:33:50.260843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:33:50.260843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:33:50.260843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:33:50.260843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:33:50.260843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:33:50.260843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:33:50.260843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:33:50.260843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:33:50.261815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:33:50.261815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:33:50.261815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:33:50.261815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:33:50.261815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:33:50.261815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:33:50.261815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:33:50.261815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:33:50.261815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:33:50.261815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:33:50.261815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:33:50.261815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:33:50.268193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 60/130] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:33:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:33:50.274485 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cce4c4-9a3a-4ce0-bde1-6e9ace3527c8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:50.300948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:50.323620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61b379-7ddd-462e-8df8-aeab29df3b04 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:50.396471 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88616f40-404a-4956-be94-302a20ec474e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:50.397303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88616f40-404a-4956-be94-302a20ec474e None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:50.397579 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88616f40-404a-4956-be94-302a20ec474e None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:50.397864 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88616f40-404a-4956-be94-302a20ec474e None admin] PATH_INFO: `/v3/users/474d7a7ff49c4da4ad22b9479082adda` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:50.399788 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88616f40-404a-4956-be94-302a20ec474e None admin] RBAC: Authorizing `identity:get_user(user_id=474d7a7ff49c4da4ad22b9479082adda)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:50.401257 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88616f40-404a-4956-be94-302a20ec474e None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:50.403041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 71/131] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:33:50 2022] GET /identity/v3/users/474d7a7ff49c4da4ad22b9479082adda => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:50.404127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdeb74-d41f-4d6a-8721-9c3fead93241 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:50.404422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdeb74-d41f-4d6a-8721-9c3fead93241 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:50.404707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdeb74-d41f-4d6a-8721-9c3fead93241 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:50.405984 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 72/132] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:50.410301 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdeb74-d41f-4d6a-8721-9c3fead93241 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:50.424632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:50.461732 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cce4c4-9a3a-4ce0-bde1-6e9ace3527c8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:50.508691 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd76a87-79b1-4080-94f1-523fa8819eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:50.509381 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd76a87-79b1-4080-94f1-523fa8819eec None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:50.509676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd76a87-79b1-4080-94f1-523fa8819eec None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:50.509959 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd76a87-79b1-4080-94f1-523fa8819eec None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:50.510721 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd76a87-79b1-4080-94f1-523fa8819eec None admin] RBAC: Adding query filter params (name=member) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:50.511034 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd76a87-79b1-4080-94f1-523fa8819eec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:50.513308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd76a87-79b1-4080-94f1-523fa8819eec None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:50.523326 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 61/133] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:33:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:33:50.524643 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0350768-5f29-45f2-aee7-68d1965dfad9 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:50.524841 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0350768-5f29-45f2-aee7-68d1965dfad9 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:50.525116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0350768-5f29-45f2-aee7-68d1965dfad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:50.542389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-e0350768-5f29-45f2-aee7-68d1965dfad9 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:50.543636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e0350768-5f29-45f2-aee7-68d1965dfad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:50.574024 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdeb74-d41f-4d6a-8721-9c3fead93241 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:50.627086 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 62/134] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:50.627751 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0350768-5f29-45f2-aee7-68d1965dfad9 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:50.635528 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126813e-dc8d-4494-bdfc-6acdb21c9ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:50.636513 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126813e-dc8d-4494-bdfc-6acdb21c9ad6 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:50.636800 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126813e-dc8d-4494-bdfc-6acdb21c9ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:50.637078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126813e-dc8d-4494-bdfc-6acdb21c9ad6 None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:50.639747 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126813e-dc8d-4494-bdfc-6acdb21c9ad6 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf9c36dd93649fb92ed3e7f9f20258d)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:50.641199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126813e-dc8d-4494-bdfc-6acdb21c9ad6 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:50.646442 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 73/135] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:33:50 2022] GET /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:50.651819 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126813e-dc8d-4494-bdfc-6acdb21c9ad6 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:50.696971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:50.763290 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:50.805734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126813e-dc8d-4494-bdfc-6acdb21c9ad6 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:50.841304 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0350768-5f29-45f2-aee7-68d1965dfad9 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:50.861823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678d836-41df-49f7-8fcf-fe7340278693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:50.862848 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678d836-41df-49f7-8fcf-fe7340278693 None admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:50.863199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678d836-41df-49f7-8fcf-fe7340278693 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:50.863533 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678d836-41df-49f7-8fcf-fe7340278693 None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d/users/474d7a7ff49c4da4ad22b9479082adda/roles/92567de587bf40dab488cc1eb666b221` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:50.866105 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678d836-41df-49f7-8fcf-fe7340278693 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bf9c36dd93649fb92ed3e7f9f20258d, user_id=474d7a7ff49c4da4ad22b9479082adda, role_id=92567de587bf40dab488cc1eb666b221)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:50.875635 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678d836-41df-49f7-8fcf-fe7340278693 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:50.887099 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61661016-5dc4-4dac-9b5b-3aff3c93d0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:50.888242 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61661016-5dc4-4dac-9b5b-3aff3c93d0f5 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:50.888672 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61661016-5dc4-4dac-9b5b-3aff3c93d0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:50.889091 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61661016-5dc4-4dac-9b5b-3aff3c93d0f5 None admin] PATH_INFO: `/v3/users/474d7a7ff49c4da4ad22b9479082adda` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:50.890481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61661016-5dc4-4dac-9b5b-3aff3c93d0f5 None admin] RBAC: Authorizing `identity:get_user(user_id=474d7a7ff49c4da4ad22b9479082adda)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:50.892741 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61661016-5dc4-4dac-9b5b-3aff3c93d0f5 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:50.894682 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 63/136] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:33:50 2022] GET /identity/v3/users/474d7a7ff49c4da4ad22b9479082adda => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:50.895647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61661016-5dc4-4dac-9b5b-3aff3c93d0f5 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:50.898984 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 74/137] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:33:50 2022] PUT /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d/users/474d7a7ff49c4da4ad22b9479082adda/roles/92567de587bf40dab488cc1eb666b221 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:33:50.912184 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678d836-41df-49f7-8fcf-fe7340278693 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:51.010381 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61661016-5dc4-4dac-9b5b-3aff3c93d0f5 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:51.049795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7b120-2e7a-4315-b769-0ec50253f2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:51.050970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7b120-2e7a-4315-b769-0ec50253f2eb None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:51.051495 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7b120-2e7a-4315-b769-0ec50253f2eb None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:51.051932 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7b120-2e7a-4315-b769-0ec50253f2eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:51.057453 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7b120-2e7a-4315-b769-0ec50253f2eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:51.059276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7b120-2e7a-4315-b769-0ec50253f2eb None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:51.061384 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 64/138] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:33:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:51.070793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7b120-2e7a-4315-b769-0ec50253f2eb None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:51.079864 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:51.083616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:51.105100 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678d836-41df-49f7-8fcf-fe7340278693 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:51.143514 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfcd0f-0c5a-4d85-9cf2-98f5af6c92ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:51.144389 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfcd0f-0c5a-4d85-9cf2-98f5af6c92ff None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:51.144682 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfcd0f-0c5a-4d85-9cf2-98f5af6c92ff None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:51.144962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfcd0f-0c5a-4d85-9cf2-98f5af6c92ff None admin] PATH_INFO: `/v3/projects/cc13fa98a78e4965afbd5771a048b274` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:51.146237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acfcd0f-0c5a-4d85-9cf2-98f5af6c92ff None admin] RBAC: Authorizing `identity:get_project(project_id=cc13fa98a78e4965afbd5771a048b274)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:51.147762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acfcd0f-0c5a-4d85-9cf2-98f5af6c92ff None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:51.150397 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 75/139] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:33:50 2022] GET /identity/v3/projects/cc13fa98a78e4965afbd5771a048b274 => generated 312 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:33:51.155958 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfcd0f-0c5a-4d85-9cf2-98f5af6c92ff None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:51.264149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7b120-2e7a-4315-b769-0ec50253f2eb None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:51.331550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a141dd-f5f2-4bd8-ac01-88855cd6ac6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:51.332239 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a141dd-f5f2-4bd8-ac01-88855cd6ac6f None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:51.332524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a141dd-f5f2-4bd8-ac01-88855cd6ac6f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:51.332800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a141dd-f5f2-4bd8-ac01-88855cd6ac6f None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:51.333538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a141dd-f5f2-4bd8-ac01-88855cd6ac6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:51.334969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a141dd-f5f2-4bd8-ac01-88855cd6ac6f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:51.372264 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfcd0f-0c5a-4d85-9cf2-98f5af6c92ff None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:51.393199 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 65/140] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jul 19 20:33:51 2022] POST /identity/v3/users => generated 283 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:33:51.443104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b186862-6ec2-417c-8fba-78a0f22a8c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:51.444149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b186862-6ec2-417c-8fba-78a0f22a8c5d None admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:51.444464 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b186862-6ec2-417c-8fba-78a0f22a8c5d None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:51.444781 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b186862-6ec2-417c-8fba-78a0f22a8c5d None admin] PATH_INFO: `/v3/projects/cc13fa98a78e4965afbd5771a048b274/users/474d7a7ff49c4da4ad22b9479082adda/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:51.453237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b186862-6ec2-417c-8fba-78a0f22a8c5d None admin] RBAC: Authorizing `identity:create_grant(project_id=cc13fa98a78e4965afbd5771a048b274, user_id=474d7a7ff49c4da4ad22b9479082adda, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:51.455321 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b186862-6ec2-417c-8fba-78a0f22a8c5d None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:51.482127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 76/141] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:33:51 2022] PUT /identity/v3/projects/cc13fa98a78e4965afbd5771a048b274/users/474d7a7ff49c4da4ad22b9479082adda/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:33:52.014812 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06e54e-1bb1-48d7-8cb6-51b125c61e5a None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:52.015532 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06e54e-1bb1-48d7-8cb6-51b125c61e5a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:52.016019 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06e54e-1bb1-48d7-8cb6-51b125c61e5a None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:52.018421 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 66/142] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:52.023773 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66992dec-38a2-4480-8d01-71d8bbad900a None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:52.024109 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66992dec-38a2-4480-8d01-71d8bbad900a None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:52.024433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66992dec-38a2-4480-8d01-71d8bbad900a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:52.048968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-66992dec-38a2-4480-8d01-71d8bbad900a None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:52.050315 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-66992dec-38a2-4480-8d01-71d8bbad900a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:52.053686 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:52.132961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 77/143] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:52.156082 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06e54e-1bb1-48d7-8cb6-51b125c61e5a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:52.223716 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:52.275317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06e54e-1bb1-48d7-8cb6-51b125c61e5a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:52.313699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e32fc7-da9e-44a1-9bd9-482d5074ede1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:52.314538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e32fc7-da9e-44a1-9bd9-482d5074ede1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:52.314828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e32fc7-da9e-44a1-9bd9-482d5074ede1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:52.315110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e32fc7-da9e-44a1-9bd9-482d5074ede1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:52.328295 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e32fc7-da9e-44a1-9bd9-482d5074ede1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:33:52.337027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-21e32fc7-da9e-44a1-9bd9-482d5074ede1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 20:33:52.337027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:33:52.337027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:33:52.337027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:33:52.337027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:33:52.337027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:33:52.337027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:33:52.337027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:33:52.337027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:33:52.337027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:33:52.337027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:33:52.337027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:33:52.337027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:33:52.337027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:33:52.337027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:33:52.337027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:33:52.337931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:33:52.337931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:33:52.337931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:33:52.337931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:33:52.337931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:33:52.337931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:33:52.337931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:33:52.337931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:33:52.337931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:33:52.337931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:33:52.337931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:33:52.337931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:33:52.337931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:33:52.337931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:33:52.337931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:33:52.337931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:33:52.339143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:33:52.339143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:33:52.339143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:33:52.339143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:33:52.339143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:33:52.339143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:33:52.339143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:33:52.339143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:33:52.339143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:33:52.339143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:33:52.339143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 20:33:52.339143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:33:52.339143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 67/144] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:33:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:33:52.344492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66992dec-38a2-4480-8d01-71d8bbad900a None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:52.458420 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66992dec-38a2-4480-8d01-71d8bbad900a None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:52.494620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e59f6-9277-42ed-80d3-a1f8ec565568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:52.495336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e59f6-9277-42ed-80d3-a1f8ec565568 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:52.495761 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e59f6-9277-42ed-80d3-a1f8ec565568 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:52.496039 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e59f6-9277-42ed-80d3-a1f8ec565568 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:52.496805 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e59f6-9277-42ed-80d3-a1f8ec565568 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:52.497116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e59f6-9277-42ed-80d3-a1f8ec565568 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:52.498503 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e59f6-9277-42ed-80d3-a1f8ec565568 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:52.508063 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 78/145] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:33:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:52.513912 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e32fc7-da9e-44a1-9bd9-482d5074ede1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:52.639116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e32fc7-da9e-44a1-9bd9-482d5074ede1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:52.663684 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:52.681742 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558df93-6f6d-404f-a881-a0085e1207c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:52.682695 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558df93-6f6d-404f-a881-a0085e1207c9 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:52.682990 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558df93-6f6d-404f-a881-a0085e1207c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:52.683286 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558df93-6f6d-404f-a881-a0085e1207c9 None admin] PATH_INFO: `/v3/users/05f408571928466da681732ae00a680c` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:52.684543 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558df93-6f6d-404f-a881-a0085e1207c9 None admin] RBAC: Authorizing `identity:get_user(user_id=05f408571928466da681732ae00a680c)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:52.686004 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558df93-6f6d-404f-a881-a0085e1207c9 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:52.687719 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 68/146] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:33:52 2022] GET /identity/v3/users/05f408571928466da681732ae00a680c => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:52.693896 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e59f6-9277-42ed-80d3-a1f8ec565568 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:52.696849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:52.808006 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e59f6-9277-42ed-80d3-a1f8ec565568 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:52.848558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ab1ba-2d0d-4696-ae84-eeb7d7101304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:52.849523 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ab1ba-2d0d-4696-ae84-eeb7d7101304 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:52.849860 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ab1ba-2d0d-4696-ae84-eeb7d7101304 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:52.850181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ab1ba-2d0d-4696-ae84-eeb7d7101304 None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:52.852300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ab1ba-2d0d-4696-ae84-eeb7d7101304 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf9c36dd93649fb92ed3e7f9f20258d)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:52.853784 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ab1ba-2d0d-4696-ae84-eeb7d7101304 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:52.855831 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 79/147] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:33:52 2022] GET /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:52.862230 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558df93-6f6d-404f-a881-a0085e1207c9 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:52.991569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558df93-6f6d-404f-a881-a0085e1207c9 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:53.034151 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa2fc3-a521-4ee5-b462-62c8a5d5b216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:53.035182 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa2fc3-a521-4ee5-b462-62c8a5d5b216 None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:53.035519 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa2fc3-a521-4ee5-b462-62c8a5d5b216 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:53.035804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa2fc3-a521-4ee5-b462-62c8a5d5b216 None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d/users/05f408571928466da681732ae00a680c/roles/61e37a77948648d989c2ba2222b6fe6f` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:53.037879 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa2fc3-a521-4ee5-b462-62c8a5d5b216 None admin] RBAC: Authorizing `identity:create_grant(project_id=8bf9c36dd93649fb92ed3e7f9f20258d, user_id=05f408571928466da681732ae00a680c, role_id=61e37a77948648d989c2ba2222b6fe6f)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:53.039476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa2fc3-a521-4ee5-b462-62c8a5d5b216 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:53.056311 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 69/148] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:33:52 2022] PUT /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d/users/05f408571928466da681732ae00a680c/roles/61e37a77948648d989c2ba2222b6fe6f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:33:53.126777 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c7e23-e749-417c-8a0c-b125106c255f None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:53.127073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c7e23-e749-417c-8a0c-b125106c255f None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:53.127286 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c7e23-e749-417c-8a0c-b125106c255f None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:53.128827 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 80/149] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:53.134227 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd70193-4408-4fed-9ce4-c0aeb8df5b9b None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:53.134580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd70193-4408-4fed-9ce4-c0aeb8df5b9b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:53.134825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd70193-4408-4fed-9ce4-c0aeb8df5b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:53.160340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-ddd70193-4408-4fed-9ce4-c0aeb8df5b9b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:53.161640 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ddd70193-4408-4fed-9ce4-c0aeb8df5b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:53.222733 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:53.255079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 70/150] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:53.293638 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c7e23-e749-417c-8a0c-b125106c255f None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:53.388565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:53.435181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c7e23-e749-417c-8a0c-b125106c255f None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:53.485782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97b642b-2c02-4da1-b08e-c6a4689c9c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:53.486652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b642b-2c02-4da1-b08e-c6a4689c9c65 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:53.486997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b642b-2c02-4da1-b08e-c6a4689c9c65 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:53.487311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97b642b-2c02-4da1-b08e-c6a4689c9c65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:53.499787 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97b642b-2c02-4da1-b08e-c6a4689c9c65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:33:53.509700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-a97b642b-2c02-4da1-b08e-c6a4689c9c65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:33:53.509700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:33:53.509700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:33:53.509700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:33:53.509700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:33:53.509700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:33:53.509700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:33:53.509700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:33:53.509700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:33:53.509700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:33:53.509700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:33:53.509700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:33:53.509700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:33:53.509700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:33:53.509700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:33:53.509700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:33:53.510567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:33:53.510567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:33:53.510567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:33:53.510567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:33:53.510567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:33:53.510567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:33:53.510567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:33:53.510567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:33:53.510567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:33:53.510567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:33:53.510567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:33:53.510567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:33:53.510567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:33:53.510567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:33:53.510567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:33:53.510567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:33:53.511375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:33:53.511375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:33:53.511375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:33:53.511375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:33:53.511375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:33:53.511375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:33:53.511375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:33:53.511375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:33:53.511375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:33:53.511375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:33:53.511375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:33:53.511375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:33:53.511375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 81/151] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:33:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:33:53.516935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd70193-4408-4fed-9ce4-c0aeb8df5b9b None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:53.606904 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7cb2d-1e55-4783-89d6-fc183b08c134 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:53.607228 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7cb2d-1e55-4783-89d6-fc183b08c134 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:53.607501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7cb2d-1e55-4783-89d6-fc183b08c134 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:53.609367 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 82/152] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:53.637256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5de9f-8deb-4674-b301-9f8cb055289a None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:53.637597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5de9f-8deb-4674-b301-9f8cb055289a None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:53.637810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5de9f-8deb-4674-b301-9f8cb055289a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:53.663321 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-95c5de9f-8deb-4674-b301-9f8cb055289a None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:53.664625 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-95c5de9f-8deb-4674-b301-9f8cb055289a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:53.672356 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd70193-4408-4fed-9ce4-c0aeb8df5b9b None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:53.774479 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99e227-d035-4ba4-8349-2352c099adb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:53.775168 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99e227-d035-4ba4-8349-2352c099adb8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:53.779535 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99e227-d035-4ba4-8349-2352c099adb8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:53.779839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99e227-d035-4ba4-8349-2352c099adb8 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:53.780636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99e227-d035-4ba4-8349-2352c099adb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:53.780950 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99e227-d035-4ba4-8349-2352c099adb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:53.783709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99e227-d035-4ba4-8349-2352c099adb8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:53.799080 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 71/153] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:33:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:53.806489 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99e227-d035-4ba4-8349-2352c099adb8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:53.817884 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 83/154] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:33:53.850123 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5de9f-8deb-4674-b301-9f8cb055289a None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:53.869106 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:53.942902 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:53.951686 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99e227-d035-4ba4-8349-2352c099adb8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:54.017827 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5de9f-8deb-4674-b301-9f8cb055289a None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:54.021732 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2ef4d-b602-4dd4-8e7c-7c9476338fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:54.022719 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2ef4d-b602-4dd4-8e7c-7c9476338fdd None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:54.023051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2ef4d-b602-4dd4-8e7c-7c9476338fdd None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:54.023395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2ef4d-b602-4dd4-8e7c-7c9476338fdd None admin] PATH_INFO: `/v3/users/70a97f9c967d4ba3819e7f4712b48b9e` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:54.026440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2ef4d-b602-4dd4-8e7c-7c9476338fdd None admin] RBAC: Authorizing `identity:get_user(user_id=70a97f9c967d4ba3819e7f4712b48b9e)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:54.027988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2ef4d-b602-4dd4-8e7c-7c9476338fdd None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:54.036411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 72/155] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:33:53 2022] GET /identity/v3/users/70a97f9c967d4ba3819e7f4712b48b9e => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:33:54.060771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2ef4d-b602-4dd4-8e7c-7c9476338fdd None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:54.105640 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58c92f-d4f5-4b6b-ac6e-63d40a143f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:54.106451 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58c92f-d4f5-4b6b-ac6e-63d40a143f50 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:54.106738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58c92f-d4f5-4b6b-ac6e-63d40a143f50 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:54.107245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58c92f-d4f5-4b6b-ac6e-63d40a143f50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:54.136337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58c92f-d4f5-4b6b-ac6e-63d40a143f50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:33:54.150612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-6b58c92f-d4f5-4b6b-ac6e-63d40a143f50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:33:54.150612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:33:54.150612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:33:54.150612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:33:54.150612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:33:54.150612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:33:54.150612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:33:54.150612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:33:54.150612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:33:54.150612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:33:54.150612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:33:54.150612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:33:54.150612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:33:54.150612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:33:54.150612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:33:54.150612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:33:54.151660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:33:54.151660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:33:54.151660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:33:54.151660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:33:54.151660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:33:54.151660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:33:54.151660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:33:54.151660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:33:54.151660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:33:54.151660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:33:54.151660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:33:54.151660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:33:54.151660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:33:54.151660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:33:54.151660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:33:54.151660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:33:54.152754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:33:54.152754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:33:54.152754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:33:54.152754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:33:54.152754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:33:54.152754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:33:54.152754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:33:54.152754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:33:54.152754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:33:54.152754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:33:54.152754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:33:54.152754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:33:54.152754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 84/156] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:33:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:33:54.165598 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58c92f-d4f5-4b6b-ac6e-63d40a143f50 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:54.279404 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2ef4d-b602-4dd4-8e7c-7c9476338fdd None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:54.298919 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:54.336635 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64477ffa-7539-4107-9265-9bdb9155ecf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:54.337308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64477ffa-7539-4107-9265-9bdb9155ecf4 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:54.337595 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64477ffa-7539-4107-9265-9bdb9155ecf4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:54.337875 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64477ffa-7539-4107-9265-9bdb9155ecf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:54.389876 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58c92f-d4f5-4b6b-ac6e-63d40a143f50 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:54.424888 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:54.452623 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655af2d1-52f3-40d5-b005-18512e2f39c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:54.453309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655af2d1-52f3-40d5-b005-18512e2f39c9 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:54.453596 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655af2d1-52f3-40d5-b005-18512e2f39c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:54.453873 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655af2d1-52f3-40d5-b005-18512e2f39c9 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:54.455168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655af2d1-52f3-40d5-b005-18512e2f39c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:54.455498 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655af2d1-52f3-40d5-b005-18512e2f39c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:54.456895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655af2d1-52f3-40d5-b005-18512e2f39c9 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:54.466227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 85/157] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:33:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:54.467253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64477ffa-7539-4107-9265-9bdb9155ecf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:54.471289 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64477ffa-7539-4107-9265-9bdb9155ecf4 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:54.486676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655af2d1-52f3-40d5-b005-18512e2f39c9 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:54.639133 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 73/158] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:33:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:54.640532 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af0858-ab6e-463c-9a99-1ec17124b977 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:54.640822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af0858-ab6e-463c-9a99-1ec17124b977 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:54.641095 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af0858-ab6e-463c-9a99-1ec17124b977 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:54.642422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 74/159] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:54.647213 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af0858-ab6e-463c-9a99-1ec17124b977 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:54.666730 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:54.696722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655af2d1-52f3-40d5-b005-18512e2f39c9 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:54.734723 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39508b99-6860-4e54-8b9d-0c4cf0ff9c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:54.735777 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39508b99-6860-4e54-8b9d-0c4cf0ff9c81 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:54.736337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39508b99-6860-4e54-8b9d-0c4cf0ff9c81 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:54.736618 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39508b99-6860-4e54-8b9d-0c4cf0ff9c81 None admin] PATH_INFO: `/v3/users/474d7a7ff49c4da4ad22b9479082adda` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:54.737951 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39508b99-6860-4e54-8b9d-0c4cf0ff9c81 None admin] RBAC: Authorizing `identity:get_user(user_id=474d7a7ff49c4da4ad22b9479082adda)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:54.739439 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39508b99-6860-4e54-8b9d-0c4cf0ff9c81 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:54.741365 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 86/160] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:33:54 2022] GET /identity/v3/users/474d7a7ff49c4da4ad22b9479082adda => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:54.742505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1308ca-abe4-4f69-9a84-4dc8a85e4d83 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:54.742792 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1308ca-abe4-4f69-9a84-4dc8a85e4d83 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:54.743101 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1308ca-abe4-4f69-9a84-4dc8a85e4d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:54.765249 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-0e1308ca-abe4-4f69-9a84-4dc8a85e4d83 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:54.766617 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-0e1308ca-abe4-4f69-9a84-4dc8a85e4d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:54.818244 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:54.842332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 87/161] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:54.843105 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1308ca-abe4-4f69-9a84-4dc8a85e4d83 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:54.895820 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af0858-ab6e-463c-9a99-1ec17124b977 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:54.940148 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad71bd-a366-4cde-850f-f16b447de444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:54.940855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad71bd-a366-4cde-850f-f16b447de444 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:54.941086 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad71bd-a366-4cde-850f-f16b447de444 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:54.941356 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad71bd-a366-4cde-850f-f16b447de444 None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:54.943174 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad71bd-a366-4cde-850f-f16b447de444 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf9c36dd93649fb92ed3e7f9f20258d)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:54.944641 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ad71bd-a366-4cde-850f-f16b447de444 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:54.946361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 75/162] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:33:54 2022] GET /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:54.950018 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad71bd-a366-4cde-850f-f16b447de444 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:55.011800 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1308ca-abe4-4f69-9a84-4dc8a85e4d83 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:55.052997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793553b2-d8f0-4ba1-b261-dc87778fd000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:55.053694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793553b2-d8f0-4ba1-b261-dc87778fd000 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:55.054200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793553b2-d8f0-4ba1-b261-dc87778fd000 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:55.054679 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793553b2-d8f0-4ba1-b261-dc87778fd000 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:55.127253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:55.129993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:55.181177 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793553b2-d8f0-4ba1-b261-dc87778fd000 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:55.182897 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793553b2-d8f0-4ba1-b261-dc87778fd000 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:55.183249 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad71bd-a366-4cde-850f-f16b447de444 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:55.268859 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbad16-d143-4fc5-a3f4-55bf1dad5b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:55.270054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbad16-d143-4fc5-a3f4-55bf1dad5b51 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:55.270563 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbad16-d143-4fc5-a3f4-55bf1dad5b51 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:55.271076 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbad16-d143-4fc5-a3f4-55bf1dad5b51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:55.300110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cbad16-d143-4fc5-a3f4-55bf1dad5b51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:33:55.308702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-87cbad16-d143-4fc5-a3f4-55bf1dad5b51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:33:55.308702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:33:55.308702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:33:55.308702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:33:55.308702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:33:55.308702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:33:55.308702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:33:55.308702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:33:55.308702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:33:55.308702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:33:55.308702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:33:55.308702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:33:55.308702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:33:55.308702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:33:55.308702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:33:55.308702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:33:55.309582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:33:55.309582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:33:55.309582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:33:55.309582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:33:55.309582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:33:55.309582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:33:55.309582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:33:55.309582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:33:55.309582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:33:55.309582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:33:55.309582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:33:55.309582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:33:55.309582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:33:55.309582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:33:55.309582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:33:55.309582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:33:55.310364 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:33:55.310364 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:33:55.310364 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:33:55.310364 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:33:55.310364 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:33:55.310364 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:33:55.310364 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:33:55.310364 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:33:55.310364 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:33:55.310364 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:33:55.310364 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:33:55.310364 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:33:55.317884 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 76/163] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jul 19 20:33:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:33:55.318886 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbad16-d143-4fc5-a3f4-55bf1dad5b51 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:55.395747 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 88/164] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:33:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:55.396774 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793553b2-d8f0-4ba1-b261-dc87778fd000 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:55.508241 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbad16-d143-4fc5-a3f4-55bf1dad5b51 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:55.544354 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:55.577650 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe21223-5d9d-4014-8c43-2fb916638fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:55.578723 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe21223-5d9d-4014-8c43-2fb916638fed None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:55.579209 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe21223-5d9d-4014-8c43-2fb916638fed None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:55.579793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe21223-5d9d-4014-8c43-2fb916638fed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:55.580330 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793553b2-d8f0-4ba1-b261-dc87778fd000 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:55.581056 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe21223-5d9d-4014-8c43-2fb916638fed None admin] RBAC: Adding query filter params (role.id=b30f01ef95004a1b84fc029830bdf053, scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d, user.id=70a97f9c967d4ba3819e7f4712b48b9e) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:55.581568 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe21223-5d9d-4014-8c43-2fb916638fed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:55.583205 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe21223-5d9d-4014-8c43-2fb916638fed None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:55.585323 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:55.592406 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 77/165] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:33:55 2022] GET /identity/v3/role_assignments?user.id=70a97f9c967d4ba3819e7f4712b48b9e&scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d&role.id=b30f01ef95004a1b84fc029830bdf053 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:55.593701 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe21223-5d9d-4014-8c43-2fb916638fed None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:55.653342 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b301e52-eaac-4e7a-acd8-c89db66f82b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:55.654035 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b301e52-eaac-4e7a-acd8-c89db66f82b3 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:55.654329 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b301e52-eaac-4e7a-acd8-c89db66f82b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:55.654610 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b301e52-eaac-4e7a-acd8-c89db66f82b3 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:55.655407 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b301e52-eaac-4e7a-acd8-c89db66f82b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:55.655762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b301e52-eaac-4e7a-acd8-c89db66f82b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:55.657544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b301e52-eaac-4e7a-acd8-c89db66f82b3 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:55.680658 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 89/166] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:33:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:55.683254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b69249-ea94-4486-bafd-80045fb4a64f None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:55.689589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b69249-ea94-4486-bafd-80045fb4a64f None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:55.690245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b69249-ea94-4486-bafd-80045fb4a64f None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:55.694649 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 90/167] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:55 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:55.698268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b69249-ea94-4486-bafd-80045fb4a64f None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:55.792976 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe21223-5d9d-4014-8c43-2fb916638fed None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:55.860599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205bcb9-e523-458c-b0c0-64e6700becc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:55.862017 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205bcb9-e523-458c-b0c0-64e6700becc2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:55.862294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205bcb9-e523-458c-b0c0-64e6700becc2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:55.862567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205bcb9-e523-458c-b0c0-64e6700becc2 None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:55.863808 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205bcb9-e523-458c-b0c0-64e6700becc2 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf9c36dd93649fb92ed3e7f9f20258d)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:55.865256 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c205bcb9-e523-458c-b0c0-64e6700becc2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:55.867158 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 78/168] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:33:55 2022] GET /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:55.869865 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6482f1-3086-4e91-8d45-80009ae06cad None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:55.870143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6482f1-3086-4e91-8d45-80009ae06cad None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:55.870420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6482f1-3086-4e91-8d45-80009ae06cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:55.902085 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-5f6482f1-3086-4e91-8d45-80009ae06cad None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:55.904813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-5f6482f1-3086-4e91-8d45-80009ae06cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:55.912301 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b69249-ea94-4486-bafd-80045fb4a64f None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:55.973316 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918af83-5555-4313-991e-2cb9fb165395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:55.974214 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918af83-5555-4313-991e-2cb9fb165395 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:55.974491 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918af83-5555-4313-991e-2cb9fb165395 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:55.974761 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918af83-5555-4313-991e-2cb9fb165395 None admin] PATH_INFO: `/v3/users/474d7a7ff49c4da4ad22b9479082adda` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:55.976794 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918af83-5555-4313-991e-2cb9fb165395 None admin] RBAC: Authorizing `identity:get_user(user_id=474d7a7ff49c4da4ad22b9479082adda)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:55.978252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918af83-5555-4313-991e-2cb9fb165395 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:55.988821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 91/169] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:33:55 2022] GET /identity/v3/users/474d7a7ff49c4da4ad22b9479082adda => generated 275 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:55.989767 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918af83-5555-4313-991e-2cb9fb165395 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:56.011656 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:56.027647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:56.040697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 79/170] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:56.041612 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6482f1-3086-4e91-8d45-80009ae06cad None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:56.159316 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918af83-5555-4313-991e-2cb9fb165395 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:56.220149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93343f23-2673-42ed-a877-fb32ee5f03c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:56.221390 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93343f23-2673-42ed-a877-fb32ee5f03c5 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:56.221678 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93343f23-2673-42ed-a877-fb32ee5f03c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:56.221869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6482f1-3086-4e91-8d45-80009ae06cad None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:56.222109 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93343f23-2673-42ed-a877-fb32ee5f03c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:56.222963 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93343f23-2673-42ed-a877-fb32ee5f03c5 None admin] RBAC: Adding query filter params (role.id=a2021efb2e4e459cbfa73f6987297bca, scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d, user.id=474d7a7ff49c4da4ad22b9479082adda) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:56.223287 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93343f23-2673-42ed-a877-fb32ee5f03c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:56.224947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93343f23-2673-42ed-a877-fb32ee5f03c5 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:56.234874 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 92/171] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:33:55 2022] GET /identity/v3/role_assignments?user.id=474d7a7ff49c4da4ad22b9479082adda&scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d&role.id=a2021efb2e4e459cbfa73f6987297bca => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:56.235879 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93343f23-2673-42ed-a877-fb32ee5f03c5 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:56.288027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6671a65-2414-4042-a56f-e966fc1e7e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:56.288709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6671a65-2414-4042-a56f-e966fc1e7e19 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:56.289052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6671a65-2414-4042-a56f-e966fc1e7e19 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:56.289342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6671a65-2414-4042-a56f-e966fc1e7e19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:56.366685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:56.375639 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:56.379275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6671a65-2414-4042-a56f-e966fc1e7e19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:56.381177 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6671a65-2414-4042-a56f-e966fc1e7e19 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:56.406832 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93343f23-2673-42ed-a877-fb32ee5f03c5 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:56.449478 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800cffc-af30-4c3c-906d-22cf171f90de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:56.450624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800cffc-af30-4c3c-906d-22cf171f90de None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:56.451138 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800cffc-af30-4c3c-906d-22cf171f90de None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:56.451580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800cffc-af30-4c3c-906d-22cf171f90de None admin] PATH_INFO: `/v3/roles/member` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:56.465013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800cffc-af30-4c3c-906d-22cf171f90de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:33:56.474501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-c800cffc-af30-4c3c-906d-22cf171f90de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:33:56.474501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:33:56.474501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:33:56.474501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:33:56.474501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:33:56.474501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:33:56.474501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:33:56.474501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:33:56.474501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:33:56.474501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:33:56.474501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:33:56.474501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:33:56.474501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:33:56.474501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:33:56.474501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:33:56.474501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:33:56.475661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:33:56.475661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:33:56.475661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:33:56.475661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:33:56.475661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:33:56.475661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:33:56.475661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:33:56.475661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:33:56.475661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:33:56.475661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:33:56.475661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:33:56.475661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:33:56.475661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:33:56.475661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:33:56.475661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:33:56.475661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:33:56.476587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:33:56.476587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:33:56.476587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:33:56.476587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:33:56.476587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:33:56.476587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:33:56.476587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:33:56.476587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:33:56.476587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:33:56.476587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:33:56.476587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:33:56.476587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:33:56.479120 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 93/172] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:33:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:33:56.484928 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800cffc-af30-4c3c-906d-22cf171f90de None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:56.574919 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 80/173] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:33:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:56.583981 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6671a65-2414-4042-a56f-e966fc1e7e19 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:56.687235 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800cffc-af30-4c3c-906d-22cf171f90de None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:56.734119 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a391113-fccf-4ce8-b1ca-3cf16c18619b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:56.734803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a391113-fccf-4ce8-b1ca-3cf16c18619b None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:56.735084 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a391113-fccf-4ce8-b1ca-3cf16c18619b None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:56.735381 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a391113-fccf-4ce8-b1ca-3cf16c18619b None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:56.736664 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a391113-fccf-4ce8-b1ca-3cf16c18619b None admin] RBAC: Adding query filter params (name=member) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:56.736968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a391113-fccf-4ce8-b1ca-3cf16c18619b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:56.738435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a391113-fccf-4ce8-b1ca-3cf16c18619b None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:56.741106 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:56.746914 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:56.755249 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 94/174] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:33:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:56.756585 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f923b59-60d0-408a-a287-c2655d5fa45e None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:56.756870 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f923b59-60d0-408a-a287-c2655d5fa45e None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:56.757144 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f923b59-60d0-408a-a287-c2655d5fa45e None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:56.757265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6671a65-2414-4042-a56f-e966fc1e7e19 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:56.758367 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 95/175] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:56.763722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a98c3-ae9d-4101-9da5-480e44fda5eb None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:56.764007 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a98c3-ae9d-4101-9da5-480e44fda5eb None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:56.764288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a98c3-ae9d-4101-9da5-480e44fda5eb None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:56.766487 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 96/176] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:56.767739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a98c3-ae9d-4101-9da5-480e44fda5eb None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:56.804314 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba186d40-7e60-42c3-a970-0fb262f24833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:56.805323 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba186d40-7e60-42c3-a970-0fb262f24833 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:56.805610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba186d40-7e60-42c3-a970-0fb262f24833 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:56.805893 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba186d40-7e60-42c3-a970-0fb262f24833 None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:56.808343 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba186d40-7e60-42c3-a970-0fb262f24833 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf9c36dd93649fb92ed3e7f9f20258d)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:56.809971 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba186d40-7e60-42c3-a970-0fb262f24833 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:56.811863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 81/177] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:33:56 2022] GET /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:56.813263 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1553f7-2d5d-4efe-a7cd-b391073efbf8 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:56.813548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1553f7-2d5d-4efe-a7cd-b391073efbf8 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:56.813877 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1553f7-2d5d-4efe-a7cd-b391073efbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:56.843474 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-6f1553f7-2d5d-4efe-a7cd-b391073efbf8 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:56.844782 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-6f1553f7-2d5d-4efe-a7cd-b391073efbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:56.896737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a98c3-ae9d-4101-9da5-480e44fda5eb None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:56.932219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 82/178] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:56.933302 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab274617-fb7b-44ef-89f2-6031d163775b None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:56.933592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab274617-fb7b-44ef-89f2-6031d163775b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:56.933870 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab274617-fb7b-44ef-89f2-6031d163775b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:56.934141 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940445fb-ca46-4a5a-b257-7e2d60e4cff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:56.935115 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940445fb-ca46-4a5a-b257-7e2d60e4cff1 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:56.935486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940445fb-ca46-4a5a-b257-7e2d60e4cff1 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:56.935850 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940445fb-ca46-4a5a-b257-7e2d60e4cff1 None admin] PATH_INFO: `/v3/users/474d7a7ff49c4da4ad22b9479082adda` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:56.937099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940445fb-ca46-4a5a-b257-7e2d60e4cff1 None admin] RBAC: Authorizing `identity:get_user(user_id=474d7a7ff49c4da4ad22b9479082adda)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:56.938522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940445fb-ca46-4a5a-b257-7e2d60e4cff1 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:56.943401 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 97/179] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:33:56 2022] GET /identity/v3/users/474d7a7ff49c4da4ad22b9479082adda => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:56.943401 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940445fb-ca46-4a5a-b257-7e2d60e4cff1 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:56.954669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-ab274617-fb7b-44ef-89f2-6031d163775b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:56.956981 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ab274617-fb7b-44ef-89f2-6031d163775b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:57.020426 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:57.035079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 83/180] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:57.043923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2e856-a8ce-492b-8f20-d105bc168c2d None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:57.043923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2e856-a8ce-492b-8f20-d105bc168c2d None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:57.043923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2e856-a8ce-492b-8f20-d105bc168c2d None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:57.043923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 84/181] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:57.043923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2e856-a8ce-492b-8f20-d105bc168c2d None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:57.072924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:57.077710 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940445fb-ca46-4a5a-b257-7e2d60e4cff1 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:57.111885 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7072f-0e22-40c3-ae12-7cd00f2f611b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:57.112545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7072f-0e22-40c3-ae12-7cd00f2f611b None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:57.112831 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7072f-0e22-40c3-ae12-7cd00f2f611b None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:57.113107 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7072f-0e22-40c3-ae12-7cd00f2f611b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:57.113939 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7072f-0e22-40c3-ae12-7cd00f2f611b None admin] RBAC: Adding query filter params (role.id=92567de587bf40dab488cc1eb666b221, scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d, user.id=474d7a7ff49c4da4ad22b9479082adda) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:57.114262 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7072f-0e22-40c3-ae12-7cd00f2f611b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:57.115741 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7072f-0e22-40c3-ae12-7cd00f2f611b None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:57.121531 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 98/182] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:33:56 2022] GET /identity/v3/role_assignments?user.id=474d7a7ff49c4da4ad22b9479082adda&scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d&role.id=92567de587bf40dab488cc1eb666b221 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:57.122358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7072f-0e22-40c3-ae12-7cd00f2f611b None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:57.169714 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2e856-a8ce-492b-8f20-d105bc168c2d None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:57.213681 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681a898-5350-4776-9d47-28a6ca6c333f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:57.214360 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681a898-5350-4776-9d47-28a6ca6c333f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:57.214646 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681a898-5350-4776-9d47-28a6ca6c333f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:57.214927 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681a898-5350-4776-9d47-28a6ca6c333f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:57.244750 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7072f-0e22-40c3-ae12-7cd00f2f611b None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:57.280875 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:57.291803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce83b1b-9fe5-468e-8182-cdb02143be94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:57.292999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce83b1b-9fe5-468e-8182-cdb02143be94 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:57.292999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce83b1b-9fe5-468e-8182-cdb02143be94 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:57.293162 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce83b1b-9fe5-468e-8182-cdb02143be94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:57.297103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681a898-5350-4776-9d47-28a6ca6c333f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:57.299118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681a898-5350-4776-9d47-28a6ca6c333f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:57.305309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce83b1b-9fe5-468e-8182-cdb02143be94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:33:57.313455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-2ce83b1b-9fe5-468e-8182-cdb02143be94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:33:57.313455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:33:57.313455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:33:57.313455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:33:57.313455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:33:57.313455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:33:57.313455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:33:57.313455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:33:57.313455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:33:57.313455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:33:57.313455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:33:57.313455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:33:57.313455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:33:57.313455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:33:57.313455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:33:57.313455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:33:57.314433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:33:57.314433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:33:57.314433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:33:57.314433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:33:57.314433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:33:57.314433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:33:57.314433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:33:57.314433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:33:57.314433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:33:57.314433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:33:57.314433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:33:57.314433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:33:57.314433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:33:57.314433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:33:57.314433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:33:57.314433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:33:57.315221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:33:57.315221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:33:57.315221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:33:57.315221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:33:57.315221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:33:57.315221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:33:57.315221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:33:57.315221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:33:57.315221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:33:57.315221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:33:57.315221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:33:57.315221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:33:57.315221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 99/183] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:33:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:33:57.316031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575a3c6-cc71-4992-8c1f-d91e4be7d935 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:57.316317 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575a3c6-cc71-4992-8c1f-d91e4be7d935 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:57.316593 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575a3c6-cc71-4992-8c1f-d91e4be7d935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:57.330483 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:57.334934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-8575a3c6-cc71-4992-8c1f-d91e4be7d935 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:57.335698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-8575a3c6-cc71-4992-8c1f-d91e4be7d935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:57.410083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 100/184] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:57.410925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575a3c6-cc71-4992-8c1f-d91e4be7d935 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:57.416615 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 85/185] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:33:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:57.416615 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cfec9-670e-4ebb-bf25-d37217ac8458 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:57.416615 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cfec9-670e-4ebb-bf25-d37217ac8458 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:57.416615 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5cfec9-670e-4ebb-bf25-d37217ac8458 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:57.416615 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 86/186] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:33:57.416615 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cfec9-670e-4ebb-bf25-d37217ac8458 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:57.545535 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5cfec9-670e-4ebb-bf25-d37217ac8458 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:57.554720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575a3c6-cc71-4992-8c1f-d91e4be7d935 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:57.569510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:57.572566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:57.581887 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1a282-fcf7-4a8e-89da-07f64ccfe957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:57.582563 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1a282-fcf7-4a8e-89da-07f64ccfe957 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:57.582848 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1a282-fcf7-4a8e-89da-07f64ccfe957 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:57.583127 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1a282-fcf7-4a8e-89da-07f64ccfe957 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:57.583919 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1a282-fcf7-4a8e-89da-07f64ccfe957 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:57.584229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1a282-fcf7-4a8e-89da-07f64ccfe957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:57.585660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb1a282-fcf7-4a8e-89da-07f64ccfe957 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:57.589810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a886cf-1294-4825-86d9-83954618d440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:57.590629 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a886cf-1294-4825-86d9-83954618d440 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:57.590918 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a886cf-1294-4825-86d9-83954618d440 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:57.591194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a886cf-1294-4825-86d9-83954618d440 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:57.599944 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 87/187] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:33:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:57.599944 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1a282-fcf7-4a8e-89da-07f64ccfe957 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:57.602068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a886cf-1294-4825-86d9-83954618d440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:33:57.610332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-99a886cf-1294-4825-86d9-83954618d440 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:33:57.610332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:33:57.610332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:33:57.610332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:33:57.610332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:33:57.610332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:33:57.610332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:33:57.610332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:33:57.610332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:33:57.610332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:33:57.610332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:33:57.610332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:33:57.610332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:33:57.610332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:33:57.610332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:33:57.610332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:33:57.611872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:33:57.611872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:33:57.611872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:33:57.611872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:33:57.611872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:33:57.611872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:33:57.611872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:33:57.611872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:33:57.611872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:33:57.611872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:33:57.611872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:33:57.611872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:33:57.611872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:33:57.611872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:33:57.611872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:33:57.611872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:33:57.612680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:33:57.612680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:33:57.612680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:33:57.612680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:33:57.612680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:33:57.612680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:33:57.612680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:33:57.612680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:33:57.612680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:33:57.612680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:33:57.612680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:33:57.612680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:33:57.612680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 101/188] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jul 19 20:33:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:33:57.613796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e170cca-efdc-4369-9fb8-0a1d29e3f502 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:57.613796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e170cca-efdc-4369-9fb8-0a1d29e3f502 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:57.613947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e170cca-efdc-4369-9fb8-0a1d29e3f502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:57.630703 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-2e170cca-efdc-4369-9fb8-0a1d29e3f502 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:33:57.631922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-2e170cca-efdc-4369-9fb8-0a1d29e3f502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:33:57.699922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 102/189] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:33:57.711950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e170cca-efdc-4369-9fb8-0a1d29e3f502 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:57.712054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1a282-fcf7-4a8e-89da-07f64ccfe957 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:57.740784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d830c-7166-466b-b383-274b4ef5ac98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:57.741697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d830c-7166-466b-b383-274b4ef5ac98 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:57.742003 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d830c-7166-466b-b383-274b4ef5ac98 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:57.742306 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d830c-7166-466b-b383-274b4ef5ac98 None admin] PATH_INFO: `/v3/projects/cc13fa98a78e4965afbd5771a048b274` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:57.743891 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d830c-7166-466b-b383-274b4ef5ac98 None admin] RBAC: Authorizing `identity:get_project(project_id=cc13fa98a78e4965afbd5771a048b274)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:57.745401 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d830c-7166-466b-b383-274b4ef5ac98 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:57.747220 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 88/190] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:33:57 2022] GET /identity/v3/projects/cc13fa98a78e4965afbd5771a048b274 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:57.749062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d830c-7166-466b-b383-274b4ef5ac98 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:57.803123 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:57.819205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e170cca-efdc-4369-9fb8-0a1d29e3f502 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:57.837951 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:57.855730 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d830c-7166-466b-b383-274b4ef5ac98 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:57.866310 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c2a06-a8cb-4f9f-a127-11bfeb1e1ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:57.867108 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c2a06-a8cb-4f9f-a127-11bfeb1e1ebb None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:57.867422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c2a06-a8cb-4f9f-a127-11bfeb1e1ebb None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:57.867695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c2a06-a8cb-4f9f-a127-11bfeb1e1ebb None admin] PATH_INFO: `/v3/domains/default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:57.868842 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c2a06-a8cb-4f9f-a127-11bfeb1e1ebb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:57.870297 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91c2a06-a8cb-4f9f-a127-11bfeb1e1ebb None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:57.871959 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 103/191] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:33:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:57.872710 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c2a06-a8cb-4f9f-a127-11bfeb1e1ebb None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:57.893343 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878082ff-228c-47d0-b7da-6c0360afb01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:57.894220 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878082ff-228c-47d0-b7da-6c0360afb01f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:57.894502 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878082ff-228c-47d0-b7da-6c0360afb01f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:57.894775 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878082ff-228c-47d0-b7da-6c0360afb01f None admin] PATH_INFO: `/v3/users/ec2c8c99f94b489c8a6b286690216c54` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:57.909121 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878082ff-228c-47d0-b7da-6c0360afb01f None admin] RBAC: Authorizing `identity:get_user(user_id=ec2c8c99f94b489c8a6b286690216c54)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:57.910559 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878082ff-228c-47d0-b7da-6c0360afb01f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:57.912256 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 89/192] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:33:57 2022] GET /identity/v3/users/ec2c8c99f94b489c8a6b286690216c54 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:57.913009 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878082ff-228c-47d0-b7da-6c0360afb01f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:57.976875 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c2a06-a8cb-4f9f-a127-11bfeb1e1ebb None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:58.009986 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178185f-6818-4fba-b6f1-322a7998b867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:58.010587 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878082ff-228c-47d0-b7da-6c0360afb01f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:58.010688 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178185f-6818-4fba-b6f1-322a7998b867 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:58.010922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178185f-6818-4fba-b6f1-322a7998b867 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:58.011199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178185f-6818-4fba-b6f1-322a7998b867 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:58.012059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178185f-6818-4fba-b6f1-322a7998b867 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:58.012360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178185f-6818-4fba-b6f1-322a7998b867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:58.013734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178185f-6818-4fba-b6f1-322a7998b867 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:58.022435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 104/193] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:33:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:58.024294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:58.024446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178185f-6818-4fba-b6f1-322a7998b867 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:58.045523 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab99be2-11b2-4c9a-b2a6-2e8c8a4c1d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:58.046316 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab99be2-11b2-4c9a-b2a6-2e8c8a4c1d00 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:58.046594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab99be2-11b2-4c9a-b2a6-2e8c8a4c1d00 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:58.046869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab99be2-11b2-4c9a-b2a6-2e8c8a4c1d00 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:58.058299 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab99be2-11b2-4c9a-b2a6-2e8c8a4c1d00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:33:58.065719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:58.067989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-7ab99be2-11b2-4c9a-b2a6-2e8c8a4c1d00 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 20:33:58.067989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:33:58.067989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:33:58.067989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:33:58.067989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:33:58.067989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:33:58.067989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:33:58.067989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:33:58.067989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:33:58.067989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:33:58.067989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:33:58.067989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:33:58.067989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:33:58.067989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:33:58.067989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:33:58.067989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:33:58.068900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:33:58.068900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:33:58.068900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:33:58.068900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:33:58.068900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:33:58.068900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:33:58.068900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:33:58.068900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:33:58.068900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:33:58.068900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:33:58.068900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:33:58.068900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:33:58.068900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:33:58.068900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:33:58.068900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:33:58.068900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:33:58.069697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:33:58.069697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:33:58.069697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:33:58.069697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:33:58.069697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:33:58.069697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:33:58.069697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:33:58.069697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:33:58.069697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:33:58.069697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:33:58.069697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 20:33:58.069697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:33:58.069697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 90/194] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:33:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:33:58.070343 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab99be2-11b2-4c9a-b2a6-2e8c8a4c1d00 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:58.132112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178185f-6818-4fba-b6f1-322a7998b867 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:58.164770 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff74b6-7e1b-44f6-b5db-c77591e1d70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:58.165432 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff74b6-7e1b-44f6-b5db-c77591e1d70c None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:58.165709 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff74b6-7e1b-44f6-b5db-c77591e1d70c None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:58.165982 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff74b6-7e1b-44f6-b5db-c77591e1d70c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:58.166818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff74b6-7e1b-44f6-b5db-c77591e1d70c None admin] RBAC: Adding query filter params (role.id=a2021efb2e4e459cbfa73f6987297bca, scope.project.id=cc13fa98a78e4965afbd5771a048b274, user.id=474d7a7ff49c4da4ad22b9479082adda) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:58.167122 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff74b6-7e1b-44f6-b5db-c77591e1d70c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:58.169043 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff74b6-7e1b-44f6-b5db-c77591e1d70c None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:58.173318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab99be2-11b2-4c9a-b2a6-2e8c8a4c1d00 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:58.174860 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 105/195] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:33:58 2022] GET /identity/v3/role_assignments?user.id=474d7a7ff49c4da4ad22b9479082adda&scope.project.id=cc13fa98a78e4965afbd5771a048b274&role.id=a2021efb2e4e459cbfa73f6987297bca => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:58.174860 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff74b6-7e1b-44f6-b5db-c77591e1d70c None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:58.223395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd89336-cdca-4ba6-8db1-647c6d0fb0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:58.224084 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd89336-cdca-4ba6-8db1-647c6d0fb0a1 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:58.224366 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd89336-cdca-4ba6-8db1-647c6d0fb0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:58.224853 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd89336-cdca-4ba6-8db1-647c6d0fb0a1 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:58.225372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd89336-cdca-4ba6-8db1-647c6d0fb0a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:58.226939 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd89336-cdca-4ba6-8db1-647c6d0fb0a1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:58.249199 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 91/196] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jul 19 20:33:58 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:33:58.250338 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd89336-cdca-4ba6-8db1-647c6d0fb0a1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:58.290819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:58.310650 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff74b6-7e1b-44f6-b5db-c77591e1d70c None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:58.313225 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:58.367378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31944930-ab42-4f30-bcb3-b9ec313dc754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:58.368064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31944930-ab42-4f30-bcb3-b9ec313dc754 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:58.368512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31944930-ab42-4f30-bcb3-b9ec313dc754 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:58.368792 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31944930-ab42-4f30-bcb3-b9ec313dc754 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:58.397220 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd89336-cdca-4ba6-8db1-647c6d0fb0a1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:58.447625 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ceb7a1-5a33-4c55-9e88-a23f3466f32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:58.448701 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ceb7a1-5a33-4c55-9e88-a23f3466f32f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:58.449965 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ceb7a1-5a33-4c55-9e88-a23f3466f32f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:58.450251 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ceb7a1-5a33-4c55-9e88-a23f3466f32f None admin] PATH_INFO: `/v3/users/ec2c8c99f94b489c8a6b286690216c54` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:58.451607 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ceb7a1-5a33-4c55-9e88-a23f3466f32f None admin] RBAC: Authorizing `identity:get_user(user_id=ec2c8c99f94b489c8a6b286690216c54)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:58.453610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ceb7a1-5a33-4c55-9e88-a23f3466f32f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:58.456426 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 92/197] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:33:58 2022] GET /identity/v3/users/ec2c8c99f94b489c8a6b286690216c54 => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:58.457224 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ceb7a1-5a33-4c55-9e88-a23f3466f32f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:58.474384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31944930-ab42-4f30-bcb3-b9ec313dc754 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:58.476262 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31944930-ab42-4f30-bcb3-b9ec313dc754 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:58.586265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ceb7a1-5a33-4c55-9e88-a23f3466f32f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:58.589490 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:58.603575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 106/198] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:33:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:58.604433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31944930-ab42-4f30-bcb3-b9ec313dc754 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:58.608537 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:58.639360 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e84d60-dfbf-40c2-aaf3-d9b8ab4bbed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:58.640449 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e84d60-dfbf-40c2-aaf3-d9b8ab4bbed9 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:58.641005 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e84d60-dfbf-40c2-aaf3-d9b8ab4bbed9 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:58.641293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e84d60-dfbf-40c2-aaf3-d9b8ab4bbed9 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:58.642058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e84d60-dfbf-40c2-aaf3-d9b8ab4bbed9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:58.642389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e84d60-dfbf-40c2-aaf3-d9b8ab4bbed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:58.645345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e84d60-dfbf-40c2-aaf3-d9b8ab4bbed9 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:58.657353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 93/199] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:33:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:58.659003 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e84d60-dfbf-40c2-aaf3-d9b8ab4bbed9 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:58.714160 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31944930-ab42-4f30-bcb3-b9ec313dc754 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:58.754277 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1227fa-a19b-4a02-a1a0-342325069df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:58.754941 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1227fa-a19b-4a02-a1a0-342325069df0 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:58.755227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1227fa-a19b-4a02-a1a0-342325069df0 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:58.755533 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1227fa-a19b-4a02-a1a0-342325069df0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:58.789118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e84d60-dfbf-40c2-aaf3-d9b8ab4bbed9 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:58.828535 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5603dc-045e-4eae-b6e2-457f8ba17367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:58.829462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5603dc-045e-4eae-b6e2-457f8ba17367 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:58.829742 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5603dc-045e-4eae-b6e2-457f8ba17367 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:58.830158 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5603dc-045e-4eae-b6e2-457f8ba17367 None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:58.831508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5603dc-045e-4eae-b6e2-457f8ba17367 None admin] RBAC: Authorizing `identity:get_project(project_id=7763226124204b95a4f39f7d36e13a32)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:58.832992 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5603dc-045e-4eae-b6e2-457f8ba17367 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:58.835201 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 94/200] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:33:58 2022] GET /identity/v3/projects/7763226124204b95a4f39f7d36e13a32 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:58.836345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5603dc-045e-4eae-b6e2-457f8ba17367 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:58.844781 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1227fa-a19b-4a02-a1a0-342325069df0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:58.846836 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1227fa-a19b-4a02-a1a0-342325069df0 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:58.849546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:58.872273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:58.974702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5603dc-045e-4eae-b6e2-457f8ba17367 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:58.976326 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 107/201] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:33:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:58.977479 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1227fa-a19b-4a02-a1a0-342325069df0 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:59.019655 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172cec4-73fd-4d4a-a0b6-1dfc34778817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:59.021611 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172cec4-73fd-4d4a-a0b6-1dfc34778817 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:59.022075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172cec4-73fd-4d4a-a0b6-1dfc34778817 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:59.022534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172cec4-73fd-4d4a-a0b6-1dfc34778817 None admin] PATH_INFO: `/v3/users/05f408571928466da681732ae00a680c` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:59.025430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172cec4-73fd-4d4a-a0b6-1dfc34778817 None admin] RBAC: Authorizing `identity:get_user(user_id=05f408571928466da681732ae00a680c)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:59.026876 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172cec4-73fd-4d4a-a0b6-1dfc34778817 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:59.033997 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 95/202] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:33:58 2022] GET /identity/v3/users/05f408571928466da681732ae00a680c => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:59.033997 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172cec4-73fd-4d4a-a0b6-1dfc34778817 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:59.098465 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1227fa-a19b-4a02-a1a0-342325069df0 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:59.100786 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:59.146433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:59.148583 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a35a4-1d59-4b6c-a85b-5007df839d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:59.149704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a35a4-1d59-4b6c-a85b-5007df839d18 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:59.150234 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a35a4-1d59-4b6c-a85b-5007df839d18 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:59.151355 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a35a4-1d59-4b6c-a85b-5007df839d18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:59.153140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a35a4-1d59-4b6c-a85b-5007df839d18 None admin] RBAC: Adding query filter params (role.id=b30f01ef95004a1b84fc029830bdf053, scope.project.id=7763226124204b95a4f39f7d36e13a32, user.id=ec2c8c99f94b489c8a6b286690216c54) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:59.153636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a35a4-1d59-4b6c-a85b-5007df839d18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:59.154903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172cec4-73fd-4d4a-a0b6-1dfc34778817 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:59.155496 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a35a4-1d59-4b6c-a85b-5007df839d18 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:59.169631 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 108/203] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:33:58 2022] GET /identity/v3/role_assignments?user.id=ec2c8c99f94b489c8a6b286690216c54&scope.project.id=7763226124204b95a4f39f7d36e13a32&role.id=b30f01ef95004a1b84fc029830bdf053 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:59.169631 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a35a4-1d59-4b6c-a85b-5007df839d18 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:59.222777 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39851c5c-cdd5-4874-9a65-0728ee82c6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:59.224146 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39851c5c-cdd5-4874-9a65-0728ee82c6d5 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:59.224434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39851c5c-cdd5-4874-9a65-0728ee82c6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:59.224755 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39851c5c-cdd5-4874-9a65-0728ee82c6d5 None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:59.229160 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39851c5c-cdd5-4874-9a65-0728ee82c6d5 None admin] RBAC: Authorizing `identity:get_project(project_id=7763226124204b95a4f39f7d36e13a32)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:59.230906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39851c5c-cdd5-4874-9a65-0728ee82c6d5 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:59.234313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 96/204] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:33:59 2022] GET /identity/v3/projects/7763226124204b95a4f39f7d36e13a32 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:59.240825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39851c5c-cdd5-4874-9a65-0728ee82c6d5 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:59.372650 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39851c5c-cdd5-4874-9a65-0728ee82c6d5 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:59.385834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a35a4-1d59-4b6c-a85b-5007df839d18 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:59.416421 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e87dd8-cd4e-4813-8c72-e047adeee186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:59.417979 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e87dd8-cd4e-4813-8c72-e047adeee186 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:59.418481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e87dd8-cd4e-4813-8c72-e047adeee186 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:59.419104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e87dd8-cd4e-4813-8c72-e047adeee186 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:59.420550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e87dd8-cd4e-4813-8c72-e047adeee186 None admin] RBAC: Adding query filter params (role.id=92567de587bf40dab488cc1eb666b221, scope.project.id=7763226124204b95a4f39f7d36e13a32, user.id=ec2c8c99f94b489c8a6b286690216c54) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:33:59.421095 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e87dd8-cd4e-4813-8c72-e047adeee186 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:59.423175 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e87dd8-cd4e-4813-8c72-e047adeee186 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:59.429648 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2f649-fb73-48be-9391-abb9d2ad30f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:59.430363 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2f649-fb73-48be-9391-abb9d2ad30f6 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:59.430776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2f649-fb73-48be-9391-abb9d2ad30f6 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:59.430987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2f649-fb73-48be-9391-abb9d2ad30f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:59.431286 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 97/205] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:33:59 2022] GET /identity/v3/role_assignments?user.id=ec2c8c99f94b489c8a6b286690216c54&scope.project.id=7763226124204b95a4f39f7d36e13a32&role.id=92567de587bf40dab488cc1eb666b221 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:59.475095 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:59.514539 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2f649-fb73-48be-9391-abb9d2ad30f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:59.516044 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2f649-fb73-48be-9391-abb9d2ad30f6 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:59.632255 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 109/206] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:33:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:33:59.640406 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e87dd8-cd4e-4813-8c72-e047adeee186 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:59.678814 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:59.758463 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e87dd8-cd4e-4813-8c72-e047adeee186 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:33:59.811957 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914d523-fb38-4059-a171-44d75cf31871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:33:59.812840 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914d523-fb38-4059-a171-44d75cf31871 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:33:59.813121 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914d523-fb38-4059-a171-44d75cf31871 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:33:59.813395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914d523-fb38-4059-a171-44d75cf31871 None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:33:59.814676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914d523-fb38-4059-a171-44d75cf31871 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf9c36dd93649fb92ed3e7f9f20258d)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:33:59.816251 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914d523-fb38-4059-a171-44d75cf31871 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:33:59.817974 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 98/207] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:33:59 2022] GET /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:33:59.824232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2f649-fb73-48be-9391-abb9d2ad30f6 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:33:59.915636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:33:59.974006 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2f649-fb73-48be-9391-abb9d2ad30f6 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:00.024058 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcabf7-986f-445e-959e-0dcf9f62f342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:00.024724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcabf7-986f-445e-959e-0dcf9f62f342 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:00.025006 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcabf7-986f-445e-959e-0dcf9f62f342 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:00.025282 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcabf7-986f-445e-959e-0dcf9f62f342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:00.026121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcabf7-986f-445e-959e-0dcf9f62f342 None admin] RBAC: Adding query filter params (role.id=61e37a77948648d989c2ba2222b6fe6f, scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d, user.id=05f408571928466da681732ae00a680c) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:00.026428 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcabf7-986f-445e-959e-0dcf9f62f342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:00.028035 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effcabf7-986f-445e-959e-0dcf9f62f342 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:00.039997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 110/208] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:33:59 2022] GET /identity/v3/role_assignments?user.id=05f408571928466da681732ae00a680c&scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d&role.id=61e37a77948648d989c2ba2222b6fe6f => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:00.599779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a45b9d-a3c3-44e3-9039-bdea8822a428 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:00.600556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a45b9d-a3c3-44e3-9039-bdea8822a428 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:00.600556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a45b9d-a3c3-44e3-9039-bdea8822a428 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:00.601936 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 99/209] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:00.609779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab9946-8a8c-4142-8bea-beb04db70e82 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:00.610622 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab9946-8a8c-4142-8bea-beb04db70e82 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:00.611448 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab9946-8a8c-4142-8bea-beb04db70e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:00.637696 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-afab9946-8a8c-4142-8bea-beb04db70e82 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:00.638893 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-afab9946-8a8c-4142-8bea-beb04db70e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:00.645862 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0e9fa-26ad-4cd9-bf68-0fa87f83e86b None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:00.646700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0e9fa-26ad-4cd9-bf68-0fa87f83e86b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:00.647524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0e9fa-26ad-4cd9-bf68-0fa87f83e86b None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:00.650162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 100/210] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:00.660336 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00738734-dcd4-4e88-b4d0-a29a33319c5f None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:00.660808 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00738734-dcd4-4e88-b4d0-a29a33319c5f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:00.661289 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00738734-dcd4-4e88-b4d0-a29a33319c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:00.697591 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-00738734-dcd4-4e88-b4d0-a29a33319c5f None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:00.700672 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-00738734-dcd4-4e88-b4d0-a29a33319c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:00.750932 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 111/211] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:00.774452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab9946-8a8c-4142-8bea-beb04db70e82 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:00.786175 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 101/212] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:00.812703 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00738734-dcd4-4e88-b4d0-a29a33319c5f None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:00.839574 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:00.849198 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:00.908815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab9946-8a8c-4142-8bea-beb04db70e82 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:00.933720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00738734-dcd4-4e88-b4d0-a29a33319c5f None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:00.946798 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8945d5-e2d3-4674-a1e0-27f8a739bbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:00.947912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8945d5-e2d3-4674-a1e0-27f8a739bbd8 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:00.948219 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8945d5-e2d3-4674-a1e0-27f8a739bbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:00.948498 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8945d5-e2d3-4674-a1e0-27f8a739bbd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:00.962602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8945d5-e2d3-4674-a1e0-27f8a739bbd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:00.971875 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcddc9cf-ed03-46a1-a9a6-7b58f215dd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:00.972139 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-bd8945d5-e2d3-4674-a1e0-27f8a739bbd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:00.972139 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:00.972139 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:00.972139 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:00.972139 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:00.972139 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:00.972139 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:00.972139 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:00.972139 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:00.972139 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:00.972139 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:00.972139 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:00.972139 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:00.972139 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:00.972139 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:00.972139 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:00.972970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:00.972970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:00.972970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:00.972970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:00.972970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:00.972970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:00.972970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:00.972970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:00.972970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:00.972970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:00.972970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:00.972970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:00.972970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:00.972970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:00.972970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:00.972970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:00.973762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:00.973762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:00.973762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:00.973762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:00.973762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:00.973762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:00.973762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:00.973762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:00.973762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:00.973762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:00.973762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:00.973762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:00.974371 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddc9cf-ed03-46a1-a9a6-7b58f215dd9f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:00.974371 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddc9cf-ed03-46a1-a9a6-7b58f215dd9f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:00.974371 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddc9cf-ed03-46a1-a9a6-7b58f215dd9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:00.974549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 112/213] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:34:00.975089 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcddc9cf-ed03-46a1-a9a6-7b58f215dd9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:00.976324 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcddc9cf-ed03-46a1-a9a6-7b58f215dd9f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:00.980436 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8945d5-e2d3-4674-a1e0-27f8a739bbd8 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:00.982794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 102/214] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:00.983780 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcddc9cf-ed03-46a1-a9a6-7b58f215dd9f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:01.086544 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:01.097501 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcddc9cf-ed03-46a1-a9a6-7b58f215dd9f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:01.115819 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8945d5-e2d3-4674-a1e0-27f8a739bbd8 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:01.137296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:01.145080 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4c40f-0b14-4083-91ff-d5e28cf7bbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:01.146192 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4c40f-0b14-4083-91ff-d5e28cf7bbbb None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:01.146635 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4c40f-0b14-4083-91ff-d5e28cf7bbbb None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:01.147068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4c40f-0b14-4083-91ff-d5e28cf7bbbb None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:01.148110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4c40f-0b14-4083-91ff-d5e28cf7bbbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:01.150342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4c40f-0b14-4083-91ff-d5e28cf7bbbb None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:01.153508 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394519e5-e783-4178-ab01-a3b05eea6038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:01.154180 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394519e5-e783-4178-ab01-a3b05eea6038 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:01.154463 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394519e5-e783-4178-ab01-a3b05eea6038 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:01.154734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394519e5-e783-4178-ab01-a3b05eea6038 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:01.155554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394519e5-e783-4178-ab01-a3b05eea6038 None admin] RBAC: Adding query filter params (name=member) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:01.155861 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394519e5-e783-4178-ab01-a3b05eea6038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:01.157498 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394519e5-e783-4178-ab01-a3b05eea6038 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:01.167870 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 113/215] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:34:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:01.176474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394519e5-e783-4178-ab01-a3b05eea6038 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:01.178284 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 103/216] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jul 19 20:34:00 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:34:01.306409 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394519e5-e783-4178-ab01-a3b05eea6038 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:01.349133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71267d5-b8ab-4cc1-8fda-1580e433647c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:01.350044 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71267d5-b8ab-4cc1-8fda-1580e433647c None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:01.350328 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71267d5-b8ab-4cc1-8fda-1580e433647c None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:01.350594 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71267d5-b8ab-4cc1-8fda-1580e433647c None admin] PATH_INFO: `/v3/users/b98d1a04efa24341b48291b164f03bc2` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:01.369601 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71267d5-b8ab-4cc1-8fda-1580e433647c None admin] RBAC: Authorizing `identity:get_user(user_id=b98d1a04efa24341b48291b164f03bc2)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:01.371132 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71267d5-b8ab-4cc1-8fda-1580e433647c None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:01.372947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 114/217] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:34:01 2022] GET /identity/v3/users/b98d1a04efa24341b48291b164f03bc2 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:01.379207 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4c40f-0b14-4083-91ff-d5e28cf7bbbb None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:01.487341 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4c40f-0b14-4083-91ff-d5e28cf7bbbb None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:01.529520 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0f5e5-6a6a-4941-98e6-5b10baf80ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:01.530266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0f5e5-6a6a-4941-98e6-5b10baf80ea0 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:01.530549 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0f5e5-6a6a-4941-98e6-5b10baf80ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:01.530863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0f5e5-6a6a-4941-98e6-5b10baf80ea0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:01.556236 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:01.621606 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0f5e5-6a6a-4941-98e6-5b10baf80ea0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:01.623890 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c0f5e5-6a6a-4941-98e6-5b10baf80ea0 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:01.710477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414ed78-6ab2-476d-a3a9-7f73710dcedc None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:01.710826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414ed78-6ab2-476d-a3a9-7f73710dcedc None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:01.711042 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414ed78-6ab2-476d-a3a9-7f73710dcedc None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:01.713592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 115/218] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:34:01.720300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f117d-8069-423d-9a31-fdb1ca3517d8 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:01.721392 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f117d-8069-423d-9a31-fdb1ca3517d8 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:01.721876 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f117d-8069-423d-9a31-fdb1ca3517d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:01.737689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 104/219] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:01.742405 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-1b5f117d-8069-423d-9a31-fdb1ca3517d8 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:01.743917 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-1b5f117d-8069-423d-9a31-fdb1ca3517d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:01.744216 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0f5e5-6a6a-4941-98e6-5b10baf80ea0 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:01.783912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:01.821355 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 116/220] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:01.849579 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f117d-8069-423d-9a31-fdb1ca3517d8 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:01.855498 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:01.988790 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f117d-8069-423d-9a31-fdb1ca3517d8 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:01.993174 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0f5e5-6a6a-4941-98e6-5b10baf80ea0 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:02.035402 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81267d13-d6d7-48d0-a5eb-32f14cae5359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:02.036632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81267d13-d6d7-48d0-a5eb-32f14cae5359 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:02.037082 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81267d13-d6d7-48d0-a5eb-32f14cae5359 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:02.037743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81267d13-d6d7-48d0-a5eb-32f14cae5359 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:02.047773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41760c15-052c-457c-a375-b4ce110f634e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:02.049482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41760c15-052c-457c-a375-b4ce110f634e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:02.049993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41760c15-052c-457c-a375-b4ce110f634e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:02.050474 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41760c15-052c-457c-a375-b4ce110f634e None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:02.052040 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41760c15-052c-457c-a375-b4ce110f634e None admin] RBAC: Authorizing `identity:get_project(project_id=7763226124204b95a4f39f7d36e13a32)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:02.052148 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81267d13-d6d7-48d0-a5eb-32f14cae5359 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:02.053783 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41760c15-052c-457c-a375-b4ce110f634e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:02.060038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-81267d13-d6d7-48d0-a5eb-32f14cae5359 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:34:02.060038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:02.060038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:02.060038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:02.060038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:02.060038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:02.060038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:02.060038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:02.060038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:02.060038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:02.060038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:02.060038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:02.060038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:02.060038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:02.060038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:02.060038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:02.060955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:02.060955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:02.060955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:02.060955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:02.060955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:02.060955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:02.060955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:02.060955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:02.060955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:02.060955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:02.060955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:02.060955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:02.060955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:02.060955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:02.060955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:02.060955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:02.061755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:02.061755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:02.061755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:02.061755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:02.061755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:02.061755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:02.061755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:02.061755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:02.061755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:02.061755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:02.061755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:34:02.061755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:02.062352 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 105/221] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:01 2022] GET /identity/v3/projects/7763226124204b95a4f39f7d36e13a32 => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:02.062352 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854106e8-b14f-4de3-9660-6e3dd430bd53 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:02.062472 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854106e8-b14f-4de3-9660-6e3dd430bd53 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:02.063328 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854106e8-b14f-4de3-9660-6e3dd430bd53 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:02.064896 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 117/222] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:34:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:34:02.066179 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81267d13-d6d7-48d0-a5eb-32f14cae5359 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:02.066700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 106/223] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:02.071971 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854106e8-b14f-4de3-9660-6e3dd430bd53 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:02.112564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:02.186624 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854106e8-b14f-4de3-9660-6e3dd430bd53 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:02.207708 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81267d13-d6d7-48d0-a5eb-32f14cae5359 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:02.209340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:02.234521 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddbe10-a325-454b-9f98-3386e3a4b9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:02.235743 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddbe10-a325-454b-9f98-3386e3a4b9ec None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:02.236093 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddbe10-a325-454b-9f98-3386e3a4b9ec None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:02.236501 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddbe10-a325-454b-9f98-3386e3a4b9ec None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:02.237515 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddbe10-a325-454b-9f98-3386e3a4b9ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:02.237990 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddbe10-a325-454b-9f98-3386e3a4b9ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:02.240530 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddbe10-a325-454b-9f98-3386e3a4b9ec None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:02.247679 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d426232-cd93-41c3-8d0e-8f8e76c23af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:02.248701 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d426232-cd93-41c3-8d0e-8f8e76c23af9 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:02.249283 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d426232-cd93-41c3-8d0e-8f8e76c23af9 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:02.249811 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d426232-cd93-41c3-8d0e-8f8e76c23af9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:02.251027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d426232-cd93-41c3-8d0e-8f8e76c23af9 None admin] RBAC: Adding query filter params (role.id=a2021efb2e4e459cbfa73f6987297bca, scope.project.id=7763226124204b95a4f39f7d36e13a32, user.id=b98d1a04efa24341b48291b164f03bc2) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:02.251150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 107/224] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:02.255652 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667192d-893d-4dde-831d-3e4083894c0b None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:02.255652 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667192d-893d-4dde-831d-3e4083894c0b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:02.255652 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667192d-893d-4dde-831d-3e4083894c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:02.256507 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d426232-cd93-41c3-8d0e-8f8e76c23af9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:02.258547 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d426232-cd93-41c3-8d0e-8f8e76c23af9 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:02.267088 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 118/225] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:34:02 2022] GET /identity/v3/role_assignments?user.id=b98d1a04efa24341b48291b164f03bc2&scope.project.id=7763226124204b95a4f39f7d36e13a32&role.id=a2021efb2e4e459cbfa73f6987297bca => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:02.268991 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d426232-cd93-41c3-8d0e-8f8e76c23af9 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:02.274906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-d667192d-893d-4dde-831d-3e4083894c0b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:02.276179 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d667192d-893d-4dde-831d-3e4083894c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:02.356380 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 108/226] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:02.384140 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667192d-893d-4dde-831d-3e4083894c0b None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:02.435435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:02.445510 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d426232-cd93-41c3-8d0e-8f8e76c23af9 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:02.488246 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc203a-f4ad-4b2f-9889-b1d7936edf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:02.489196 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc203a-f4ad-4b2f-9889-b1d7936edf91 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:02.489486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc203a-f4ad-4b2f-9889-b1d7936edf91 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:02.489764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc203a-f4ad-4b2f-9889-b1d7936edf91 None admin] PATH_INFO: `/v3/users/ec2c8c99f94b489c8a6b286690216c54` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:02.492095 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc203a-f4ad-4b2f-9889-b1d7936edf91 None admin] RBAC: Authorizing `identity:get_user(user_id=ec2c8c99f94b489c8a6b286690216c54)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:02.493768 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cc203a-f4ad-4b2f-9889-b1d7936edf91 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:02.496024 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 119/227] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:34:02 2022] GET /identity/v3/users/ec2c8c99f94b489c8a6b286690216c54 => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:02.507332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc203a-f4ad-4b2f-9889-b1d7936edf91 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:02.565804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667192d-893d-4dde-831d-3e4083894c0b None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:02.576453 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:02.620603 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3415dc-130b-456f-bb74-0323466e6848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:02.623483 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3415dc-130b-456f-bb74-0323466e6848 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:02.625175 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3415dc-130b-456f-bb74-0323466e6848 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:02.625657 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3415dc-130b-456f-bb74-0323466e6848 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:02.649329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3415dc-130b-456f-bb74-0323466e6848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:02.660243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-ab3415dc-130b-456f-bb74-0323466e6848 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:34:02.660243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:02.660243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:02.660243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:02.660243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:02.660243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:02.660243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:02.660243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:02.660243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:02.660243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:02.660243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:02.660243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:02.660243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:02.660243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:02.660243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:02.660243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:02.661610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:02.661610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:02.661610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:02.661610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:02.661610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:02.661610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:02.661610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:02.661610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:02.661610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:02.661610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:02.661610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:02.661610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:02.661610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:02.661610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:02.661610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:02.661610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:02.662838 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:02.662838 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:02.662838 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:02.662838 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:02.662838 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:02.662838 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:02.662838 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:02.662838 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:02.662838 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:02.662838 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:02.662838 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:34:02.662838 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:02.663486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 109/228] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jul 19 20:34:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:34:02.673794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3415dc-130b-456f-bb74-0323466e6848 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:02.692894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc203a-f4ad-4b2f-9889-b1d7936edf91 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:02.733117 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a3ab8-e1db-49a0-9c89-822da0306bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:02.734455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a3ab8-e1db-49a0-9c89-822da0306bee None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:02.734967 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a3ab8-e1db-49a0-9c89-822da0306bee None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:02.735473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a3ab8-e1db-49a0-9c89-822da0306bee None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:02.737928 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a3ab8-e1db-49a0-9c89-822da0306bee None admin] RBAC: Authorizing `identity:get_project(project_id=7763226124204b95a4f39f7d36e13a32)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:02.739738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a3ab8-e1db-49a0-9c89-822da0306bee None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:02.741832 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 120/229] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:02 2022] GET /identity/v3/projects/7763226124204b95a4f39f7d36e13a32 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:02.747805 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a3ab8-e1db-49a0-9c89-822da0306bee None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:02.794201 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:02.869250 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3415dc-130b-456f-bb74-0323466e6848 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:02.921609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a3ab8-e1db-49a0-9c89-822da0306bee None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:02.931296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b5398-dd65-4c94-b805-1d44dfdb0c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:02.931296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b5398-dd65-4c94-b805-1d44dfdb0c33 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:02.931296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b5398-dd65-4c94-b805-1d44dfdb0c33 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:02.931296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04b5398-dd65-4c94-b805-1d44dfdb0c33 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:02.931689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b5398-dd65-4c94-b805-1d44dfdb0c33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:02.931689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b5398-dd65-4c94-b805-1d44dfdb0c33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:02.931689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04b5398-dd65-4c94-b805-1d44dfdb0c33 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:02.939386 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 110/230] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:02.946058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b5398-dd65-4c94-b805-1d44dfdb0c33 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:02.995082 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfadb47c-336d-4809-ab24-3ea374d91bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:02.996007 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadb47c-336d-4809-ab24-3ea374d91bf2 None admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:02.996287 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadb47c-336d-4809-ab24-3ea374d91bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:02.996558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadb47c-336d-4809-ab24-3ea374d91bf2 None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32/users/ec2c8c99f94b489c8a6b286690216c54/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:02.999821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfadb47c-336d-4809-ab24-3ea374d91bf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7763226124204b95a4f39f7d36e13a32, user_id=ec2c8c99f94b489c8a6b286690216c54, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:03.001211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfadb47c-336d-4809-ab24-3ea374d91bf2 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:03.008435 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:03.033035 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 121/231] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:34:02 2022] PUT /identity/v3/projects/7763226124204b95a4f39f7d36e13a32/users/ec2c8c99f94b489c8a6b286690216c54/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:34:03.094433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04b5398-dd65-4c94-b805-1d44dfdb0c33 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:03.133736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d702b-3d2f-4bfa-ad47-dd2d6a7b5f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:03.134689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d702b-3d2f-4bfa-ad47-dd2d6a7b5f90 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:03.134978 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d702b-3d2f-4bfa-ad47-dd2d6a7b5f90 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:03.135255 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d702b-3d2f-4bfa-ad47-dd2d6a7b5f90 None admin] PATH_INFO: `/v3/users/ec2c8c99f94b489c8a6b286690216c54` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:03.136558 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d702b-3d2f-4bfa-ad47-dd2d6a7b5f90 None admin] RBAC: Authorizing `identity:get_user(user_id=ec2c8c99f94b489c8a6b286690216c54)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:03.138023 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d702b-3d2f-4bfa-ad47-dd2d6a7b5f90 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:03.140057 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 111/232] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:34:02 2022] GET /identity/v3/users/ec2c8c99f94b489c8a6b286690216c54 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:03.145734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfadb47c-336d-4809-ab24-3ea374d91bf2 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:03.279472 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:03.293992 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfadb47c-336d-4809-ab24-3ea374d91bf2 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:03.329731 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d68856-b514-49e7-8f10-e7470d689cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:03.331130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d68856-b514-49e7-8f10-e7470d689cb8 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:03.331465 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d68856-b514-49e7-8f10-e7470d689cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:03.331738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d68856-b514-49e7-8f10-e7470d689cb8 None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:03.332941 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d68856-b514-49e7-8f10-e7470d689cb8 None admin] RBAC: Authorizing `identity:get_project(project_id=7763226124204b95a4f39f7d36e13a32)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:03.334375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d68856-b514-49e7-8f10-e7470d689cb8 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:03.336415 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 122/233] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:03 2022] GET /identity/v3/projects/7763226124204b95a4f39f7d36e13a32 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:03.342069 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d702b-3d2f-4bfa-ad47-dd2d6a7b5f90 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:03.516371 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:03.521608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d702b-3d2f-4bfa-ad47-dd2d6a7b5f90 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:03.569006 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43befeda-86ec-41b5-b539-ef5008ca4dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:03.569828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43befeda-86ec-41b5-b539-ef5008ca4dc5 None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:03.570117 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43befeda-86ec-41b5-b539-ef5008ca4dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:03.570399 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43befeda-86ec-41b5-b539-ef5008ca4dc5 None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32/users/ec2c8c99f94b489c8a6b286690216c54/roles/92567de587bf40dab488cc1eb666b221` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:03.572733 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43befeda-86ec-41b5-b539-ef5008ca4dc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=7763226124204b95a4f39f7d36e13a32, user_id=ec2c8c99f94b489c8a6b286690216c54, role_id=92567de587bf40dab488cc1eb666b221)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:03.574388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43befeda-86ec-41b5-b539-ef5008ca4dc5 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:03.593196 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 112/234] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:34:03 2022] PUT /identity/v3/projects/7763226124204b95a4f39f7d36e13a32/users/ec2c8c99f94b489c8a6b286690216c54/roles/92567de587bf40dab488cc1eb666b221 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:34:03.948305 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0863beb-419a-4a6f-858b-9b9678045109 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:03.949280 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0863beb-419a-4a6f-858b-9b9678045109 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:03.949752 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0863beb-419a-4a6f-858b-9b9678045109 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:03.951622 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 123/235] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:03.956714 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22476d31-8ad9-44be-a1e4-035a63b57e50 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:03.957569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22476d31-8ad9-44be-a1e4-035a63b57e50 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:03.958044 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22476d31-8ad9-44be-a1e4-035a63b57e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:03.961706 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e808a9d-e818-41b0-b36c-dd44df70e19f None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:03.961987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e808a9d-e818-41b0-b36c-dd44df70e19f None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:03.962263 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e808a9d-e818-41b0-b36c-dd44df70e19f None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:03.963917 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 124/236] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:34:03.980649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-22476d31-8ad9-44be-a1e4-035a63b57e50 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:03.981904 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-22476d31-8ad9-44be-a1e4-035a63b57e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:03.986160 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c614e-aac0-4e7f-a3a9-c9b48534d851 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:03.987309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c614e-aac0-4e7f-a3a9-c9b48534d851 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:03.987804 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c614e-aac0-4e7f-a3a9-c9b48534d851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:04.015348 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-958c614e-aac0-4e7f-a3a9-c9b48534d851 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:04.017585 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-958c614e-aac0-4e7f-a3a9-c9b48534d851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:04.113481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 113/237] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:04.139224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 125/238] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:34:04.155571 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22476d31-8ad9-44be-a1e4-035a63b57e50 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:04.166680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c614e-aac0-4e7f-a3a9-c9b48534d851 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:04.262576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22476d31-8ad9-44be-a1e4-035a63b57e50 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:04.267048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:04.301269 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e83eb-759b-4a3d-8b25-b494712bd28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:04.302347 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e83eb-759b-4a3d-8b25-b494712bd28a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:04.302871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e83eb-759b-4a3d-8b25-b494712bd28a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:04.303332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e83eb-759b-4a3d-8b25-b494712bd28a None admin] PATH_INFO: `/v3/domains/default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:04.304893 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e83eb-759b-4a3d-8b25-b494712bd28a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:04.306514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e83eb-759b-4a3d-8b25-b494712bd28a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:04.308399 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 114/239] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:04.315582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e83eb-759b-4a3d-8b25-b494712bd28a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:04.356913 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:04.383756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c614e-aac0-4e7f-a3a9-c9b48534d851 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:04.440016 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fb094-f80d-4ba2-b004-e15ff8908d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:04.440745 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fb094-f80d-4ba2-b004-e15ff8908d60 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:04.441027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fb094-f80d-4ba2-b004-e15ff8908d60 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:04.441301 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fb094-f80d-4ba2-b004-e15ff8908d60 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:04.453325 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e83eb-759b-4a3d-8b25-b494712bd28a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:04.464764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5fb094-f80d-4ba2-b004-e15ff8908d60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:04.473012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-cf5fb094-f80d-4ba2-b004-e15ff8908d60 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 20:34:04.473012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:04.473012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:04.473012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:04.473012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:04.473012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:04.473012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:04.473012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:04.473012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:04.473012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:04.473012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:04.473012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:04.473012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:04.473012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:04.473012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:04.473012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:04.473916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:04.473916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:04.473916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:04.473916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:04.473916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:04.473916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:04.473916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:04.473916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:04.473916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:04.473916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:04.473916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:04.473916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:04.473916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:04.473916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:04.473916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:04.473916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:04.474743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:04.474743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:04.474743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:04.474743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:04.474743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:04.474743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:04.474743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:04.474743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:04.474743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:04.474743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:04.474743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 20:34:04.474743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:04.474743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 126/240] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:34:04.484230 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fb094-f80d-4ba2-b004-e15ff8908d60 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:04.535582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332679e-407b-48af-9d5f-ab265677d0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:04.537676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332679e-407b-48af-9d5f-ab265677d0b6 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:04.538405 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332679e-407b-48af-9d5f-ab265677d0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:04.539519 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332679e-407b-48af-9d5f-ab265677d0b6 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:04.540571 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332679e-407b-48af-9d5f-ab265677d0b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:04.542306 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332679e-407b-48af-9d5f-ab265677d0b6 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:04.578302 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 115/241] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jul 19 20:34:04 2022] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:34:04.644116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fb094-f80d-4ba2-b004-e15ff8908d60 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:04.693769 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f0db9-0570-44c2-889c-4d943520346b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:04.694692 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f0db9-0570-44c2-889c-4d943520346b None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:04.695126 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f0db9-0570-44c2-889c-4d943520346b None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:04.695569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f0db9-0570-44c2-889c-4d943520346b None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:04.696557 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f0db9-0570-44c2-889c-4d943520346b None admin] RBAC: Adding query filter params (name=reader) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:04.697014 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f0db9-0570-44c2-889c-4d943520346b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:04.698597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f0db9-0570-44c2-889c-4d943520346b None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:04.713334 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 127/242] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:34:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:04.719201 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332679e-407b-48af-9d5f-ab265677d0b6 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:04.738676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:04.839211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332679e-407b-48af-9d5f-ab265677d0b6 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:04.883680 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7e879-8272-46a2-a8f1-01b80c41cd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:04.884592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7e879-8272-46a2-a8f1-01b80c41cd87 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:04.884880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7e879-8272-46a2-a8f1-01b80c41cd87 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:04.885163 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7e879-8272-46a2-a8f1-01b80c41cd87 None admin] PATH_INFO: `/v3/users/db8ffc510ff44cbdb0f6f8eb5ed82138` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:04.903722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7e879-8272-46a2-a8f1-01b80c41cd87 None admin] RBAC: Authorizing `identity:get_user(user_id=db8ffc510ff44cbdb0f6f8eb5ed82138)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:04.903722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7e879-8272-46a2-a8f1-01b80c41cd87 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:04.903992 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 116/243] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:34:04 2022] GET /identity/v3/users/db8ffc510ff44cbdb0f6f8eb5ed82138 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:04.912528 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f0db9-0570-44c2-889c-4d943520346b None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:04.926861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5b67f-946c-4381-95d6-6a07702e3d9f None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:04.927144 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5b67f-946c-4381-95d6-6a07702e3d9f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:04.927468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5b67f-946c-4381-95d6-6a07702e3d9f None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:04.928840 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 117/244] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:34:04.933141 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:04.934984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41482e9-2440-4e5b-8c64-b698aa39ae4b None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:04.935834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41482e9-2440-4e5b-8c64-b698aa39ae4b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:04.936289 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41482e9-2440-4e5b-8c64-b698aa39ae4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:04.955881 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-e41482e9-2440-4e5b-8c64-b698aa39ae4b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:04.957277 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e41482e9-2440-4e5b-8c64-b698aa39ae4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:05.033940 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:05.039226 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 118/245] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:05.047730 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f0db9-0570-44c2-889c-4d943520346b None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:05.062492 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41482e9-2440-4e5b-8c64-b698aa39ae4b None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:05.093712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22671ba6-5395-4208-bbca-a7b9606c8484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:05.094700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22671ba6-5395-4208-bbca-a7b9606c8484 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:05.095192 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22671ba6-5395-4208-bbca-a7b9606c8484 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:05.095825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22671ba6-5395-4208-bbca-a7b9606c8484 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:05.171996 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22671ba6-5395-4208-bbca-a7b9606c8484 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:05.174051 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22671ba6-5395-4208-bbca-a7b9606c8484 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:05.181930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41482e9-2440-4e5b-8c64-b698aa39ae4b None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:05.187897 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:05.222872 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10792d-57cf-416f-a338-f1e459d844ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:05.223951 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10792d-57cf-416f-a338-f1e459d844ee None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:05.224376 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10792d-57cf-416f-a338-f1e459d844ee None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:05.224813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10792d-57cf-416f-a338-f1e459d844ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:05.237314 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10792d-57cf-416f-a338-f1e459d844ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:05.245952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-0a10792d-57cf-416f-a338-f1e459d844ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:05.245952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:05.245952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:05.245952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:05.245952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:05.245952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:05.245952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:05.245952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:05.245952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:05.245952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:05.245952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:05.245952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:05.245952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:05.245952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:05.245952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:05.245952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:05.246828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:05.246828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:05.246828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:05.246828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:05.246828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:05.246828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:05.246828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:05.246828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:05.246828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:05.246828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:05.246828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:05.246828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:05.246828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:05.246828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:05.246828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:05.246828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:05.247727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:05.247727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:05.247727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:05.247727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:05.247727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:05.247727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:05.247727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:05.247727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:05.247727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:05.247727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:05.247727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:05.247727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:05.249893 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 119/246] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:34:05.265700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10792d-57cf-416f-a338-f1e459d844ee None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:05.290159 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 128/247] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:05.295974 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22671ba6-5395-4208-bbca-a7b9606c8484 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:05.332615 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:05.378096 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10792d-57cf-416f-a338-f1e459d844ee None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:05.410831 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22671ba6-5395-4208-bbca-a7b9606c8484 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:05.415158 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6894ba6-628e-4fe6-9cef-26bdb44fd1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:05.416049 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6894ba6-628e-4fe6-9cef-26bdb44fd1c7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:05.416473 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6894ba6-628e-4fe6-9cef-26bdb44fd1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:05.416888 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6894ba6-628e-4fe6-9cef-26bdb44fd1c7 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:05.417786 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6894ba6-628e-4fe6-9cef-26bdb44fd1c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:05.418227 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6894ba6-628e-4fe6-9cef-26bdb44fd1c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:05.419901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6894ba6-628e-4fe6-9cef-26bdb44fd1c7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:05.422519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:05.432556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 120/248] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:34:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:05.438408 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6894ba6-628e-4fe6-9cef-26bdb44fd1c7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:05.450227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca767d7-4ae6-486e-adae-2882acd14651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:05.451102 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca767d7-4ae6-486e-adae-2882acd14651 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:05.451423 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca767d7-4ae6-486e-adae-2882acd14651 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:05.451993 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca767d7-4ae6-486e-adae-2882acd14651 None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:05.453026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca767d7-4ae6-486e-adae-2882acd14651 None admin] RBAC: Authorizing `identity:get_project(project_id=7763226124204b95a4f39f7d36e13a32)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:05.454595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca767d7-4ae6-486e-adae-2882acd14651 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:05.456480 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 129/249] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:05 2022] GET /identity/v3/projects/7763226124204b95a4f39f7d36e13a32 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:05.462562 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca767d7-4ae6-486e-adae-2882acd14651 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:05.551335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6894ba6-628e-4fe6-9cef-26bdb44fd1c7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:05.575924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:05.577336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca767d7-4ae6-486e-adae-2882acd14651 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:05.589561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe958c-f2b0-47ce-818e-d41465452d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:05.590952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe958c-f2b0-47ce-818e-d41465452d68 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:05.591432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe958c-f2b0-47ce-818e-d41465452d68 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:05.591846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe958c-f2b0-47ce-818e-d41465452d68 None admin] PATH_INFO: `/v3/users/b98d1a04efa24341b48291b164f03bc2` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:05.593425 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe958c-f2b0-47ce-818e-d41465452d68 None admin] RBAC: Authorizing `identity:get_user(user_id=b98d1a04efa24341b48291b164f03bc2)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:05.595025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe958c-f2b0-47ce-818e-d41465452d68 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:05.597172 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 121/250] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:34:05 2022] GET /identity/v3/users/b98d1a04efa24341b48291b164f03bc2 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:05.602590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe958c-f2b0-47ce-818e-d41465452d68 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:05.615794 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7260d2-66a9-475f-95a5-b9c7ece8f4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:05.616483 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7260d2-66a9-475f-95a5-b9c7ece8f4f0 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:05.616895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7260d2-66a9-475f-95a5-b9c7ece8f4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:05.617010 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7260d2-66a9-475f-95a5-b9c7ece8f4f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:05.617867 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7260d2-66a9-475f-95a5-b9c7ece8f4f0 None admin] RBAC: Adding query filter params (role.id=61e37a77948648d989c2ba2222b6fe6f, scope.project.id=7763226124204b95a4f39f7d36e13a32, user.id=db8ffc510ff44cbdb0f6f8eb5ed82138) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:05.619035 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7260d2-66a9-475f-95a5-b9c7ece8f4f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:05.619638 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7260d2-66a9-475f-95a5-b9c7ece8f4f0 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:05.625814 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 130/251] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:34:05 2022] GET /identity/v3/role_assignments?user.id=db8ffc510ff44cbdb0f6f8eb5ed82138&scope.project.id=7763226124204b95a4f39f7d36e13a32&role.id=61e37a77948648d989c2ba2222b6fe6f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:05.627123 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e932076-7ad3-4256-a759-a2497c487d63 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:05.631662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e932076-7ad3-4256-a759-a2497c487d63 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:05.631974 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e932076-7ad3-4256-a759-a2497c487d63 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:05.633718 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 131/252] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:05.639086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ceeccf-609b-4eae-8bf0-527609d166ad None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:05.639411 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ceeccf-609b-4eae-8bf0-527609d166ad None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:05.639693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ceeccf-609b-4eae-8bf0-527609d166ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:05.664457 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-a9ceeccf-609b-4eae-8bf0-527609d166ad None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:05.665712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-a9ceeccf-609b-4eae-8bf0-527609d166ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:05.718658 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe958c-f2b0-47ce-818e-d41465452d68 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:05.758126 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c5302-9866-4513-a8bf-a4eca9771b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:05.759350 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c5302-9866-4513-a8bf-a4eca9771b38 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:05.759847 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c5302-9866-4513-a8bf-a4eca9771b38 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:05.760417 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c5302-9866-4513-a8bf-a4eca9771b38 None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:05.761968 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c5302-9866-4513-a8bf-a4eca9771b38 None admin] RBAC: Authorizing `identity:get_project(project_id=7763226124204b95a4f39f7d36e13a32)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:05.763723 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911c5302-9866-4513-a8bf-a4eca9771b38 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:05.766040 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 122/253] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:05 2022] GET /identity/v3/projects/7763226124204b95a4f39f7d36e13a32 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:05.772513 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c5302-9866-4513-a8bf-a4eca9771b38 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:05.804651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:05.842923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:05.862372 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 132/254] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:34:05.898873 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911c5302-9866-4513-a8bf-a4eca9771b38 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:05.946618 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a43b4-5833-498d-8345-45049e5a865c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:05.947561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a43b4-5833-498d-8345-45049e5a865c None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:05.947845 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a43b4-5833-498d-8345-45049e5a865c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:05.948120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a43b4-5833-498d-8345-45049e5a865c None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32/users/b98d1a04efa24341b48291b164f03bc2/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:05.950176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a43b4-5833-498d-8345-45049e5a865c None admin] RBAC: Authorizing `identity:create_grant(project_id=7763226124204b95a4f39f7d36e13a32, user_id=b98d1a04efa24341b48291b164f03bc2, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:05.951667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a43b4-5833-498d-8345-45049e5a865c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:05.958319 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ceeccf-609b-4eae-8bf0-527609d166ad None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:05.971522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 123/255] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:34:05 2022] PUT /identity/v3/projects/7763226124204b95a4f39f7d36e13a32/users/b98d1a04efa24341b48291b164f03bc2/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:34:06.100822 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ceeccf-609b-4eae-8bf0-527609d166ad None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:06.149382 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56af5e5-82a2-43d5-8e10-1dd27b90a438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:06.150200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af5e5-82a2-43d5-8e10-1dd27b90a438 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:06.150485 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af5e5-82a2-43d5-8e10-1dd27b90a438 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:06.150761 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56af5e5-82a2-43d5-8e10-1dd27b90a438 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:06.166520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56af5e5-82a2-43d5-8e10-1dd27b90a438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:06.174922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-b56af5e5-82a2-43d5-8e10-1dd27b90a438 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:34:06.174922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:06.174922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:06.174922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:06.174922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:06.174922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:06.174922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:06.174922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:06.174922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:06.174922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:06.174922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:06.174922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:06.174922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:06.174922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:06.174922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:06.174922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:06.175834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:06.175834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:06.175834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:06.175834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:06.175834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:06.175834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:06.175834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:06.175834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:06.175834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:06.175834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:06.175834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:06.175834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:06.175834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:06.175834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:06.175834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:06.175834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:06.177211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:06.177211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:06.177211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:06.177211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:06.177211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:06.177211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:06.177211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:06.177211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:06.177211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:06.177211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:06.177211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:34:06.177211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:06.177211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 133/256] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:34:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:06.182036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a43b4-5833-498d-8345-45049e5a865c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:06.319664 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a43b4-5833-498d-8345-45049e5a865c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:06.344502 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:06.355983 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae87d6-4911-4640-9323-cc597eca269c None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:06.356609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae87d6-4911-4640-9323-cc597eca269c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:06.357164 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae87d6-4911-4640-9323-cc597eca269c None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:06.358839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 134/257] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:34:06.368490 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a28c11-b7aa-4a49-8895-8d580bf8e76d None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:06.369089 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a28c11-b7aa-4a49-8895-8d580bf8e76d None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:06.369570 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a28c11-b7aa-4a49-8895-8d580bf8e76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:06.388552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab241c9f-9e7c-412c-b3e6-8fa18c856ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:06.389536 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab241c9f-9e7c-412c-b3e6-8fa18c856ef2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:06.389963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab241c9f-9e7c-412c-b3e6-8fa18c856ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:06.390377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab241c9f-9e7c-412c-b3e6-8fa18c856ef2 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:06.391420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab241c9f-9e7c-412c-b3e6-8fa18c856ef2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:06.391909 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab241c9f-9e7c-412c-b3e6-8fa18c856ef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:06.393592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab241c9f-9e7c-412c-b3e6-8fa18c856ef2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:06.403506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 124/258] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:06.410040 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab241c9f-9e7c-412c-b3e6-8fa18c856ef2 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:06.418412 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-e8a28c11-b7aa-4a49-8895-8d580bf8e76d None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:06.421520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e8a28c11-b7aa-4a49-8895-8d580bf8e76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:06.476865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:06.587116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 135/259] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:06.591084 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab241c9f-9e7c-412c-b3e6-8fa18c856ef2 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:06.633987 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42ec8c-c8df-4467-b956-6cc26e2d6b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:06.634789 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42ec8c-c8df-4467-b956-6cc26e2d6b3f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:06.635065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42ec8c-c8df-4467-b956-6cc26e2d6b3f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:06.635356 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42ec8c-c8df-4467-b956-6cc26e2d6b3f None admin] PATH_INFO: `/v3/users/ec2c8c99f94b489c8a6b286690216c54` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:06.637313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a28c11-b7aa-4a49-8895-8d580bf8e76d None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:06.640619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42ec8c-c8df-4467-b956-6cc26e2d6b3f None admin] RBAC: Authorizing `identity:get_user(user_id=ec2c8c99f94b489c8a6b286690216c54)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:06.646503 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42ec8c-c8df-4467-b956-6cc26e2d6b3f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:06.656529 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 125/260] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:34:06 2022] GET /identity/v3/users/ec2c8c99f94b489c8a6b286690216c54 => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:06.657648 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42ec8c-c8df-4467-b956-6cc26e2d6b3f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:06.779516 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:06.871039 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a28c11-b7aa-4a49-8895-8d580bf8e76d None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:06.917400 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42ec8c-c8df-4467-b956-6cc26e2d6b3f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:06.942852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bfe12-650e-4f1f-9df8-7b8496b07dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:06.943720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bfe12-650e-4f1f-9df8-7b8496b07dde None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:06.944004 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bfe12-650e-4f1f-9df8-7b8496b07dde None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:06.944283 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bfe12-650e-4f1f-9df8-7b8496b07dde None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:06.966220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bfe12-650e-4f1f-9df8-7b8496b07dde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:06.976094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-a75bfe12-650e-4f1f-9df8-7b8496b07dde None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:34:06.976094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:06.976094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:06.976094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:06.976094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:06.976094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:06.976094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:06.976094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:06.976094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:06.976094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:06.976094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:06.976094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:06.976094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:06.976094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:06.976094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:06.976094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:06.977059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:06.977059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:06.977059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:06.977059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:06.977059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:06.977059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:06.977059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:06.977059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:06.977059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:06.977059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:06.977059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:06.977059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:06.977059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:06.977059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:06.977059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:06.977059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:06.977857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:06.977857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:06.977857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:06.977857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:06.977857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:06.977857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:06.977857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:06.977857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:06.977857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:06.977857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:06.977857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:34:06.977857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:06.980374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 136/261] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jul 19 20:34:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:34:06.986371 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bfe12-650e-4f1f-9df8-7b8496b07dde None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:06.996529 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417f074-ee4d-44ff-9202-ef05526a20db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:06.997429 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417f074-ee4d-44ff-9202-ef05526a20db None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:06.997928 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417f074-ee4d-44ff-9202-ef05526a20db None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:06.998419 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417f074-ee4d-44ff-9202-ef05526a20db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:07.015336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:07.109115 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bfe12-650e-4f1f-9df8-7b8496b07dde None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:07.135105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417f074-ee4d-44ff-9202-ef05526a20db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:07.136820 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417f074-ee4d-44ff-9202-ef05526a20db None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:07.151575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3a175-54ad-4772-aded-60c712e3f855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:07.152546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3a175-54ad-4772-aded-60c712e3f855 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:07.153314 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3a175-54ad-4772-aded-60c712e3f855 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:07.154475 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3a175-54ad-4772-aded-60c712e3f855 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:07.155774 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3a175-54ad-4772-aded-60c712e3f855 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:07.156218 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3a175-54ad-4772-aded-60c712e3f855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:07.158021 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3a175-54ad-4772-aded-60c712e3f855 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:07.169644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 137/262] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:07.176064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3a175-54ad-4772-aded-60c712e3f855 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:07.248955 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:07.293931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3a175-54ad-4772-aded-60c712e3f855 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:07.331161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af9ed8-78e5-4989-8e9d-26a73cfcead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:07.333111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af9ed8-78e5-4989-8e9d-26a73cfcead1 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:07.333713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af9ed8-78e5-4989-8e9d-26a73cfcead1 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:07.334207 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af9ed8-78e5-4989-8e9d-26a73cfcead1 None admin] PATH_INFO: `/v3/users/ec2c8c99f94b489c8a6b286690216c54` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:07.335465 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:07.338011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 126/263] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:07.342431 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af9ed8-78e5-4989-8e9d-26a73cfcead1 None admin] RBAC: Authorizing `identity:get_user(user_id=ec2c8c99f94b489c8a6b286690216c54)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:07.343761 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417f074-ee4d-44ff-9202-ef05526a20db None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:07.344836 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af9ed8-78e5-4989-8e9d-26a73cfcead1 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:07.346955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 138/264] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:34:07 2022] GET /identity/v3/users/ec2c8c99f94b489c8a6b286690216c54 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:07.352724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af9ed8-78e5-4989-8e9d-26a73cfcead1 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:07.463375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af9ed8-78e5-4989-8e9d-26a73cfcead1 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:07.516818 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417f074-ee4d-44ff-9202-ef05526a20db None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:07.548960 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec5b19-5d72-4211-9f2c-c68734bdab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:07.549796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec5b19-5d72-4211-9f2c-c68734bdab3d None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:07.550086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec5b19-5d72-4211-9f2c-c68734bdab3d None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:07.550370 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec5b19-5d72-4211-9f2c-c68734bdab3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:07.558318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7934d-fe4f-4469-b0f6-431dbc9de52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:07.559535 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7934d-fe4f-4469-b0f6-431dbc9de52c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:07.560034 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7934d-fe4f-4469-b0f6-431dbc9de52c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:07.560530 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7934d-fe4f-4469-b0f6-431dbc9de52c None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:07.561976 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7934d-fe4f-4469-b0f6-431dbc9de52c None admin] RBAC: Authorizing `identity:get_project(project_id=7763226124204b95a4f39f7d36e13a32)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:07.563687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7934d-fe4f-4469-b0f6-431dbc9de52c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:07.567181 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 127/265] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:07 2022] GET /identity/v3/projects/7763226124204b95a4f39f7d36e13a32 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:07.572900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7934d-fe4f-4469-b0f6-431dbc9de52c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:07.599627 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:07.600563 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:07.653668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec5b19-5d72-4211-9f2c-c68734bdab3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:07.655381 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec5b19-5d72-4211-9f2c-c68734bdab3d None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:07.696002 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7934d-fe4f-4469-b0f6-431dbc9de52c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:07.732334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72c0a2-570f-4121-b4f2-bb0aa4f3a0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:07.732921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72c0a2-570f-4121-b4f2-bb0aa4f3a0e7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:07.733207 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72c0a2-570f-4121-b4f2-bb0aa4f3a0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:07.733488 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72c0a2-570f-4121-b4f2-bb0aa4f3a0e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:07.734336 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72c0a2-570f-4121-b4f2-bb0aa4f3a0e7 None admin] RBAC: Adding query filter params (role.id=b30f01ef95004a1b84fc029830bdf053, scope.project.id=7763226124204b95a4f39f7d36e13a32, user.id=ec2c8c99f94b489c8a6b286690216c54) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:07.734648 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72c0a2-570f-4121-b4f2-bb0aa4f3a0e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:07.736132 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72c0a2-570f-4121-b4f2-bb0aa4f3a0e7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:07.743836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 128/266] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:34:07 2022] GET /identity/v3/role_assignments?user.id=ec2c8c99f94b489c8a6b286690216c54&scope.project.id=7763226124204b95a4f39f7d36e13a32&role.id=b30f01ef95004a1b84fc029830bdf053 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:07.775447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 139/267] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:07.777324 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72c0a2-570f-4121-b4f2-bb0aa4f3a0e7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:07.894216 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:07.923799 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72c0a2-570f-4121-b4f2-bb0aa4f3a0e7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:07.975356 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34981c37-1977-4601-a8da-0a0db8a5891c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:07.976236 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34981c37-1977-4601-a8da-0a0db8a5891c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:07.976522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34981c37-1977-4601-a8da-0a0db8a5891c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:07.976800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34981c37-1977-4601-a8da-0a0db8a5891c None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:07.978019 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34981c37-1977-4601-a8da-0a0db8a5891c None admin] RBAC: Authorizing `identity:get_project(project_id=7763226124204b95a4f39f7d36e13a32)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:07.979601 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34981c37-1977-4601-a8da-0a0db8a5891c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:07.981624 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 129/268] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:07 2022] GET /identity/v3/projects/7763226124204b95a4f39f7d36e13a32 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:07.988225 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec5b19-5d72-4211-9f2c-c68734bdab3d None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:08.046831 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:08.096679 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec5b19-5d72-4211-9f2c-c68734bdab3d None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:08.134856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bbb7d-efd4-4eb6-9174-283aaa5fd5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:08.135536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bbb7d-efd4-4eb6-9174-283aaa5fd5d8 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:08.135827 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bbb7d-efd4-4eb6-9174-283aaa5fd5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:08.136107 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bbb7d-efd4-4eb6-9174-283aaa5fd5d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:08.137015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bbb7d-efd4-4eb6-9174-283aaa5fd5d8 None admin] RBAC: Adding query filter params (role.id=92567de587bf40dab488cc1eb666b221, scope.project.id=7763226124204b95a4f39f7d36e13a32, user.id=ec2c8c99f94b489c8a6b286690216c54) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:08.137330 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bbb7d-efd4-4eb6-9174-283aaa5fd5d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:08.138827 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bbb7d-efd4-4eb6-9174-283aaa5fd5d8 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:08.150613 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 140/269] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:34:07 2022] GET /identity/v3/role_assignments?user.id=ec2c8c99f94b489c8a6b286690216c54&scope.project.id=7763226124204b95a4f39f7d36e13a32&role.id=92567de587bf40dab488cc1eb666b221 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:08.370470 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79351f1b-366d-4e32-93a0-1a88ed3a251c None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:08.370949 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79351f1b-366d-4e32-93a0-1a88ed3a251c None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:08.370949 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79351f1b-366d-4e32-93a0-1a88ed3a251c None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:08.372551 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 130/270] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:08.380940 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72d8d0-e5c2-4fb3-b755-4681f7264804 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:08.381273 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72d8d0-e5c2-4fb3-b755-4681f7264804 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:08.381580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72d8d0-e5c2-4fb3-b755-4681f7264804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:08.400083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-0d72d8d0-e5c2-4fb3-b755-4681f7264804 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:08.401358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-0d72d8d0-e5c2-4fb3-b755-4681f7264804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:08.485182 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 141/271] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:08.519693 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79351f1b-366d-4e32-93a0-1a88ed3a251c None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:08.656658 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79351f1b-366d-4e32-93a0-1a88ed3a251c None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:08.659247 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08943d2-2768-4a3b-aaa2-76a6a931123b None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:08.659585 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08943d2-2768-4a3b-aaa2-76a6a931123b None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:08.659867 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08943d2-2768-4a3b-aaa2-76a6a931123b None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:08.661288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 142/272] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:08.667486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce30fb-e98f-4daf-9c78-9534f3399684 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:08.667776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce30fb-e98f-4daf-9c78-9534f3399684 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:08.668063 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce30fb-e98f-4daf-9c78-9534f3399684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:08.690996 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-09ce30fb-e98f-4daf-9c78-9534f3399684 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:08.692983 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-09ce30fb-e98f-4daf-9c78-9534f3399684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:08.699291 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59f930-e842-44bb-9760-26d847e308d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:08.700106 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59f930-e842-44bb-9760-26d847e308d6 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:08.700394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59f930-e842-44bb-9760-26d847e308d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:08.700673 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59f930-e842-44bb-9760-26d847e308d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:08.712768 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59f930-e842-44bb-9760-26d847e308d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:08.721361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-1e59f930-e842-44bb-9760-26d847e308d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:08.721361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:08.721361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:08.721361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:08.721361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:08.721361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:08.721361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:08.721361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:08.721361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:08.721361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:08.721361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:08.721361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:08.721361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:08.721361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:08.721361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:08.721361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:08.722274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:08.722274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:08.722274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:08.722274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:08.722274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:08.722274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:08.722274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:08.722274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:08.722274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:08.722274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:08.722274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:08.722274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:08.722274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:08.722274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:08.722274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:08.722274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:08.723078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:08.723078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:08.723078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:08.723078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:08.723078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:08.723078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:08.723078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:08.723078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:08.723078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:08.723078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:08.723078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:08.723078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:08.723078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 131/273] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:08.729188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59f930-e842-44bb-9760-26d847e308d6 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:08.742788 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:08.747424 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:08.770908 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 143/274] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:34:08.795880 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce30fb-e98f-4daf-9c78-9534f3399684 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:08.850936 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59f930-e842-44bb-9760-26d847e308d6 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:08.890328 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92cd02-abbe-471d-9a07-1a3902a39720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:08.891004 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92cd02-abbe-471d-9a07-1a3902a39720 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:08.891775 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92cd02-abbe-471d-9a07-1a3902a39720 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:08.892061 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92cd02-abbe-471d-9a07-1a3902a39720 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:08.892823 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92cd02-abbe-471d-9a07-1a3902a39720 None admin] RBAC: Adding query filter params (name=member) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:08.893164 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92cd02-abbe-471d-9a07-1a3902a39720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:08.894577 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de92cd02-abbe-471d-9a07-1a3902a39720 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:08.903670 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 132/275] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:34:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:08.906454 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce30fb-e98f-4daf-9c78-9534f3399684 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:08.910675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c36df-92ac-40c0-ba4e-e4beac808ffc None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:08.910910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c36df-92ac-40c0-ba4e-e4beac808ffc None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:08.911183 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c36df-92ac-40c0-ba4e-e4beac808ffc None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:08.912691 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 133/276] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:08.916126 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c36df-92ac-40c0-ba4e-e4beac808ffc None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:08.946194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3833712-00f6-46b3-9a1c-dd388ad7c42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:08.947358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3833712-00f6-46b3-9a1c-dd388ad7c42e None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:08.947685 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3833712-00f6-46b3-9a1c-dd388ad7c42e None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:08.948009 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3833712-00f6-46b3-9a1c-dd388ad7c42e None admin] PATH_INFO: `/v3/domains/default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:08.949304 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3833712-00f6-46b3-9a1c-dd388ad7c42e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:08.950986 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3833712-00f6-46b3-9a1c-dd388ad7c42e None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:08.952650 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 144/277] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:08.953953 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79b289-a5bd-4418-87f0-93b4ca985dc4 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:08.954248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79b289-a5bd-4418-87f0-93b4ca985dc4 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:08.954527 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79b289-a5bd-4418-87f0-93b4ca985dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:08.976150 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-3a79b289-a5bd-4418-87f0-93b4ca985dc4 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:08.977354 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-3a79b289-a5bd-4418-87f0-93b4ca985dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:08.998610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:09.019214 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:09.037018 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c36df-92ac-40c0-ba4e-e4beac808ffc None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:09.047959 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 145/278] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:09.048728 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79b289-a5bd-4418-87f0-93b4ca985dc4 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:09.076183 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d0c17-3cc1-4e38-a894-8bae617a0150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:09.077062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d0c17-3cc1-4e38-a894-8bae617a0150 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:09.077350 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d0c17-3cc1-4e38-a894-8bae617a0150 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:09.077629 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d0c17-3cc1-4e38-a894-8bae617a0150 None admin] PATH_INFO: `/v3/users/b3243dcc929249a89ef80163e461a0a7` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:09.091063 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d0c17-3cc1-4e38-a894-8bae617a0150 None admin] RBAC: Authorizing `identity:get_user(user_id=b3243dcc929249a89ef80163e461a0a7)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:09.092554 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d0c17-3cc1-4e38-a894-8bae617a0150 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:09.094395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 134/279] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:34:08 2022] GET /identity/v3/users/b3243dcc929249a89ef80163e461a0a7 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:09.095611 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5da3f-9a02-43af-81a6-e4045461f115 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:09.095897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5da3f-9a02-43af-81a6-e4045461f115 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:09.096663 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5da3f-9a02-43af-81a6-e4045461f115 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:09.097902 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 135/280] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:09.102133 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5da3f-9a02-43af-81a6-e4045461f115 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:09.166079 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79b289-a5bd-4418-87f0-93b4ca985dc4 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:09.198790 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e28818-359e-4b99-80db-e62c914b537c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:09.199492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e28818-359e-4b99-80db-e62c914b537c None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:09.199778 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e28818-359e-4b99-80db-e62c914b537c None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:09.200057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e28818-359e-4b99-80db-e62c914b537c None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:09.200769 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e28818-359e-4b99-80db-e62c914b537c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:09.202010 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5da3f-9a02-43af-81a6-e4045461f115 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:09.202226 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e28818-359e-4b99-80db-e62c914b537c None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:09.223649 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 146/281] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jul 19 20:34:09 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:34:09.233624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e28818-359e-4b99-80db-e62c914b537c None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:09.242214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:09.252080 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff75a2e-c0b7-4c04-98d5-37d11f9aebd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:09.252940 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff75a2e-c0b7-4c04-98d5-37d11f9aebd3 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:09.253509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff75a2e-c0b7-4c04-98d5-37d11f9aebd3 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:09.253789 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff75a2e-c0b7-4c04-98d5-37d11f9aebd3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:09.259592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:09.266085 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff75a2e-c0b7-4c04-98d5-37d11f9aebd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:09.275229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-0ff75a2e-c0b7-4c04-98d5-37d11f9aebd3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 20:34:09.275229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:09.275229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:09.275229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:09.275229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:09.275229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:09.275229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:09.275229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:09.275229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:09.275229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:09.275229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:09.275229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:09.275229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:09.275229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:09.275229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:09.275229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:09.276235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:09.276235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:09.276235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:09.276235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:09.276235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:09.276235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:09.276235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:09.276235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:09.276235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:09.276235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:09.276235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:09.276235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:09.276235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:09.276235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:09.276235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:09.276235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:09.277068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:09.277068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:09.277068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:09.277068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:09.277068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:09.277068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:09.277068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:09.277068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:09.277068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:09.277068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:09.277068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 20:34:09.277068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:09.277068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 136/282] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:09.278269 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc6d4e-9a79-48f7-bf48-905d378b9901 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:09.278269 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc6d4e-9a79-48f7-bf48-905d378b9901 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:09.278433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc6d4e-9a79-48f7-bf48-905d378b9901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:09.297565 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-cfbc6d4e-9a79-48f7-bf48-905d378b9901 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:09.298801 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-cfbc6d4e-9a79-48f7-bf48-905d378b9901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:09.351152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e28818-359e-4b99-80db-e62c914b537c None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:09.379309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 137/283] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:09.379309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc6d4e-9a79-48f7-bf48-905d378b9901 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:09.395953 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d0d5f-4cb8-4d57-9013-938b53009eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:09.396769 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d0d5f-4cb8-4d57-9013-938b53009eda None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:09.397059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d0d5f-4cb8-4d57-9013-938b53009eda None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:09.397341 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d0d5f-4cb8-4d57-9013-938b53009eda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:09.398338 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d0d5f-4cb8-4d57-9013-938b53009eda None admin] RBAC: Adding query filter params (role.id=a2021efb2e4e459cbfa73f6987297bca, user.id=b3243dcc929249a89ef80163e461a0a7, scope.system=all) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:09.399227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d0d5f-4cb8-4d57-9013-938b53009eda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:09.400158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d0d5f-4cb8-4d57-9013-938b53009eda None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:09.405961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 147/284] 10.222.0.77 () {56 vars in 1308 bytes} [Tue Jul 19 20:34:09 2022] GET /identity/v3/role_assignments?user.id=b3243dcc929249a89ef80163e461a0a7&scope.system=all&role.id=a2021efb2e4e459cbfa73f6987297bca => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:09.406851 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d0d5f-4cb8-4d57-9013-938b53009eda None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:09.529789 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc6d4e-9a79-48f7-bf48-905d378b9901 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:09.560698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:09.565559 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:09.574653 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d0d5f-4cb8-4d57-9013-938b53009eda None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:09.586467 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60edd7-2a08-4d36-9c4a-55015b8793f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:09.587156 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60edd7-2a08-4d36-9c4a-55015b8793f2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:09.587534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60edd7-2a08-4d36-9c4a-55015b8793f2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:09.587816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60edd7-2a08-4d36-9c4a-55015b8793f2 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:09.588678 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60edd7-2a08-4d36-9c4a-55015b8793f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:09.588884 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60edd7-2a08-4d36-9c4a-55015b8793f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:09.590269 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60edd7-2a08-4d36-9c4a-55015b8793f2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:09.599635 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 138/285] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:34:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:09.605608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60edd7-2a08-4d36-9c4a-55015b8793f2 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:09.622743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f857b2-f0a4-4b71-a784-ae737a96986a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:09.624023 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f857b2-f0a4-4b71-a784-ae737a96986a None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:09.624322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f857b2-f0a4-4b71-a784-ae737a96986a None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:09.625623 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f857b2-f0a4-4b71-a784-ae737a96986a None admin] PATH_INFO: `/v3/roles/member` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:09.637484 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f857b2-f0a4-4b71-a784-ae737a96986a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:09.645566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-78f857b2-f0a4-4b71-a784-ae737a96986a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:09.645566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:09.645566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:09.645566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:09.645566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:09.645566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:09.645566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:09.645566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:09.645566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:09.645566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:09.645566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:09.645566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:09.645566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:09.645566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:09.645566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:09.645566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:09.646460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:09.646460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:09.646460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:09.646460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:09.646460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:09.646460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:09.646460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:09.646460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:09.646460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:09.646460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:09.646460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:09.646460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:09.646460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:09.646460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:09.646460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:09.646460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:09.647252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:09.647252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:09.647252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:09.647252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:09.647252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:09.647252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:09.647252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:09.647252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:09.647252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:09.647252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:09.647252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:09.647252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:09.647252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 148/286] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:09.653343 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f857b2-f0a4-4b71-a784-ae737a96986a None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:09.721796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60edd7-2a08-4d36-9c4a-55015b8793f2 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:09.785781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961196f9-2c0e-4925-893b-44a357474b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:09.786601 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961196f9-2c0e-4925-893b-44a357474b57 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:09.786884 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961196f9-2c0e-4925-893b-44a357474b57 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:09.787161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961196f9-2c0e-4925-893b-44a357474b57 None admin] PATH_INFO: `/v3/users/db8ffc510ff44cbdb0f6f8eb5ed82138` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:09.788629 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961196f9-2c0e-4925-893b-44a357474b57 None admin] RBAC: Authorizing `identity:get_user(user_id=db8ffc510ff44cbdb0f6f8eb5ed82138)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:09.790112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961196f9-2c0e-4925-893b-44a357474b57 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:09.794602 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 139/287] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:34:09 2022] GET /identity/v3/users/db8ffc510ff44cbdb0f6f8eb5ed82138 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:09.800686 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961196f9-2c0e-4925-893b-44a357474b57 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:09.834374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f857b2-f0a4-4b71-a784-ae737a96986a None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:09.883319 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:09.925049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c29d3-1b43-4597-916a-1155185ac988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:09.925741 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c29d3-1b43-4597-916a-1155185ac988 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:09.926031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c29d3-1b43-4597-916a-1155185ac988 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:09.926316 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c29d3-1b43-4597-916a-1155185ac988 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:09.927083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c29d3-1b43-4597-916a-1155185ac988 None admin] RBAC: Adding query filter params (name=member) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:09.927423 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c29d3-1b43-4597-916a-1155185ac988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:09.928834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c29d3-1b43-4597-916a-1155185ac988 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:09.941588 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961196f9-2c0e-4925-893b-44a357474b57 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:09.947573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 149/288] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:34:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:09.953244 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c29d3-1b43-4597-916a-1155185ac988 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:09.987997 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76da210-2c8a-4113-ab70-34e93f5951ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:09.988879 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76da210-2c8a-4113-ab70-34e93f5951ed None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:09.989165 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76da210-2c8a-4113-ab70-34e93f5951ed None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:09.989446 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76da210-2c8a-4113-ab70-34e93f5951ed None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:09.990689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76da210-2c8a-4113-ab70-34e93f5951ed None admin] RBAC: Authorizing `identity:get_project(project_id=7763226124204b95a4f39f7d36e13a32)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:09.992166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76da210-2c8a-4113-ab70-34e93f5951ed None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:09.994053 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 140/289] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:09 2022] GET /identity/v3/projects/7763226124204b95a4f39f7d36e13a32 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:09.995644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:10.004227 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76da210-2c8a-4113-ab70-34e93f5951ed None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:10.069370 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c29d3-1b43-4597-916a-1155185ac988 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:10.108499 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d3d82-fdba-4782-b925-c37902ca5978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:10.109440 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d3d82-fdba-4782-b925-c37902ca5978 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:10.109732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d3d82-fdba-4782-b925-c37902ca5978 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:10.110011 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d3d82-fdba-4782-b925-c37902ca5978 None admin] PATH_INFO: `/v3/users/b98d1a04efa24341b48291b164f03bc2` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:10.111379 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d3d82-fdba-4782-b925-c37902ca5978 None admin] RBAC: Authorizing `identity:get_user(user_id=b98d1a04efa24341b48291b164f03bc2)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:10.113488 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d3d82-fdba-4782-b925-c37902ca5978 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:10.120549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 150/290] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:34:09 2022] GET /identity/v3/users/b98d1a04efa24341b48291b164f03bc2 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:10.126987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d3d82-fdba-4782-b925-c37902ca5978 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:10.169504 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76da210-2c8a-4113-ab70-34e93f5951ed None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:10.200564 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:10.234679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496bccea-09df-4be8-a67a-c05cc3c3f1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:10.236033 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bccea-09df-4be8-a67a-c05cc3c3f1f7 None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:10.237966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bccea-09df-4be8-a67a-c05cc3c3f1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:10.238722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496bccea-09df-4be8-a67a-c05cc3c3f1f7 None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32/users/db8ffc510ff44cbdb0f6f8eb5ed82138/roles/61e37a77948648d989c2ba2222b6fe6f` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:10.241935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496bccea-09df-4be8-a67a-c05cc3c3f1f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7763226124204b95a4f39f7d36e13a32, user_id=db8ffc510ff44cbdb0f6f8eb5ed82138, role_id=61e37a77948648d989c2ba2222b6fe6f)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:10.243805 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496bccea-09df-4be8-a67a-c05cc3c3f1f7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:10.268952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 141/291] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:34:10 2022] PUT /identity/v3/projects/7763226124204b95a4f39f7d36e13a32/users/db8ffc510ff44cbdb0f6f8eb5ed82138/roles/61e37a77948648d989c2ba2222b6fe6f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:34:10.287672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:10.308727 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d3d82-fdba-4782-b925-c37902ca5978 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:10.368817 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da380aa1-f81c-4ca8-b7c7-e1f64861cfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:10.369826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da380aa1-f81c-4ca8-b7c7-e1f64861cfc2 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:10.370311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da380aa1-f81c-4ca8-b7c7-e1f64861cfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:10.370786 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da380aa1-f81c-4ca8-b7c7-e1f64861cfc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:10.459921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da380aa1-f81c-4ca8-b7c7-e1f64861cfc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:10.461735 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da380aa1-f81c-4ca8-b7c7-e1f64861cfc2 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:10.553871 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:10.572856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 151/292] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:10.578391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496bccea-09df-4be8-a67a-c05cc3c3f1f7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:10.682233 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496bccea-09df-4be8-a67a-c05cc3c3f1f7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:10.717395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b3cbd-dd61-4098-bf57-9085e70dab8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:10.718605 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b3cbd-dd61-4098-bf57-9085e70dab8d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:10.719087 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b3cbd-dd61-4098-bf57-9085e70dab8d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:10.719713 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b3cbd-dd61-4098-bf57-9085e70dab8d None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:10.721686 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b3cbd-dd61-4098-bf57-9085e70dab8d None admin] RBAC: Authorizing `identity:get_project(project_id=7763226124204b95a4f39f7d36e13a32)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:10.723393 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b3cbd-dd61-4098-bf57-9085e70dab8d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:10.725370 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 142/293] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:10 2022] GET /identity/v3/projects/7763226124204b95a4f39f7d36e13a32 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:10.731314 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da380aa1-f81c-4ca8-b7c7-e1f64861cfc2 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:10.844825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da380aa1-f81c-4ca8-b7c7-e1f64861cfc2 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:10.891310 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c55f9c-32a0-4884-9ce1-a99caaf64d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:10.891310 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c55f9c-32a0-4884-9ce1-a99caaf64d8e None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:10.891310 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c55f9c-32a0-4884-9ce1-a99caaf64d8e None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:10.891310 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c55f9c-32a0-4884-9ce1-a99caaf64d8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:10.891628 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c55f9c-32a0-4884-9ce1-a99caaf64d8e None admin] RBAC: Adding query filter params (role.id=a2021efb2e4e459cbfa73f6987297bca, scope.project.id=7763226124204b95a4f39f7d36e13a32, user.id=b98d1a04efa24341b48291b164f03bc2) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:10.891628 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c55f9c-32a0-4884-9ce1-a99caaf64d8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:10.891915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c55f9c-32a0-4884-9ce1-a99caaf64d8e None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:10.903384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 152/294] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:34:10 2022] GET /identity/v3/role_assignments?user.id=b98d1a04efa24341b48291b164f03bc2&scope.project.id=7763226124204b95a4f39f7d36e13a32&role.id=a2021efb2e4e459cbfa73f6987297bca => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:11.885178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60fe7b-ed37-4024-8e59-1e8ddb071f87 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:11.885178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60fe7b-ed37-4024-8e59-1e8ddb071f87 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:11.885178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60fe7b-ed37-4024-8e59-1e8ddb071f87 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:11.886272 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 143/295] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:11.891613 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0f145-bbd1-49e4-9c47-b698b65c3971 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:11.892007 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0f145-bbd1-49e4-9c47-b698b65c3971 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:11.892198 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0f145-bbd1-49e4-9c47-b698b65c3971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:11.912334 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-b5f0f145-bbd1-49e4-9c47-b698b65c3971 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:11.913535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b5f0f145-bbd1-49e4-9c47-b698b65c3971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:11.933496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74ce99-91aa-493c-aded-f6dcd4f9d1f2 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:11.933496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74ce99-91aa-493c-aded-f6dcd4f9d1f2 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:11.933496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74ce99-91aa-493c-aded-f6dcd4f9d1f2 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:11.934554 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 144/296] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:34:11.939680 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d583b-bb77-41f9-9e74-c582b235fc29 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:11.940501 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d583b-bb77-41f9-9e74-c582b235fc29 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:11.940848 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d583b-bb77-41f9-9e74-c582b235fc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:11.958264 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-840d583b-bb77-41f9-9e74-c582b235fc29 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:11.959519 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-840d583b-bb77-41f9-9e74-c582b235fc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:11.968904 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:11.997692 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 153/297] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:11.999036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b89ba-3c4b-4077-9cc7-6df9e8050bbe None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:12.001778 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b89ba-3c4b-4077-9cc7-6df9e8050bbe None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:12.002176 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b89ba-3c4b-4077-9cc7-6df9e8050bbe None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:12.004522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 154/298] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:12.010124 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce043e-0246-4cde-91f5-e3e5a4b4f218 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:12.010414 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce043e-0246-4cde-91f5-e3e5a4b4f218 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:12.010724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce043e-0246-4cde-91f5-e3e5a4b4f218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:12.011684 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:12.034209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-8cce043e-0246-4cde-91f5-e3e5a4b4f218 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:12.035444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-8cce043e-0246-4cde-91f5-e3e5a4b4f218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:12.043251 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 145/299] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:12.043953 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d583b-bb77-41f9-9e74-c582b235fc29 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:12.113185 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 155/300] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:34:12.119506 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce043e-0246-4cde-91f5-e3e5a4b4f218 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:12.167128 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d583b-bb77-41f9-9e74-c582b235fc29 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:12.202061 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd14055-099a-456b-9927-fd2af593195e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:12.202863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd14055-099a-456b-9927-fd2af593195e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:12.203148 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd14055-099a-456b-9927-fd2af593195e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:12.203452 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd14055-099a-456b-9927-fd2af593195e None admin] PATH_INFO: `/v3/domains/default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:12.204631 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd14055-099a-456b-9927-fd2af593195e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:12.206678 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd14055-099a-456b-9927-fd2af593195e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:12.208367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 146/301] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:12.208367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd14055-099a-456b-9927-fd2af593195e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:12.233527 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce043e-0246-4cde-91f5-e3e5a4b4f218 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:12.245024 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:12.258141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:12.273607 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa07370-caf7-4b98-99b0-814b6a0b9878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:12.274406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa07370-caf7-4b98-99b0-814b6a0b9878 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:12.274692 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa07370-caf7-4b98-99b0-814b6a0b9878 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:12.274970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa07370-caf7-4b98-99b0-814b6a0b9878 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:12.285614 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa07370-caf7-4b98-99b0-814b6a0b9878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:12.293839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-7aa07370-caf7-4b98-99b0-814b6a0b9878 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:12.293839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:12.293839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:12.293839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:12.293839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:12.293839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:12.293839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:12.293839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:12.293839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:12.293839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:12.293839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:12.293839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:12.293839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:12.293839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:12.293839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:12.293839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:12.294756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:12.294756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:12.294756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:12.294756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:12.294756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:12.294756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:12.294756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:12.294756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:12.294756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:12.294756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:12.294756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:12.294756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:12.294756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:12.294756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:12.294756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:12.294756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:12.295997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:12.295997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:12.295997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:12.295997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:12.295997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:12.295997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:12.295997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:12.295997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:12.295997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:12.295997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:12.295997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:12.295997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:12.295997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 156/302] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:12.295997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa07370-caf7-4b98-99b0-814b6a0b9878 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:12.322777 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd14055-099a-456b-9927-fd2af593195e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:12.363078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde2fda-a902-4d6b-adf7-b7b24a04cbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:12.364162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde2fda-a902-4d6b-adf7-b7b24a04cbf1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:12.364445 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde2fda-a902-4d6b-adf7-b7b24a04cbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:12.364725 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde2fda-a902-4d6b-adf7-b7b24a04cbf1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:12.375962 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde2fda-a902-4d6b-adf7-b7b24a04cbf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:12.385614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-5dde2fda-a902-4d6b-adf7-b7b24a04cbf1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 20:34:12.385614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:12.385614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:12.385614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:12.385614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:12.385614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:12.385614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:12.385614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:12.385614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:12.385614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:12.385614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:12.385614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:12.385614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:12.385614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:12.385614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:12.385614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:12.386534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:12.386534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:12.386534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:12.386534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:12.386534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:12.386534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:12.386534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:12.386534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:12.386534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:12.386534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:12.386534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:12.386534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:12.386534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:12.386534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:12.386534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:12.386534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:12.387367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:12.387367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:12.387367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:12.387367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:12.387367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:12.387367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:12.387367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:12.387367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:12.387367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:12.387367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:12.387367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 20:34:12.387367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:12.387367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 147/303] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:12.394176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde2fda-a902-4d6b-adf7-b7b24a04cbf1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:12.407181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa07370-caf7-4b98-99b0-814b6a0b9878 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:12.445808 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bda10-5c1d-4000-927d-30e735841f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:12.446860 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bda10-5c1d-4000-927d-30e735841f27 None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:12.447170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bda10-5c1d-4000-927d-30e735841f27 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:12.447468 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bda10-5c1d-4000-927d-30e735841f27 None admin] PATH_INFO: `/v3/groups` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:12.448165 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bda10-5c1d-4000-927d-30e735841f27 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:12.450309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bda10-5c1d-4000-927d-30e735841f27 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:12.475291 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 157/304] 10.222.0.77 () {60 vars in 1134 bytes} [Tue Jul 19 20:34:12 2022] POST /identity/v3/groups => generated 229 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:34:12.475291 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bda10-5c1d-4000-927d-30e735841f27 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:12.509937 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:12.529648 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde2fda-a902-4d6b-adf7-b7b24a04cbf1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:12.531485 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:12.580195 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed807bb-c796-4661-a987-7ce7a74fdc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:12.581319 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed807bb-c796-4661-a987-7ce7a74fdc24 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:12.581784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed807bb-c796-4661-a987-7ce7a74fdc24 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:12.582374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed807bb-c796-4661-a987-7ce7a74fdc24 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:12.583893 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed807bb-c796-4661-a987-7ce7a74fdc24 None admin] RBAC: Adding query filter params (name=member) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:12.584692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed807bb-c796-4661-a987-7ce7a74fdc24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:12.586434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed807bb-c796-4661-a987-7ce7a74fdc24 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:12.598508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 148/305] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:34:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:12.604133 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed807bb-c796-4661-a987-7ce7a74fdc24 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:12.606619 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bda10-5c1d-4000-927d-30e735841f27 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:12.660020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838e237-b955-485e-9903-fafd7c7720cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:12.662179 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838e237-b955-485e-9903-fafd7c7720cb None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:12.662466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838e237-b955-485e-9903-fafd7c7720cb None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:12.662743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838e237-b955-485e-9903-fafd7c7720cb None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:12.663533 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838e237-b955-485e-9903-fafd7c7720cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:12.663839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838e237-b955-485e-9903-fafd7c7720cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:12.665320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d838e237-b955-485e-9903-fafd7c7720cb None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:12.676328 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 158/306] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:34:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:12.682223 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838e237-b955-485e-9903-fafd7c7720cb None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:12.739343 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed807bb-c796-4661-a987-7ce7a74fdc24 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:12.776424 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a62a7-c623-4093-90af-8d30c0db355a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:12.777570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a62a7-c623-4093-90af-8d30c0db355a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:12.777856 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a62a7-c623-4093-90af-8d30c0db355a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:12.778282 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a62a7-c623-4093-90af-8d30c0db355a None admin] PATH_INFO: `/v3/users/b3243dcc929249a89ef80163e461a0a7` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:12.779393 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a62a7-c623-4093-90af-8d30c0db355a None admin] RBAC: Authorizing `identity:get_user(user_id=b3243dcc929249a89ef80163e461a0a7)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:12.780832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a62a7-c623-4093-90af-8d30c0db355a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:12.782485 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 149/307] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:34:12 2022] GET /identity/v3/users/b3243dcc929249a89ef80163e461a0a7 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:12.785115 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:12.789252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37176d-fa0d-4f99-b645-34e9ce844ad4 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:12.789550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37176d-fa0d-4f99-b645-34e9ce844ad4 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:12.789997 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37176d-fa0d-4f99-b645-34e9ce844ad4 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:12.791288 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 150/308] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:12.791986 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37176d-fa0d-4f99-b645-34e9ce844ad4 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:12.801127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d838e237-b955-485e-9903-fafd7c7720cb None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:12.825630 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:12.837063 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45015c26-fbff-4de2-9202-99f624d598e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:12.837945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45015c26-fbff-4de2-9202-99f624d598e4 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:12.838226 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45015c26-fbff-4de2-9202-99f624d598e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:12.838500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45015c26-fbff-4de2-9202-99f624d598e4 None admin] PATH_INFO: `/v3/users/b36a8653148846cfa5966bd9fa80f49e` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:12.853309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45015c26-fbff-4de2-9202-99f624d598e4 None admin] RBAC: Authorizing `identity:get_user(user_id=b36a8653148846cfa5966bd9fa80f49e)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:12.854899 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45015c26-fbff-4de2-9202-99f624d598e4 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:12.861359 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 159/309] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:34:12 2022] GET /identity/v3/users/b36a8653148846cfa5966bd9fa80f49e => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:12.863189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f615e-04fa-442b-a276-01fdb55062eb None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:12.863558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f615e-04fa-442b-a276-01fdb55062eb None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:12.863838 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f615e-04fa-442b-a276-01fdb55062eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:12.882615 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-8f7f615e-04fa-442b-a276-01fdb55062eb None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:12.883872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-8f7f615e-04fa-442b-a276-01fdb55062eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:12.911917 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37176d-fa0d-4f99-b645-34e9ce844ad4 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:12.949494 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096aeac-f1db-4cbd-91a7-d3e215871547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:12.950380 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096aeac-f1db-4cbd-91a7-d3e215871547 None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:12.950669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096aeac-f1db-4cbd-91a7-d3e215871547 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:12.951027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096aeac-f1db-4cbd-91a7-d3e215871547 None admin] PATH_INFO: `/v3/system/users/b3243dcc929249a89ef80163e461a0a7/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:12.952702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096aeac-f1db-4cbd-91a7-d3e215871547 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b3243dcc929249a89ef80163e461a0a7, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:12.954191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096aeac-f1db-4cbd-91a7-d3e215871547 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:12.963732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 160/310] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:12.972286 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f615e-04fa-442b-a276-01fdb55062eb None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:12.972379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 151/311] 10.222.0.77 () {58 vars in 1334 bytes} [Tue Jul 19 20:34:12 2022] PUT /identity/v3/system/users/b3243dcc929249a89ef80163e461a0a7/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:34:12.994756 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096aeac-f1db-4cbd-91a7-d3e215871547 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:13.092896 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:13.122051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:13.124491 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f615e-04fa-442b-a276-01fdb55062eb None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:13.126918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096aeac-f1db-4cbd-91a7-d3e215871547 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:13.170060 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fde367-5fa6-4b2c-bc69-290499227b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:13.170722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fde367-5fa6-4b2c-bc69-290499227b8a None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:13.171008 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fde367-5fa6-4b2c-bc69-290499227b8a None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:13.171296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fde367-5fa6-4b2c-bc69-290499227b8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:13.172221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fde367-5fa6-4b2c-bc69-290499227b8a None admin] RBAC: Adding query filter params (role.id=61e37a77948648d989c2ba2222b6fe6f, user.id=b36a8653148846cfa5966bd9fa80f49e, scope.system=all) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:13.172556 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fde367-5fa6-4b2c-bc69-290499227b8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:13.173227 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6250310-a5f6-48d0-abd5-b29ec7b23751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:13.173997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fde367-5fa6-4b2c-bc69-290499227b8a None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:13.174973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6250310-a5f6-48d0-abd5-b29ec7b23751 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:13.175478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6250310-a5f6-48d0-abd5-b29ec7b23751 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:13.176205 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6250310-a5f6-48d0-abd5-b29ec7b23751 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:13.180641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 161/312] 10.222.0.77 () {56 vars in 1308 bytes} [Tue Jul 19 20:34:12 2022] GET /identity/v3/role_assignments?user.id=b36a8653148846cfa5966bd9fa80f49e&scope.system=all&role.id=61e37a77948648d989c2ba2222b6fe6f => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:13.196608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6250310-a5f6-48d0-abd5-b29ec7b23751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:13.204855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-e6250310-a5f6-48d0-abd5-b29ec7b23751 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 20:34:13.204855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:13.204855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:13.204855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:13.204855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:13.204855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:13.204855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:13.204855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:13.204855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:13.204855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:13.204855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:13.204855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:13.204855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:13.204855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:13.204855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:13.204855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:13.206349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:13.206349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:13.206349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:13.206349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:13.206349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:13.206349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:13.206349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:13.206349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:13.206349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:13.206349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:13.206349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:13.206349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:13.206349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:13.206349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:13.206349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:13.206349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:13.207150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:13.207150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:13.207150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:13.207150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:13.207150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:13.207150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:13.207150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:13.207150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:13.207150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:13.207150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:13.207150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 20:34:13.207150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:13.211417 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 152/313] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:34:13.213152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fde367-5fa6-4b2c-bc69-290499227b8a None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:13.329825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fde367-5fa6-4b2c-bc69-290499227b8a None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:13.379925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e5d85-1120-4f2d-93f1-99887a2afa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:13.380597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e5d85-1120-4f2d-93f1-99887a2afa2c None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:13.380877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e5d85-1120-4f2d-93f1-99887a2afa2c None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:13.381151 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e5d85-1120-4f2d-93f1-99887a2afa2c None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:13.381901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e5d85-1120-4f2d-93f1-99887a2afa2c None admin] RBAC: Adding query filter params (name=reader) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:13.382207 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e5d85-1120-4f2d-93f1-99887a2afa2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:13.383606 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e5d85-1120-4f2d-93f1-99887a2afa2c None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:13.392163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 162/314] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:34:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:13.398091 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6250310-a5f6-48d0-abd5-b29ec7b23751 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:13.505689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6250310-a5f6-48d0-abd5-b29ec7b23751 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:13.554581 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4726904-653b-468a-941d-e7108dcb56ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:13.555535 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4726904-653b-468a-941d-e7108dcb56ad None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:13.555821 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4726904-653b-468a-941d-e7108dcb56ad None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:13.556097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4726904-653b-468a-941d-e7108dcb56ad None admin] PATH_INFO: `/v3/users/db8ffc510ff44cbdb0f6f8eb5ed82138` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:13.557313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4726904-653b-468a-941d-e7108dcb56ad None admin] RBAC: Authorizing `identity:get_user(user_id=db8ffc510ff44cbdb0f6f8eb5ed82138)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:13.558765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4726904-653b-468a-941d-e7108dcb56ad None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:13.564965 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 153/315] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:34:13 2022] GET /identity/v3/users/db8ffc510ff44cbdb0f6f8eb5ed82138 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:13.566403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e5d85-1120-4f2d-93f1-99887a2afa2c None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:13.576346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:13.692265 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e5d85-1120-4f2d-93f1-99887a2afa2c None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:13.730713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2e758-0265-4003-9c26-bed8f7810e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:13.731751 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2e758-0265-4003-9c26-bed8f7810e1d None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:13.732042 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2e758-0265-4003-9c26-bed8f7810e1d None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:13.732322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2e758-0265-4003-9c26-bed8f7810e1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:13.841120 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2e758-0265-4003-9c26-bed8f7810e1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:13.842580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2e758-0265-4003-9c26-bed8f7810e1d None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:13.871631 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:13.976419 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 163/316] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:13.977794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4726904-653b-468a-941d-e7108dcb56ad None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:14.015947 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:14.121920 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4726904-653b-468a-941d-e7108dcb56ad None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:14.172957 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b09ec-15e8-4355-9260-429d98abdfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:14.173843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b09ec-15e8-4355-9260-429d98abdfb9 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:14.174124 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b09ec-15e8-4355-9260-429d98abdfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:14.174426 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b09ec-15e8-4355-9260-429d98abdfb9 None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:14.176433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b09ec-15e8-4355-9260-429d98abdfb9 None admin] RBAC: Authorizing `identity:get_project(project_id=7763226124204b95a4f39f7d36e13a32)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:14.177886 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b09ec-15e8-4355-9260-429d98abdfb9 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:14.179658 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 154/317] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:13 2022] GET /identity/v3/projects/7763226124204b95a4f39f7d36e13a32 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:14.185760 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2e758-0265-4003-9c26-bed8f7810e1d None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:14.295045 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2e758-0265-4003-9c26-bed8f7810e1d None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:14.297411 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:14.331550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbda6b-6446-4031-b2d2-b76d135da139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:14.332216 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbda6b-6446-4031-b2d2-b76d135da139 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:14.332500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbda6b-6446-4031-b2d2-b76d135da139 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:14.332777 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbda6b-6446-4031-b2d2-b76d135da139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:14.333620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbda6b-6446-4031-b2d2-b76d135da139 None admin] RBAC: Adding query filter params (role.id=61e37a77948648d989c2ba2222b6fe6f, scope.project.id=7763226124204b95a4f39f7d36e13a32, user.id=db8ffc510ff44cbdb0f6f8eb5ed82138) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:14.333936 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbda6b-6446-4031-b2d2-b76d135da139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:14.335392 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbda6b-6446-4031-b2d2-b76d135da139 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:14.346915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 164/318] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:34:14 2022] GET /identity/v3/role_assignments?user.id=db8ffc510ff44cbdb0f6f8eb5ed82138&scope.project.id=7763226124204b95a4f39f7d36e13a32&role.id=61e37a77948648d989c2ba2222b6fe6f => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:14.780636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf372e82-7fe6-4a16-8a9d-59d1d61673d3 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:14.781026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf372e82-7fe6-4a16-8a9d-59d1d61673d3 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:14.781201 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf372e82-7fe6-4a16-8a9d-59d1d61673d3 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:14.782715 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 155/319] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:14.788000 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f0ae8-476a-4cc5-9a4e-dea62bae6003 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:14.788297 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f0ae8-476a-4cc5-9a4e-dea62bae6003 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:14.788578 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f0ae8-476a-4cc5-9a4e-dea62bae6003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:14.805957 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-b03f0ae8-476a-4cc5-9a4e-dea62bae6003 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:14.807161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b03f0ae8-476a-4cc5-9a4e-dea62bae6003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:14.877453 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 165/320] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:14.900398 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf372e82-7fe6-4a16-8a9d-59d1d61673d3 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:14.998785 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:15.010139 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf372e82-7fe6-4a16-8a9d-59d1d61673d3 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:15.044288 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44af5be-bcd8-4f63-b1ca-5d121ca2b73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:15.045015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44af5be-bcd8-4f63-b1ca-5d121ca2b73f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:15.045302 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44af5be-bcd8-4f63-b1ca-5d121ca2b73f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:15.045579 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44af5be-bcd8-4f63-b1ca-5d121ca2b73f None admin] PATH_INFO: `/v3/domains/default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:15.046744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44af5be-bcd8-4f63-b1ca-5d121ca2b73f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:15.048208 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44af5be-bcd8-4f63-b1ca-5d121ca2b73f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:15.050620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 156/321] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:15.056003 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f0ae8-476a-4cc5-9a4e-dea62bae6003 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:15.159867 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:15.164807 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f0ae8-476a-4cc5-9a4e-dea62bae6003 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:15.184272 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f7913-6553-40b9-bf94-3337ce1daa4b None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:15.184558 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f7913-6553-40b9-bf94-3337ce1daa4b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:15.185037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f7913-6553-40b9-bf94-3337ce1daa4b None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:15.186402 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 157/322] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:15.192007 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2467f36-b066-4edb-8fa7-e2883e3fc63a None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:15.192300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2467f36-b066-4edb-8fa7-e2883e3fc63a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:15.192577 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2467f36-b066-4edb-8fa7-e2883e3fc63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:15.200764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54317f-b292-446e-9590-e154ebff118c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:15.201440 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54317f-b292-446e-9590-e154ebff118c None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:15.201724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54317f-b292-446e-9590-e154ebff118c None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:15.202001 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54317f-b292-446e-9590-e154ebff118c None admin] PATH_INFO: `/v3/groups` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:15.202743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54317f-b292-446e-9590-e154ebff118c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:15.204274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54317f-b292-446e-9590-e154ebff118c None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:15.210113 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-c2467f36-b066-4edb-8fa7-e2883e3fc63a None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:15.211537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c2467f36-b066-4edb-8fa7-e2883e3fc63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:15.220407 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 166/323] 10.222.0.77 () {60 vars in 1134 bytes} [Tue Jul 19 20:34:15 2022] POST /identity/v3/groups => generated 226 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:34:15.286757 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 158/324] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:15.311359 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54317f-b292-446e-9590-e154ebff118c None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:15.357403 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688cae5-3ce1-4c61-8d35-b273bb38ea37 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:15.357690 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688cae5-3ce1-4c61-8d35-b273bb38ea37 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:15.357965 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688cae5-3ce1-4c61-8d35-b273bb38ea37 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:15.359749 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 159/325] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:34:15.365514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cfe39-55c2-4f53-a3aa-d49010a56960 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:15.366162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cfe39-55c2-4f53-a3aa-d49010a56960 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:15.366162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cfe39-55c2-4f53-a3aa-d49010a56960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:15.385561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-f37cfe39-55c2-4f53-a3aa-d49010a56960 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:15.386753 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-f37cfe39-55c2-4f53-a3aa-d49010a56960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:15.428412 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54317f-b292-446e-9590-e154ebff118c None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:15.472616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 160/326] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:34:15.476818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8d677-4a69-4988-8c77-d3abb8dd456d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:15.477636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8d677-4a69-4988-8c77-d3abb8dd456d None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:15.477926 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8d677-4a69-4988-8c77-d3abb8dd456d None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:15.478206 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8d677-4a69-4988-8c77-d3abb8dd456d None admin] PATH_INFO: `/v3/roles/member` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:15.490780 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8d677-4a69-4988-8c77-d3abb8dd456d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:15.494733 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cfe39-55c2-4f53-a3aa-d49010a56960 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:15.498990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-5de8d677-4a69-4988-8c77-d3abb8dd456d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:15.498990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:15.498990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:15.498990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:15.498990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:15.498990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:15.498990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:15.498990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:15.498990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:15.498990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:15.498990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:15.498990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:15.498990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:15.498990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:15.498990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:15.498990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:15.499948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:15.499948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:15.499948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:15.499948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:15.499948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:15.499948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:15.499948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:15.499948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:15.499948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:15.499948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:15.499948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:15.499948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:15.499948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:15.499948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:15.499948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:15.499948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:15.501168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:15.501168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:15.501168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:15.501168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:15.501168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:15.501168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:15.501168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:15.501168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:15.501168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:15.501168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:15.501168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:15.501168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:15.501168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 167/327] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:15.506210 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8d677-4a69-4988-8c77-d3abb8dd456d None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:15.520517 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:15.529009 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:15.632402 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cfe39-55c2-4f53-a3aa-d49010a56960 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:15.633355 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8d677-4a69-4988-8c77-d3abb8dd456d None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:15.678047 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef59913-9a28-44a2-9c5d-9d690fb4cb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:15.678724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef59913-9a28-44a2-9c5d-9d690fb4cb37 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:15.679037 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef59913-9a28-44a2-9c5d-9d690fb4cb37 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:15.679312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef59913-9a28-44a2-9c5d-9d690fb4cb37 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:15.680078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef59913-9a28-44a2-9c5d-9d690fb4cb37 None admin] RBAC: Adding query filter params (name=member) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:15.680384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef59913-9a28-44a2-9c5d-9d690fb4cb37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:15.681761 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef59913-9a28-44a2-9c5d-9d690fb4cb37 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:15.684400 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152a5a3-95f6-4748-a9c2-a9102994a62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:15.685950 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152a5a3-95f6-4748-a9c2-a9102994a62f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:15.686436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152a5a3-95f6-4748-a9c2-a9102994a62f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:15.686924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152a5a3-95f6-4748-a9c2-a9102994a62f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:15.692117 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 168/328] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:34:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:15.699010 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef59913-9a28-44a2-9c5d-9d690fb4cb37 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:15.705931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152a5a3-95f6-4748-a9c2-a9102994a62f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:15.714185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-1152a5a3-95f6-4748-a9c2-a9102994a62f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 20:34:15.714185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:15.714185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:15.714185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:15.714185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:15.714185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:15.714185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:15.714185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:15.714185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:15.714185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:15.714185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:15.714185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:15.714185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:15.714185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:15.714185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:15.714185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:15.715103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:15.715103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:15.715103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:15.715103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:15.715103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:15.715103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:15.715103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:15.715103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:15.715103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:15.715103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:15.715103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:15.715103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:15.715103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:15.715103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:15.715103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:15.715103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:15.715935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:15.715935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:15.715935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:15.715935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:15.715935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:15.715935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:15.715935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:15.715935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:15.715935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:15.715935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:15.715935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 20:34:15.715935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:15.715935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 161/329] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:15.721871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152a5a3-95f6-4748-a9c2-a9102994a62f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:15.791572 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:15.810612 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:15.813392 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef59913-9a28-44a2-9c5d-9d690fb4cb37 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:15.831566 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152a5a3-95f6-4748-a9c2-a9102994a62f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:15.857737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814676be-d93b-4130-869b-10789f49aa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:15.859083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814676be-d93b-4130-869b-10789f49aa51 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:15.859589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814676be-d93b-4130-869b-10789f49aa51 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:15.860099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814676be-d93b-4130-869b-10789f49aa51 None admin] PATH_INFO: `/v3/users/b3243dcc929249a89ef80163e461a0a7` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:15.862668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814676be-d93b-4130-869b-10789f49aa51 None admin] RBAC: Authorizing `identity:get_user(user_id=b3243dcc929249a89ef80163e461a0a7)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:15.865475 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814676be-d93b-4130-869b-10789f49aa51 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:15.868479 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 169/330] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:34:15 2022] GET /identity/v3/users/b3243dcc929249a89ef80163e461a0a7 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:15.875202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814676be-d93b-4130-869b-10789f49aa51 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:15.879483 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f4dee-8d6e-4e45-92d9-9bb8b5471634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:15.880162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f4dee-8d6e-4e45-92d9-9bb8b5471634 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:15.880487 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f4dee-8d6e-4e45-92d9-9bb8b5471634 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:15.881573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f4dee-8d6e-4e45-92d9-9bb8b5471634 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:15.881573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f4dee-8d6e-4e45-92d9-9bb8b5471634 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:15.881866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f4dee-8d6e-4e45-92d9-9bb8b5471634 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:15.883527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f4dee-8d6e-4e45-92d9-9bb8b5471634 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:15.898496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 162/331] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:34:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:15.905985 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f4dee-8d6e-4e45-92d9-9bb8b5471634 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:16.009555 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814676be-d93b-4130-869b-10789f49aa51 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:16.043731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f4dee-8d6e-4e45-92d9-9bb8b5471634 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:16.058713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc283e-0cb5-4213-8e09-78f711f6da96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:16.060079 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc283e-0cb5-4213-8e09-78f711f6da96 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:16.060368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc283e-0cb5-4213-8e09-78f711f6da96 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:16.060649 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc283e-0cb5-4213-8e09-78f711f6da96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:16.061498 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc283e-0cb5-4213-8e09-78f711f6da96 None admin] RBAC: Adding query filter params (role.id=a2021efb2e4e459cbfa73f6987297bca, user.id=b3243dcc929249a89ef80163e461a0a7, scope.system=all) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:16.061812 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc283e-0cb5-4213-8e09-78f711f6da96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:16.063286 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc283e-0cb5-4213-8e09-78f711f6da96 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:16.088333 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 170/332] 10.222.0.77 () {56 vars in 1308 bytes} [Tue Jul 19 20:34:15 2022] GET /identity/v3/role_assignments?user.id=b3243dcc929249a89ef80163e461a0a7&scope.system=all&role.id=a2021efb2e4e459cbfa73f6987297bca => generated 510 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:16.095607 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8a026-98b1-4428-9e8e-3de3d3e84e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:16.096772 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8a026-98b1-4428-9e8e-3de3d3e84e0b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:16.097190 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8a026-98b1-4428-9e8e-3de3d3e84e0b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:16.097592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8a026-98b1-4428-9e8e-3de3d3e84e0b None admin] PATH_INFO: `/v3/users/b36a8653148846cfa5966bd9fa80f49e` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:16.099015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8a026-98b1-4428-9e8e-3de3d3e84e0b None admin] RBAC: Authorizing `identity:get_user(user_id=b36a8653148846cfa5966bd9fa80f49e)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:16.100773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8a026-98b1-4428-9e8e-3de3d3e84e0b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:16.102977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 163/333] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:34:15 2022] GET /identity/v3/users/b36a8653148846cfa5966bd9fa80f49e => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:16.108511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc283e-0cb5-4213-8e09-78f711f6da96 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:16.125091 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:16.243061 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc283e-0cb5-4213-8e09-78f711f6da96 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:16.280939 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e9283-e70c-4ba1-98a8-af64bf39b6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:16.282094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e9283-e70c-4ba1-98a8-af64bf39b6b7 None admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:16.282535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e9283-e70c-4ba1-98a8-af64bf39b6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:16.283209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e9283-e70c-4ba1-98a8-af64bf39b6b7 None admin] PATH_INFO: `/v3/system/users/b36a8653148846cfa5966bd9fa80f49e/roles/61e37a77948648d989c2ba2222b6fe6f` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:16.285017 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e9283-e70c-4ba1-98a8-af64bf39b6b7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b36a8653148846cfa5966bd9fa80f49e, role_id=61e37a77948648d989c2ba2222b6fe6f)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:16.286575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e9283-e70c-4ba1-98a8-af64bf39b6b7 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:16.296597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 171/334] 10.222.0.77 () {58 vars in 1334 bytes} [Tue Jul 19 20:34:16 2022] PUT /identity/v3/system/users/b36a8653148846cfa5966bd9fa80f49e/roles/61e37a77948648d989c2ba2222b6fe6f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:34:17.858491 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038c288-3854-4163-9d60-c6053c4ba425 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:17.859003 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038c288-3854-4163-9d60-c6053c4ba425 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:17.859078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038c288-3854-4163-9d60-c6053c4ba425 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:17.860665 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 164/335] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:17.866953 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89572ce1-7a1b-4050-8b87-cbdc8555df4d None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:17.867845 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89572ce1-7a1b-4050-8b87-cbdc8555df4d None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:17.868322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89572ce1-7a1b-4050-8b87-cbdc8555df4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:17.886144 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-89572ce1-7a1b-4050-8b87-cbdc8555df4d None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:17.891285 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-89572ce1-7a1b-4050-8b87-cbdc8555df4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:17.977036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:17.985325 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 172/336] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:18.032451 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038c288-3854-4163-9d60-c6053c4ba425 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:18.051424 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:18.150877 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038c288-3854-4163-9d60-c6053c4ba425 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:18.193863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da673bb-0bed-4c76-8264-e91bf8934310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:18.195047 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da673bb-0bed-4c76-8264-e91bf8934310 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:18.195567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da673bb-0bed-4c76-8264-e91bf8934310 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:18.196059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da673bb-0bed-4c76-8264-e91bf8934310 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:18.212567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da673bb-0bed-4c76-8264-e91bf8934310 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:18.221188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-5da673bb-0bed-4c76-8264-e91bf8934310 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:34:18.221188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:18.221188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:18.221188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:18.221188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:18.221188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:18.221188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:18.221188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:18.221188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:18.221188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:18.221188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:18.221188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:18.221188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:18.221188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:18.221188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:18.221188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:18.222110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:18.222110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:18.222110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:18.222110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:18.222110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:18.222110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:18.222110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:18.222110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:18.222110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:18.222110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:18.222110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:18.222110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:18.222110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:18.222110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:18.222110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:18.222110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:18.222921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:18.222921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:18.222921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:18.222921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:18.222921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:18.222921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:18.222921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:18.222921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:18.222921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:18.222921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:18.222921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:34:18.222921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:18.229845 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 165/337] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jul 19 20:34:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:18.240362 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89572ce1-7a1b-4050-8b87-cbdc8555df4d None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:18.376559 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89572ce1-7a1b-4050-8b87-cbdc8555df4d None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:18.419037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ea7c9-0973-4650-a883-66bc63b5a965 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:18.419768 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ea7c9-0973-4650-a883-66bc63b5a965 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:18.420275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792ea7c9-0973-4650-a883-66bc63b5a965 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:18.422764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 166/338] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:18.429195 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7f283-12b7-4906-8627-88bfec4f91bb None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:18.429859 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7f283-12b7-4906-8627-88bfec4f91bb None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:18.430434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7f283-12b7-4906-8627-88bfec4f91bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:18.432160 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aefb3c-f782-4a24-b4ae-0e700db9576e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:18.432844 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aefb3c-f782-4a24-b4ae-0e700db9576e None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:18.433132 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aefb3c-f782-4a24-b4ae-0e700db9576e None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:18.433414 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aefb3c-f782-4a24-b4ae-0e700db9576e None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:18.437245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aefb3c-f782-4a24-b4ae-0e700db9576e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:18.437245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aefb3c-f782-4a24-b4ae-0e700db9576e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:18.437245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aefb3c-f782-4a24-b4ae-0e700db9576e None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:18.450376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 173/339] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:18.456432 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aefb3c-f782-4a24-b4ae-0e700db9576e None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:18.465282 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-38c7f283-12b7-4906-8627-88bfec4f91bb None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:18.466774 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-38c7f283-12b7-4906-8627-88bfec4f91bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:18.573217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 167/340] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:34:18.575656 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:18.599670 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:18.616389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7f283-12b7-4906-8627-88bfec4f91bb None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:18.658417 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aefb3c-f782-4a24-b4ae-0e700db9576e None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:18.716040 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9638b9-548d-4315-8daa-701b8016282b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:18.717089 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9638b9-548d-4315-8daa-701b8016282b None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:18.717597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9638b9-548d-4315-8daa-701b8016282b None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:18.718083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9638b9-548d-4315-8daa-701b8016282b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:18.779104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7f283-12b7-4906-8627-88bfec4f91bb None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:18.818697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9638b9-548d-4315-8daa-701b8016282b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:18.824749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9638b9-548d-4315-8daa-701b8016282b None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:18.839973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc065f4-944b-4170-aeff-6a66c86bac39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:18.841045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc065f4-944b-4170-aeff-6a66c86bac39 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:18.841540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc065f4-944b-4170-aeff-6a66c86bac39 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:18.841958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc065f4-944b-4170-aeff-6a66c86bac39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:18.872488 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc065f4-944b-4170-aeff-6a66c86bac39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:18.881232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-6bc065f4-944b-4170-aeff-6a66c86bac39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:18.881232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:18.881232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:18.881232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:18.881232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:18.881232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:18.881232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:18.881232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:18.881232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:18.881232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:18.881232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:18.881232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:18.881232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:18.881232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:18.881232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:18.881232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:18.882265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:18.882265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:18.882265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:18.882265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:18.882265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:18.882265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:18.882265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:18.882265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:18.882265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:18.882265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:18.882265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:18.882265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:18.882265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:18.882265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:18.882265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:18.882265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:18.887476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:18.887476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:18.887476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:18.887476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:18.887476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:18.887476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:18.887476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:18.887476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:18.887476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:18.887476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:18.887476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:18.887476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:18.890294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 168/341] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:18.896408 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc065f4-944b-4170-aeff-6a66c86bac39 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:18.929176 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:19.005290 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:19.008590 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 174/342] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 20:34:19.010713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efff8bf-970f-49c5-b6c5-62c94a4d74ae None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:19.011002 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efff8bf-970f-49c5-b6c5-62c94a4d74ae None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:19.011295 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efff8bf-970f-49c5-b6c5-62c94a4d74ae None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:19.012587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 175/343] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:19.018831 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efff8bf-970f-49c5-b6c5-62c94a4d74ae None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:19.105490 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc065f4-944b-4170-aeff-6a66c86bac39 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:19.157495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efff8bf-970f-49c5-b6c5-62c94a4d74ae None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:19.196056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397f877-69b6-4b3b-83f5-fbd397fb5a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:19.197248 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d511ad-bfe3-4559-8693-43e58694caa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:19.197423 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397f877-69b6-4b3b-83f5-fbd397fb5a67 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:19.197527 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397f877-69b6-4b3b-83f5-fbd397fb5a67 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:19.197804 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397f877-69b6-4b3b-83f5-fbd397fb5a67 None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:19.198673 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d511ad-bfe3-4559-8693-43e58694caa6 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:19.199074 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397f877-69b6-4b3b-83f5-fbd397fb5a67 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf9c36dd93649fb92ed3e7f9f20258d)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:19.199204 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d511ad-bfe3-4559-8693-43e58694caa6 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:19.199421 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d511ad-bfe3-4559-8693-43e58694caa6 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:19.200335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d511ad-bfe3-4559-8693-43e58694caa6 None admin] RBAC: Adding query filter params (name=member) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:19.200790 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d511ad-bfe3-4559-8693-43e58694caa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:19.200917 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397f877-69b6-4b3b-83f5-fbd397fb5a67 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:19.203294 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 176/344] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:19 2022] GET /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:19.203647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d511ad-bfe3-4559-8693-43e58694caa6 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:19.205063 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39b3b1-4773-4417-8051-6afc96fb32e2 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:19.205063 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39b3b1-4773-4417-8051-6afc96fb32e2 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:19.205063 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39b3b1-4773-4417-8051-6afc96fb32e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:19.214992 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 169/345] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:34:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:19.216571 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65347915-1ea9-4a20-8013-a796fd6b7fd5 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:19.217027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65347915-1ea9-4a20-8013-a796fd6b7fd5 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:19.217511 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65347915-1ea9-4a20-8013-a796fd6b7fd5 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:19.218932 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 170/346] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:19.219810 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65347915-1ea9-4a20-8013-a796fd6b7fd5 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:19.224168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-7b39b3b1-4773-4417-8051-6afc96fb32e2 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:19.225404 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-7b39b3b1-4773-4417-8051-6afc96fb32e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:19.253885 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:19.310597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 177/347] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:19.311708 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39b3b1-4773-4417-8051-6afc96fb32e2 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:19.351655 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65347915-1ea9-4a20-8013-a796fd6b7fd5 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:19.378572 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:19.391815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4260374-db9e-45e1-86b0-547dc71403f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:19.394164 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4260374-db9e-45e1-86b0-547dc71403f5 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:19.394892 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4260374-db9e-45e1-86b0-547dc71403f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:19.395368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4260374-db9e-45e1-86b0-547dc71403f5 None admin] PATH_INFO: `/v3/groups/0506c68c6ac54279bbafd35465886bc5` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:19.404385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4260374-db9e-45e1-86b0-547dc71403f5 None admin] RBAC: Authorizing `identity:get_group(group_id=0506c68c6ac54279bbafd35465886bc5)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:19.406068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4260374-db9e-45e1-86b0-547dc71403f5 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:19.408525 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 171/348] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jul 19 20:34:19 2022] GET /identity/v3/groups/0506c68c6ac54279bbafd35465886bc5 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:19.410524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514c0fa-3113-42d9-b7b6-579fe749a4a5 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:19.411460 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514c0fa-3113-42d9-b7b6-579fe749a4a5 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:19.411904 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514c0fa-3113-42d9-b7b6-579fe749a4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:19.435462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-1514c0fa-3113-42d9-b7b6-579fe749a4a5 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:19.437191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-1514c0fa-3113-42d9-b7b6-579fe749a4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:19.441286 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39b3b1-4773-4417-8051-6afc96fb32e2 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:19.487994 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cc87d-0405-4bf1-9198-05edb6990708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:19.489622 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cc87d-0405-4bf1-9198-05edb6990708 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:19.489916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cc87d-0405-4bf1-9198-05edb6990708 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:19.490200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cc87d-0405-4bf1-9198-05edb6990708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:19.533977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:19.536430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 172/349] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:19.537536 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514c0fa-3113-42d9-b7b6-579fe749a4a5 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:19.606052 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cc87d-0405-4bf1-9198-05edb6990708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:19.607807 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cc87d-0405-4bf1-9198-05edb6990708 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:19.681435 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514c0fa-3113-42d9-b7b6-579fe749a4a5 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:19.704548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:19.733450 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 178/350] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:19.735736 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cc87d-0405-4bf1-9198-05edb6990708 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:19.749883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7c2e5-dcf4-48c1-9400-6423cdb9627a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:19.750849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7c2e5-dcf4-48c1-9400-6423cdb9627a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:19.751310 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7c2e5-dcf4-48c1-9400-6423cdb9627a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:19.751712 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7c2e5-dcf4-48c1-9400-6423cdb9627a None admin] PATH_INFO: `/v3/roles/member` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:19.767305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7c2e5-dcf4-48c1-9400-6423cdb9627a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:19.779770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-68b7c2e5-dcf4-48c1-9400-6423cdb9627a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:19.779770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:19.779770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:19.779770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:19.779770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:19.779770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:19.779770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:19.779770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:19.779770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:19.779770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:19.779770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:19.779770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:19.779770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:19.779770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:19.779770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:19.779770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:19.780905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:19.780905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:19.780905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:19.780905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:19.780905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:19.780905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:19.780905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:19.780905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:19.780905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:19.780905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:19.780905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:19.780905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:19.780905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:19.780905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:19.780905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:19.780905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:19.781871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:19.781871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:19.781871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:19.781871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:19.781871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:19.781871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:19.781871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:19.781871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:19.781871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:19.781871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:19.781871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:19.781871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:19.782941 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 173/351] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:19.783966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7c2e5-dcf4-48c1-9400-6423cdb9627a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:19.811288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:19.871866 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cc87d-0405-4bf1-9198-05edb6990708 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:19.917286 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f02dfe-86ce-4de5-9cc5-d1c4e959ff4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:19.918107 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f02dfe-86ce-4de5-9cc5-d1c4e959ff4a None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:19.918403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f02dfe-86ce-4de5-9cc5-d1c4e959ff4a None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:19.918974 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f02dfe-86ce-4de5-9cc5-d1c4e959ff4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:19.920051 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f02dfe-86ce-4de5-9cc5-d1c4e959ff4a None admin] RBAC: Adding query filter params (group.id=0506c68c6ac54279bbafd35465886bc5, role.id=92567de587bf40dab488cc1eb666b221, scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:19.920369 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f02dfe-86ce-4de5-9cc5-d1c4e959ff4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:19.921808 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f02dfe-86ce-4de5-9cc5-d1c4e959ff4a None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:19.931211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 179/352] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Jul 19 20:34:19 2022] GET /identity/v3/role_assignments?group.id=0506c68c6ac54279bbafd35465886bc5&scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d&role.id=92567de587bf40dab488cc1eb666b221 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:19.931211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f02dfe-86ce-4de5-9cc5-d1c4e959ff4a None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:19.945423 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7c2e5-dcf4-48c1-9400-6423cdb9627a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:19.990996 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8b844-31f9-4094-971d-adba69864558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:19.991490 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8b844-31f9-4094-971d-adba69864558 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:19.991785 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8b844-31f9-4094-971d-adba69864558 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:19.992062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec8b844-31f9-4094-971d-adba69864558 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:20.005724 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec8b844-31f9-4094-971d-adba69864558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:20.014359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-9ec8b844-31f9-4094-971d-adba69864558 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:34:20.014359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:20.014359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:20.014359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:20.014359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:20.014359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:20.014359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:20.014359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:20.014359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:20.014359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:20.014359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:20.014359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:20.014359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:20.014359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:20.014359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:20.014359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:20.015717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:20.015717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:20.015717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:20.015717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:20.015717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:20.015717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:20.015717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:20.015717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:20.015717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:20.015717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:20.015717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:20.015717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:20.015717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:20.015717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:20.015717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:20.015717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:20.016675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:20.016675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:20.016675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:20.016675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:20.016675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:20.016675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:20.016675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:20.016675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:20.016675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:20.016675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:20.016675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:34:20.016675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:20.018172 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 174/353] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jul 19 20:34:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:20.018911 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8b844-31f9-4094-971d-adba69864558 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:20.062178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:20.082187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f02dfe-86ce-4de5-9cc5-d1c4e959ff4a None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:20.116539 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:20.130327 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907a519-2f5c-48a1-a536-ddd12cb5ba19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:20.131636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907a519-2f5c-48a1-a536-ddd12cb5ba19 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:20.131919 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907a519-2f5c-48a1-a536-ddd12cb5ba19 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:20.132485 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907a519-2f5c-48a1-a536-ddd12cb5ba19 None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:20.136106 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907a519-2f5c-48a1-a536-ddd12cb5ba19 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf9c36dd93649fb92ed3e7f9f20258d)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:20.138823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4907a519-2f5c-48a1-a536-ddd12cb5ba19 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:20.141373 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 180/354] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:19 2022] GET /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:20.142780 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d8aa7-1856-452e-baa1-eb1842e7fc18 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:20.143067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d8aa7-1856-452e-baa1-eb1842e7fc18 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:20.145642 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec8b844-31f9-4094-971d-adba69864558 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:20.147475 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d8aa7-1856-452e-baa1-eb1842e7fc18 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:20.149710 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 181/355] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:20.152078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d8aa7-1856-452e-baa1-eb1842e7fc18 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:20.192404 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d0103-4713-4d79-989d-a807eea91d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:20.193088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d0103-4713-4d79-989d-a807eea91d85 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:20.193374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d0103-4713-4d79-989d-a807eea91d85 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:20.193654 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d0103-4713-4d79-989d-a807eea91d85 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:20.194418 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d0103-4713-4d79-989d-a807eea91d85 None admin] RBAC: Adding query filter params (name=member) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:20.194733 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d0103-4713-4d79-989d-a807eea91d85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:20.196214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d0103-4713-4d79-989d-a807eea91d85 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:20.206662 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 175/356] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:34:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:20.208434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d570c6-d3c7-4acb-8e9b-c02c775aa1bd None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:20.208722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d570c6-d3c7-4acb-8e9b-c02c775aa1bd None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:20.209002 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d570c6-d3c7-4acb-8e9b-c02c775aa1bd None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:20.210448 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 176/357] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:20.212185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d570c6-d3c7-4acb-8e9b-c02c775aa1bd None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:20.303718 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d8aa7-1856-452e-baa1-eb1842e7fc18 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:20.339227 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:20.344835 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d570c6-d3c7-4acb-8e9b-c02c775aa1bd None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:20.351620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f608714-308d-46c5-9450-f710455c2a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:20.352311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f608714-308d-46c5-9450-f710455c2a17 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:20.352601 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f608714-308d-46c5-9450-f710455c2a17 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:20.353340 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f608714-308d-46c5-9450-f710455c2a17 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:20.354111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f608714-308d-46c5-9450-f710455c2a17 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:20.354423 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f608714-308d-46c5-9450-f710455c2a17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:20.356247 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f608714-308d-46c5-9450-f710455c2a17 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:20.369346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 182/358] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:20.375151 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a404e-9e04-4ef2-815b-1e1bc1b820df None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:20.375454 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a404e-9e04-4ef2-815b-1e1bc1b820df None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:20.375740 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a404e-9e04-4ef2-815b-1e1bc1b820df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:20.384715 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e37a1-bb1c-4eac-a2ba-557f041d7fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:20.385515 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e37a1-bb1c-4eac-a2ba-557f041d7fd4 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:20.385802 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e37a1-bb1c-4eac-a2ba-557f041d7fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:20.386079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e37a1-bb1c-4eac-a2ba-557f041d7fd4 None admin] PATH_INFO: `/v3/groups/0506c68c6ac54279bbafd35465886bc5` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:20.387318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e37a1-bb1c-4eac-a2ba-557f041d7fd4 None admin] RBAC: Authorizing `identity:get_group(group_id=0506c68c6ac54279bbafd35465886bc5)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:20.388766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e37a1-bb1c-4eac-a2ba-557f041d7fd4 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:20.390658 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 177/359] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jul 19 20:34:20 2022] GET /identity/v3/groups/0506c68c6ac54279bbafd35465886bc5 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:20.391204 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e37a1-bb1c-4eac-a2ba-557f041d7fd4 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:20.393820 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-cd0a404e-9e04-4ef2-815b-1e1bc1b820df None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:20.395032 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-cd0a404e-9e04-4ef2-815b-1e1bc1b820df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:20.462369 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:20.489953 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 183/360] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:20.495452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8af90a-27bf-443c-9ef7-003d885ceceb None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:20.496340 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8af90a-27bf-443c-9ef7-003d885ceceb None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:20.496854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8af90a-27bf-443c-9ef7-003d885ceceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:20.512544 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e37a1-bb1c-4eac-a2ba-557f041d7fd4 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:20.524331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-fd8af90a-27bf-443c-9ef7-003d885ceceb None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:20.525532 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-fd8af90a-27bf-443c-9ef7-003d885ceceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:20.558410 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebc42c-bc5c-469b-a873-0279579a2b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:20.559075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebc42c-bc5c-469b-a873-0279579a2b3d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:20.559602 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebc42c-bc5c-469b-a873-0279579a2b3d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:20.559881 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebc42c-bc5c-469b-a873-0279579a2b3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:20.612707 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:20.612899 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 184/361] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:20.615368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8af90a-27bf-443c-9ef7-003d885ceceb None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:20.672814 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eebc42c-bc5c-469b-a873-0279579a2b3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:20.674589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eebc42c-bc5c-469b-a873-0279579a2b3d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:20.759618 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8af90a-27bf-443c-9ef7-003d885ceceb None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:20.776817 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:20.808208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64fc58-c109-4312-bed6-85ece48f1e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:20.808866 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64fc58-c109-4312-bed6-85ece48f1e1d None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:20.809155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64fc58-c109-4312-bed6-85ece48f1e1d None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:20.809428 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64fc58-c109-4312-bed6-85ece48f1e1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:20.817140 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 178/362] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:20.818334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebc42c-bc5c-469b-a873-0279579a2b3d None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:20.902505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64fc58-c109-4312-bed6-85ece48f1e1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:20.904269 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64fc58-c109-4312-bed6-85ece48f1e1d None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:20.910795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:20.956512 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebc42c-bc5c-469b-a873-0279579a2b3d None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:20.998456 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cfb6e-de24-4165-b0b8-94fae520ee4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:20.999150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cfb6e-de24-4165-b0b8-94fae520ee4f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:20.999515 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cfb6e-de24-4165-b0b8-94fae520ee4f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:20.999799 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cfb6e-de24-4165-b0b8-94fae520ee4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:21.000673 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6cfb6e-de24-4165-b0b8-94fae520ee4f None admin] RBAC: Adding query filter params (group.id=0506c68c6ac54279bbafd35465886bc5, role.id=a2021efb2e4e459cbfa73f6987297bca, scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:21.001010 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6cfb6e-de24-4165-b0b8-94fae520ee4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:21.002545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6cfb6e-de24-4165-b0b8-94fae520ee4f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:21.010867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 179/363] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Jul 19 20:34:20 2022] GET /identity/v3/role_assignments?group.id=0506c68c6ac54279bbafd35465886bc5&scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d&role.id=a2021efb2e4e459cbfa73f6987297bca => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:21.012273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cfb6e-de24-4165-b0b8-94fae520ee4f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:21.050130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 185/364] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:21.052200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64fc58-c109-4312-bed6-85ece48f1e1d None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:21.073383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:21.142646 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cfb6e-de24-4165-b0b8-94fae520ee4f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:21.178729 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:21.185119 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64fc58-c109-4312-bed6-85ece48f1e1d None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:21.185582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e67cb3-b93b-4437-94c8-ccd10d7a65e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:21.186713 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e67cb3-b93b-4437-94c8-ccd10d7a65e4 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:21.189799 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e67cb3-b93b-4437-94c8-ccd10d7a65e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:21.191016 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e67cb3-b93b-4437-94c8-ccd10d7a65e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:21.206081 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e67cb3-b93b-4437-94c8-ccd10d7a65e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:21.215669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-40e67cb3-b93b-4437-94c8-ccd10d7a65e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 20:34:21.215669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:21.215669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:21.215669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:21.215669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:21.215669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:21.215669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:21.215669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:21.215669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:21.215669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:21.215669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:21.215669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:21.215669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:21.215669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:21.215669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:21.215669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:21.216822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:21.216822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:21.216822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:21.216822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:21.216822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:21.216822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:21.216822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:21.216822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:21.216822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:21.216822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:21.216822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:21.216822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:21.216822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:21.216822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:21.216822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:21.216822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:21.217776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:21.217776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:21.217776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:21.217776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:21.217776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:21.217776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:21.217776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:21.217776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:21.217776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:21.217776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:21.217776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 20:34:21.217776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:21.217776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 180/365] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:21.218801 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e67cb3-b93b-4437-94c8-ccd10d7a65e4 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:21.236099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e7bbc-fde0-476d-9f71-63c40a7a6375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:21.237262 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e7bbc-fde0-476d-9f71-63c40a7a6375 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:21.237582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e7bbc-fde0-476d-9f71-63c40a7a6375 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:21.237863 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e7bbc-fde0-476d-9f71-63c40a7a6375 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:21.256974 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e7bbc-fde0-476d-9f71-63c40a7a6375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:21.267254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-159e7bbc-fde0-476d-9f71-63c40a7a6375 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:34:21.267254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:21.267254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:21.267254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:21.267254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:21.267254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:21.267254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:21.267254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:21.267254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:21.267254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:21.267254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:21.267254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:21.267254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:21.267254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:21.267254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:21.267254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:21.268221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:21.268221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:21.268221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:21.268221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:21.268221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:21.268221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:21.268221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:21.268221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:21.268221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:21.268221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:21.268221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:21.268221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:21.268221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:21.268221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:21.268221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:21.268221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:21.269569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:21.269569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:21.269569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:21.269569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:21.269569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:21.269569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:21.269569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:21.269569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:21.269569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:21.269569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:21.269569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:34:21.269569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:21.269569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 186/366] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:34:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:21.275896 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e7bbc-fde0-476d-9f71-63c40a7a6375 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:21.349055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e67cb3-b93b-4437-94c8-ccd10d7a65e4 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:21.378588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:21.396361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd6040-f3fc-4b3f-a0bb-f71e3564584b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:21.397399 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd6040-f3fc-4b3f-a0bb-f71e3564584b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:21.397689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd6040-f3fc-4b3f-a0bb-f71e3564584b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:21.397973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd6040-f3fc-4b3f-a0bb-f71e3564584b None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:21.401262 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd6040-f3fc-4b3f-a0bb-f71e3564584b None admin] RBAC: Authorizing `identity:get_project(project_id=7763226124204b95a4f39f7d36e13a32)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:21.403977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd6040-f3fc-4b3f-a0bb-f71e3564584b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:21.405922 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 181/367] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:21 2022] GET /identity/v3/projects/7763226124204b95a4f39f7d36e13a32 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:21.409438 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd6040-f3fc-4b3f-a0bb-f71e3564584b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:21.422994 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e7bbc-fde0-476d-9f71-63c40a7a6375 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:21.464347 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0703d36-89e4-4ea3-a40b-e1cd8a083470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:21.465606 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0703d36-89e4-4ea3-a40b-e1cd8a083470 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:21.465606 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0703d36-89e4-4ea3-a40b-e1cd8a083470 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:21.466026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0703d36-89e4-4ea3-a40b-e1cd8a083470 None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:21.467322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0703d36-89e4-4ea3-a40b-e1cd8a083470 None admin] RBAC: Authorizing `identity:get_project(project_id=7763226124204b95a4f39f7d36e13a32)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:21.468872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0703d36-89e4-4ea3-a40b-e1cd8a083470 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:21.471024 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 187/368] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:21 2022] GET /identity/v3/projects/7763226124204b95a4f39f7d36e13a32 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:21.472726 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0703d36-89e4-4ea3-a40b-e1cd8a083470 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:21.486781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:21.538288 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd6040-f3fc-4b3f-a0bb-f71e3564584b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:21.588222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2cfa0-22e8-4d71-b8b6-ebebf5c93076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:21.589192 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2cfa0-22e8-4d71-b8b6-ebebf5c93076 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:21.589579 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2cfa0-22e8-4d71-b8b6-ebebf5c93076 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:21.589861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2cfa0-22e8-4d71-b8b6-ebebf5c93076 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:21.590647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2cfa0-22e8-4d71-b8b6-ebebf5c93076 None admin] RBAC: Adding query filter params (name=reader) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:21.590984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2cfa0-22e8-4d71-b8b6-ebebf5c93076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:21.592571 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2cfa0-22e8-4d71-b8b6-ebebf5c93076 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:21.603586 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 182/369] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:34:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:21.604431 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2cfa0-22e8-4d71-b8b6-ebebf5c93076 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:21.607657 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0703d36-89e4-4ea3-a40b-e1cd8a083470 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:21.651208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df39fd-5fdf-42e2-9202-2ce11f3c27a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:21.652835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df39fd-5fdf-42e2-9202-2ce11f3c27a0 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:21.653399 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df39fd-5fdf-42e2-9202-2ce11f3c27a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:21.653687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df39fd-5fdf-42e2-9202-2ce11f3c27a0 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:21.654457 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df39fd-5fdf-42e2-9202-2ce11f3c27a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:21.654772 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df39fd-5fdf-42e2-9202-2ce11f3c27a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:21.657156 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df39fd-5fdf-42e2-9202-2ce11f3c27a0 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:21.668253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 188/370] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:21.669208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df39fd-5fdf-42e2-9202-2ce11f3c27a0 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:21.673036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:21.742594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2cfa0-22e8-4d71-b8b6-ebebf5c93076 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:21.770361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:21.789100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af66dee-c3c6-4276-a6e6-5ae7287b2bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:21.789980 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af66dee-c3c6-4276-a6e6-5ae7287b2bf4 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:21.790306 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af66dee-c3c6-4276-a6e6-5ae7287b2bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:21.790586 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af66dee-c3c6-4276-a6e6-5ae7287b2bf4 None admin] PATH_INFO: `/v3/groups/0506c68c6ac54279bbafd35465886bc5` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:21.792013 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af66dee-c3c6-4276-a6e6-5ae7287b2bf4 None admin] RBAC: Authorizing `identity:get_group(group_id=0506c68c6ac54279bbafd35465886bc5)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:21.793453 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af66dee-c3c6-4276-a6e6-5ae7287b2bf4 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:21.795417 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 183/371] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jul 19 20:34:21 2022] GET /identity/v3/groups/0506c68c6ac54279bbafd35465886bc5 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:21.797149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af66dee-c3c6-4276-a6e6-5ae7287b2bf4 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:21.797734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df39fd-5fdf-42e2-9202-2ce11f3c27a0 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:21.858308 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04012b57-7cfb-4a61-ae88-75a4e6e0900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:21.859201 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04012b57-7cfb-4a61-ae88-75a4e6e0900b None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:21.859666 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04012b57-7cfb-4a61-ae88-75a4e6e0900b None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:21.859954 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04012b57-7cfb-4a61-ae88-75a4e6e0900b None admin] PATH_INFO: `/v3/groups/0506c68c6ac54279bbafd35465886bc5` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:21.861304 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04012b57-7cfb-4a61-ae88-75a4e6e0900b None admin] RBAC: Authorizing `identity:get_group(group_id=0506c68c6ac54279bbafd35465886bc5)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:21.863015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04012b57-7cfb-4a61-ae88-75a4e6e0900b None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:21.866198 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 189/372] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jul 19 20:34:21 2022] GET /identity/v3/groups/0506c68c6ac54279bbafd35465886bc5 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:21.867000 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04012b57-7cfb-4a61-ae88-75a4e6e0900b None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:21.930856 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af66dee-c3c6-4276-a6e6-5ae7287b2bf4 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:21.969295 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:21.974105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666e8b9-a5a5-41ab-96a4-7a36768bb20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:21.975001 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666e8b9-a5a5-41ab-96a4-7a36768bb20a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:21.975303 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666e8b9-a5a5-41ab-96a4-7a36768bb20a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:21.975588 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666e8b9-a5a5-41ab-96a4-7a36768bb20a None admin] PATH_INFO: `/v3/users/b36a8653148846cfa5966bd9fa80f49e` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:21.976822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666e8b9-a5a5-41ab-96a4-7a36768bb20a None admin] RBAC: Authorizing `identity:get_user(user_id=b36a8653148846cfa5966bd9fa80f49e)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:21.978260 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666e8b9-a5a5-41ab-96a4-7a36768bb20a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:21.980254 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 184/373] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:34:21 2022] GET /identity/v3/users/b36a8653148846cfa5966bd9fa80f49e => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:21.981098 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666e8b9-a5a5-41ab-96a4-7a36768bb20a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:21.993603 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04012b57-7cfb-4a61-ae88-75a4e6e0900b None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:22.037693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d338e6-0be8-45e3-9f3b-220b7cfc5d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:22.038362 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d338e6-0be8-45e3-9f3b-220b7cfc5d22 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:22.038841 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d338e6-0be8-45e3-9f3b-220b7cfc5d22 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:22.039128 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d338e6-0be8-45e3-9f3b-220b7cfc5d22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:22.057186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:22.118265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666e8b9-a5a5-41ab-96a4-7a36768bb20a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:22.125451 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d338e6-0be8-45e3-9f3b-220b7cfc5d22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:22.126973 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d338e6-0be8-45e3-9f3b-220b7cfc5d22 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:22.157049 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ac274-4ccc-4bf9-bf7f-9b69c7c285db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:22.157815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ac274-4ccc-4bf9-bf7f-9b69c7c285db None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:22.158107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ac274-4ccc-4bf9-bf7f-9b69c7c285db None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:22.158678 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ac274-4ccc-4bf9-bf7f-9b69c7c285db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:22.159654 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ac274-4ccc-4bf9-bf7f-9b69c7c285db None admin] RBAC: Adding query filter params (group.id=0506c68c6ac54279bbafd35465886bc5, role.id=a2021efb2e4e459cbfa73f6987297bca, scope.project.id=7763226124204b95a4f39f7d36e13a32) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:22.159973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ac274-4ccc-4bf9-bf7f-9b69c7c285db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:22.161507 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ac274-4ccc-4bf9-bf7f-9b69c7c285db None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:22.167940 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 185/374] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Jul 19 20:34:21 2022] GET /identity/v3/role_assignments?group.id=0506c68c6ac54279bbafd35465886bc5&scope.project.id=7763226124204b95a4f39f7d36e13a32&role.id=a2021efb2e4e459cbfa73f6987297bca => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:22.168572 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ac274-4ccc-4bf9-bf7f-9b69c7c285db None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:22.211669 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:22.243306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 190/375] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:22.243493 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d338e6-0be8-45e3-9f3b-220b7cfc5d22 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:22.344089 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ac274-4ccc-4bf9-bf7f-9b69c7c285db None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:22.379700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:22.398388 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d338e6-0be8-45e3-9f3b-220b7cfc5d22 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:22.401111 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511d5d4-2fe2-4acc-8006-a8d58cc8ed77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:22.403306 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511d5d4-2fe2-4acc-8006-a8d58cc8ed77 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:22.403306 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511d5d4-2fe2-4acc-8006-a8d58cc8ed77 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:22.403306 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511d5d4-2fe2-4acc-8006-a8d58cc8ed77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:22.403306 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511d5d4-2fe2-4acc-8006-a8d58cc8ed77 None admin] RBAC: Adding query filter params (group.id=0506c68c6ac54279bbafd35465886bc5, role.id=92567de587bf40dab488cc1eb666b221, scope.project.id=7763226124204b95a4f39f7d36e13a32) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:22.403609 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511d5d4-2fe2-4acc-8006-a8d58cc8ed77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:22.405544 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511d5d4-2fe2-4acc-8006-a8d58cc8ed77 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:22.412283 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 186/376] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Jul 19 20:34:22 2022] GET /identity/v3/role_assignments?group.id=0506c68c6ac54279bbafd35465886bc5&scope.project.id=7763226124204b95a4f39f7d36e13a32&role.id=92567de587bf40dab488cc1eb666b221 => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:22.413123 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511d5d4-2fe2-4acc-8006-a8d58cc8ed77 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:22.461766 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b99587-d496-4b80-87c1-9486c84cebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:22.462865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b99587-d496-4b80-87c1-9486c84cebab None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:22.463152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b99587-d496-4b80-87c1-9486c84cebab None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:22.463457 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b99587-d496-4b80-87c1-9486c84cebab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:22.464968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b99587-d496-4b80-87c1-9486c84cebab None admin] RBAC: Adding query filter params (role.id=61e37a77948648d989c2ba2222b6fe6f, user.id=b36a8653148846cfa5966bd9fa80f49e, scope.system=all) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:22.465287 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b99587-d496-4b80-87c1-9486c84cebab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:22.466989 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b99587-d496-4b80-87c1-9486c84cebab None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:22.485274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 191/377] 10.222.0.77 () {56 vars in 1308 bytes} [Tue Jul 19 20:34:22 2022] GET /identity/v3/role_assignments?user.id=b36a8653148846cfa5966bd9fa80f49e&scope.system=all&role.id=61e37a77948648d989c2ba2222b6fe6f => generated 510 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:22.486908 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c5c13-d686-4c13-993c-08ea6099f3e9 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:22.487200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c5c13-d686-4c13-993c-08ea6099f3e9 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:22.487567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c5c13-d686-4c13-993c-08ea6099f3e9 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:22.490508 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 192/378] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:22.498859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0368470-de1a-4573-b4d4-23b94b2fdf87 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:22.499309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0368470-de1a-4573-b4d4-23b94b2fdf87 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:22.499601 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0368470-de1a-4573-b4d4-23b94b2fdf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:22.532943 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-e0368470-de1a-4573-b4d4-23b94b2fdf87 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:22.534912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e0368470-de1a-4573-b4d4-23b94b2fdf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:22.568932 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511d5d4-2fe2-4acc-8006-a8d58cc8ed77 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:22.588523 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:22.632960 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835c7a1-d8ce-42b2-acf6-cb2a15bb2f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:22.634195 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835c7a1-d8ce-42b2-acf6-cb2a15bb2f93 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:22.634641 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835c7a1-d8ce-42b2-acf6-cb2a15bb2f93 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:22.635057 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835c7a1-d8ce-42b2-acf6-cb2a15bb2f93 None admin] PATH_INFO: `/v3/projects/f4e53da4f0744609812a487b0656c7b7` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:22.637722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835c7a1-d8ce-42b2-acf6-cb2a15bb2f93 None admin] RBAC: Authorizing `identity:get_project(project_id=f4e53da4f0744609812a487b0656c7b7)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:22.643359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835c7a1-d8ce-42b2-acf6-cb2a15bb2f93 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:22.649037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 187/379] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:22 2022] GET /identity/v3/projects/f4e53da4f0744609812a487b0656c7b7 => generated 344 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:22.652434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835c7a1-d8ce-42b2-acf6-cb2a15bb2f93 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:22.687477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 193/380] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:34:22.709824 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0368470-de1a-4573-b4d4-23b94b2fdf87 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:22.729529 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:22.796356 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835c7a1-d8ce-42b2-acf6-cb2a15bb2f93 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:22.838733 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a5352-f94a-4ea7-864e-e1d07f69e1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:22.839647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a5352-f94a-4ea7-864e-e1d07f69e1ab None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:22.839928 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a5352-f94a-4ea7-864e-e1d07f69e1ab None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:22.840201 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a5352-f94a-4ea7-864e-e1d07f69e1ab None admin] PATH_INFO: `/v3/groups/6a77a1f352424c2eb05b26ba51ccd006` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:22.848196 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0368470-de1a-4573-b4d4-23b94b2fdf87 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:22.849712 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a5352-f94a-4ea7-864e-e1d07f69e1ab None admin] RBAC: Authorizing `identity:get_group(group_id=6a77a1f352424c2eb05b26ba51ccd006)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:22.851252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a5352-f94a-4ea7-864e-e1d07f69e1ab None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:22.853504 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 188/381] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jul 19 20:34:22 2022] GET /identity/v3/groups/6a77a1f352424c2eb05b26ba51ccd006 => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:22.859665 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a5352-f94a-4ea7-864e-e1d07f69e1ab None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:22.922767 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448f378-a78f-4e1b-b705-635cc1364f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:22.923695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448f378-a78f-4e1b-b705-635cc1364f01 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:22.923980 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448f378-a78f-4e1b-b705-635cc1364f01 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:22.924255 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448f378-a78f-4e1b-b705-635cc1364f01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:22.944003 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1448f378-a78f-4e1b-b705-635cc1364f01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:22.963724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-1448f378-a78f-4e1b-b705-635cc1364f01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:34:22.963724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:22.963724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:22.963724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:22.963724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:22.963724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:22.963724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:22.963724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:22.963724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:22.963724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:22.963724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:22.963724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:22.963724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:22.963724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:22.963724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:22.963724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:22.964680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:22.964680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:22.964680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:22.964680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:22.964680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:22.964680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:22.964680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:22.964680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:22.964680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:22.964680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:22.964680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:22.964680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:22.964680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:22.964680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:22.964680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:22.964680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:22.965486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:22.965486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:22.965486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:22.965486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:22.965486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:22.965486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:22.965486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:22.965486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:22.965486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:22.965486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:22.965486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:34:22.965486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:22.965486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 194/382] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jul 19 20:34:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:22.988342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a5352-f94a-4ea7-864e-e1d07f69e1ab None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:22.988845 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448f378-a78f-4e1b-b705-635cc1364f01 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:23.013631 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:23.024477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:23.029801 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888e684-1802-4c01-9606-b0465675a182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:23.030468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888e684-1802-4c01-9606-b0465675a182 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:23.030750 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888e684-1802-4c01-9606-b0465675a182 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:23.031026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888e684-1802-4c01-9606-b0465675a182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:23.034250 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888e684-1802-4c01-9606-b0465675a182 None admin] RBAC: Adding query filter params (group.id=6a77a1f352424c2eb05b26ba51ccd006, role.id=b30f01ef95004a1b84fc029830bdf053, scope.project.id=f4e53da4f0744609812a487b0656c7b7) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:23.035112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888e684-1802-4c01-9606-b0465675a182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:23.036847 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888e684-1802-4c01-9606-b0465675a182 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:23.046613 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 189/383] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Jul 19 20:34:22 2022] GET /identity/v3/role_assignments?group.id=6a77a1f352424c2eb05b26ba51ccd006&scope.project.id=f4e53da4f0744609812a487b0656c7b7&role.id=b30f01ef95004a1b84fc029830bdf053 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:23.126248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1448f378-a78f-4e1b-b705-635cc1364f01 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:23.167711 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dd5e3-fbe2-4b80-b6f0-d1870ff08fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:23.168320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dd5e3-fbe2-4b80-b6f0-d1870ff08fb1 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:23.168603 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dd5e3-fbe2-4b80-b6f0-d1870ff08fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:23.168876 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dd5e3-fbe2-4b80-b6f0-d1870ff08fb1 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:23.169656 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44dd5e3-fbe2-4b80-b6f0-d1870ff08fb1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:23.169962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44dd5e3-fbe2-4b80-b6f0-d1870ff08fb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:23.171436 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44dd5e3-fbe2-4b80-b6f0-d1870ff08fb1 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:23.185549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 195/384] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:23.186964 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888e684-1802-4c01-9606-b0465675a182 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:23.297131 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888e684-1802-4c01-9606-b0465675a182 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:23.334814 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e44867-80d4-4cb5-9726-6e643a86e1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:23.335739 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e44867-80d4-4cb5-9726-6e643a86e1c3 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:23.336016 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e44867-80d4-4cb5-9726-6e643a86e1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:23.336286 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e44867-80d4-4cb5-9726-6e643a86e1c3 None admin] PATH_INFO: `/v3/groups/0506c68c6ac54279bbafd35465886bc5` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:23.337545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e44867-80d4-4cb5-9726-6e643a86e1c3 None admin] RBAC: Authorizing `identity:get_group(group_id=0506c68c6ac54279bbafd35465886bc5)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:23.338976 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e44867-80d4-4cb5-9726-6e643a86e1c3 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:23.343286 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 190/385] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jul 19 20:34:23 2022] GET /identity/v3/groups/0506c68c6ac54279bbafd35465886bc5 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:23.346742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dd5e3-fbe2-4b80-b6f0-d1870ff08fb1 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:23.454909 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:23.481996 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dd5e3-fbe2-4b80-b6f0-d1870ff08fb1 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:23.529681 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6944e6a-89e5-48c3-b8b5-e4cb710d99a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:23.530558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6944e6a-89e5-48c3-b8b5-e4cb710d99a9 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:23.530842 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6944e6a-89e5-48c3-b8b5-e4cb710d99a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:23.531127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6944e6a-89e5-48c3-b8b5-e4cb710d99a9 None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:23.532361 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6944e6a-89e5-48c3-b8b5-e4cb710d99a9 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf9c36dd93649fb92ed3e7f9f20258d)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:23.534051 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6944e6a-89e5-48c3-b8b5-e4cb710d99a9 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:23.535833 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 196/386] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:23 2022] GET /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:23.542074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e44867-80d4-4cb5-9726-6e643a86e1c3 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:23.609665 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:23.661835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e1533-347b-45a9-81e5-2b7bbcc0d9a4 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:23.662165 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e1533-347b-45a9-81e5-2b7bbcc0d9a4 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:23.662411 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e1533-347b-45a9-81e5-2b7bbcc0d9a4 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:23.664852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 197/387] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:23.669182 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db279504-f9b3-481b-aced-042de9b15e69 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:23.669475 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db279504-f9b3-481b-aced-042de9b15e69 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:23.669756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db279504-f9b3-481b-aced-042de9b15e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:23.673232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e44867-80d4-4cb5-9726-6e643a86e1c3 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:23.695489 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-db279504-f9b3-481b-aced-042de9b15e69 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:23.696682 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-db279504-f9b3-481b-aced-042de9b15e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:23.713142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e3a91-b40d-4626-988a-9af1bdf3dfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:23.714284 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e3a91-b40d-4626-988a-9af1bdf3dfaa None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:23.714712 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e3a91-b40d-4626-988a-9af1bdf3dfaa None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:23.715138 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e3a91-b40d-4626-988a-9af1bdf3dfaa None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d/groups/0506c68c6ac54279bbafd35465886bc5/roles/92567de587bf40dab488cc1eb666b221` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:23.721084 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e3a91-b40d-4626-988a-9af1bdf3dfaa None admin] RBAC: Authorizing `identity:create_grant(project_id=8bf9c36dd93649fb92ed3e7f9f20258d, group_id=0506c68c6ac54279bbafd35465886bc5, role_id=92567de587bf40dab488cc1eb666b221)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:23.723370 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e3a91-b40d-4626-988a-9af1bdf3dfaa None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:23.751958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 191/388] 10.222.0.77 () {58 vars in 1442 bytes} [Tue Jul 19 20:34:23 2022] PUT /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d/groups/0506c68c6ac54279bbafd35465886bc5/roles/92567de587bf40dab488cc1eb666b221 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:34:23.791143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 198/389] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:23.836193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e3a91-b40d-4626-988a-9af1bdf3dfaa None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:23.964867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e3a91-b40d-4626-988a-9af1bdf3dfaa None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:23.974341 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:24.001968 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9aebd-3d78-415a-b1e8-5294b5bd6438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:24.002789 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9aebd-3d78-415a-b1e8-5294b5bd6438 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:24.003637 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9aebd-3d78-415a-b1e8-5294b5bd6438 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:24.003915 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9aebd-3d78-415a-b1e8-5294b5bd6438 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:24.014802 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9aebd-3d78-415a-b1e8-5294b5bd6438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:24.023296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-3da9aebd-3d78-415a-b1e8-5294b5bd6438 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:24.023296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:24.023296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:24.023296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:24.023296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:24.023296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:24.023296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:24.023296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:24.023296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:24.023296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:24.023296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:24.023296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:24.023296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:24.023296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:24.023296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:24.023296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:24.024223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:24.024223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:24.024223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:24.024223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:24.024223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:24.024223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:24.024223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:24.024223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:24.024223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:24.024223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:24.024223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:24.024223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:24.024223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:24.024223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:24.024223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:24.024223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:24.025027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:24.025027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:24.025027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:24.025027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:24.025027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:24.025027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:24.025027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:24.025027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:24.025027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:24.025027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:24.025027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:24.025027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:24.025027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 192/390] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:24.030751 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db279504-f9b3-481b-aced-042de9b15e69 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:24.137966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:24.161432 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db279504-f9b3-481b-aced-042de9b15e69 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:24.198874 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abe7db-2a1f-44a3-a8c9-92f5b3ba6d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:24.200024 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abe7db-2a1f-44a3-a8c9-92f5b3ba6d05 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:24.200536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abe7db-2a1f-44a3-a8c9-92f5b3ba6d05 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:24.201008 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abe7db-2a1f-44a3-a8c9-92f5b3ba6d05 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:24.201971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abe7db-2a1f-44a3-a8c9-92f5b3ba6d05 None admin] RBAC: Adding query filter params (name=member) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:24.202472 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abe7db-2a1f-44a3-a8c9-92f5b3ba6d05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:24.204075 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abe7db-2a1f-44a3-a8c9-92f5b3ba6d05 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:24.218777 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 199/391] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:34:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:24.224411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9aebd-3d78-415a-b1e8-5294b5bd6438 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:24.380473 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9aebd-3d78-415a-b1e8-5294b5bd6438 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:24.433317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117376b-9297-4487-a739-e49414b6c1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:24.434561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117376b-9297-4487-a739-e49414b6c1a3 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:24.435043 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117376b-9297-4487-a739-e49414b6c1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:24.435538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9117376b-9297-4487-a739-e49414b6c1a3 None admin] PATH_INFO: `/v3/groups/0506c68c6ac54279bbafd35465886bc5` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:24.436981 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117376b-9297-4487-a739-e49414b6c1a3 None admin] RBAC: Authorizing `identity:get_group(group_id=0506c68c6ac54279bbafd35465886bc5)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:24.438625 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9117376b-9297-4487-a739-e49414b6c1a3 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:24.440535 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 193/392] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jul 19 20:34:24 2022] GET /identity/v3/groups/0506c68c6ac54279bbafd35465886bc5 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:24.446611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abe7db-2a1f-44a3-a8c9-92f5b3ba6d05 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:24.575958 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abe7db-2a1f-44a3-a8c9-92f5b3ba6d05 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:24.618707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad685768-b5cb-46cb-bc7d-57d7a817250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:24.619957 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad685768-b5cb-46cb-bc7d-57d7a817250b None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:24.620446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad685768-b5cb-46cb-bc7d-57d7a817250b None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:24.620919 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad685768-b5cb-46cb-bc7d-57d7a817250b None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:24.622334 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad685768-b5cb-46cb-bc7d-57d7a817250b None admin] RBAC: Authorizing `identity:get_project(project_id=8bf9c36dd93649fb92ed3e7f9f20258d)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:24.624025 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad685768-b5cb-46cb-bc7d-57d7a817250b None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:24.625955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 200/393] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:24 2022] GET /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:24.632201 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117376b-9297-4487-a739-e49414b6c1a3 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:24.684375 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:24.778095 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9117376b-9297-4487-a739-e49414b6c1a3 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:24.829900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be54e2-fe75-4cc7-9896-86735cd5df2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:24.831046 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be54e2-fe75-4cc7-9896-86735cd5df2b None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:24.831543 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be54e2-fe75-4cc7-9896-86735cd5df2b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:24.831965 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be54e2-fe75-4cc7-9896-86735cd5df2b None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d/groups/0506c68c6ac54279bbafd35465886bc5/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:24.840352 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be54e2-fe75-4cc7-9896-86735cd5df2b None admin] RBAC: Authorizing `identity:create_grant(project_id=8bf9c36dd93649fb92ed3e7f9f20258d, group_id=0506c68c6ac54279bbafd35465886bc5, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:24.842138 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be54e2-fe75-4cc7-9896-86735cd5df2b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:24.857982 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 194/394] 10.222.0.77 () {58 vars in 1442 bytes} [Tue Jul 19 20:34:24 2022] PUT /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d/groups/0506c68c6ac54279bbafd35465886bc5/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:34:24.905812 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca45218-54f2-445f-b27c-e56b01e4775c None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:24.906260 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca45218-54f2-445f-b27c-e56b01e4775c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:24.906641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca45218-54f2-445f-b27c-e56b01e4775c None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:24.908380 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 201/395] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:24.914449 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd25ac-5200-48a3-8be4-ce9ab5798577 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:24.914847 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd25ac-5200-48a3-8be4-ce9ab5798577 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:24.915233 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd25ac-5200-48a3-8be4-ce9ab5798577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:24.933298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-d2dd25ac-5200-48a3-8be4-ce9ab5798577 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:24.934504 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d2dd25ac-5200-48a3-8be4-ce9ab5798577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:25.021806 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 195/396] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:25.060521 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca45218-54f2-445f-b27c-e56b01e4775c None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:25.074333 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:25.193258 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca45218-54f2-445f-b27c-e56b01e4775c None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:25.228555 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6e615-9e16-41e9-8b43-b710aaf0d1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:25.229375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6e615-9e16-41e9-8b43-b710aaf0d1cb None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:25.229655 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6e615-9e16-41e9-8b43-b710aaf0d1cb None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:25.229927 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6e615-9e16-41e9-8b43-b710aaf0d1cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:25.241210 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6e615-9e16-41e9-8b43-b710aaf0d1cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:25.249473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-3aa6e615-9e16-41e9-8b43-b710aaf0d1cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:25.249473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:25.249473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:25.249473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:25.249473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:25.249473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:25.249473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:25.249473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:25.249473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:25.249473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:25.249473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:25.249473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:25.249473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:25.249473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:25.249473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:25.249473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:25.250378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:25.250378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:25.250378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:25.250378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:25.250378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:25.250378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:25.250378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:25.250378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:25.250378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:25.250378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:25.250378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:25.250378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:25.250378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:25.250378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:25.250378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:25.250378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:25.251208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:25.251208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:25.251208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:25.251208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:25.251208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:25.251208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:25.251208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:25.251208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:25.251208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:25.251208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:25.251208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:25.251208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:25.251208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 202/397] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:34:25.256716 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd25ac-5200-48a3-8be4-ce9ab5798577 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:25.289720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:25.368209 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd25ac-5200-48a3-8be4-ce9ab5798577 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:25.403577 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c451f4-5a93-458e-9956-a9d92432f7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:25.404418 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c451f4-5a93-458e-9956-a9d92432f7a6 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:25.404700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c451f4-5a93-458e-9956-a9d92432f7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:25.404976 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c451f4-5a93-458e-9956-a9d92432f7a6 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:25.405724 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c451f4-5a93-458e-9956-a9d92432f7a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:25.406031 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c451f4-5a93-458e-9956-a9d92432f7a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:25.407485 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c451f4-5a93-458e-9956-a9d92432f7a6 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:25.417275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 196/398] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:34:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:25.423867 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6e615-9e16-41e9-8b43-b710aaf0d1cb None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:25.471116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581b53c-22d1-4c3f-9c35-1bb6206b277e None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:25.471443 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581b53c-22d1-4c3f-9c35-1bb6206b277e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:25.471689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581b53c-22d1-4c3f-9c35-1bb6206b277e None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:25.473687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 197/399] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:34:25.490322 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cd684-406d-44b6-82b5-671cc0052839 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:25.490683 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cd684-406d-44b6-82b5-671cc0052839 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:25.490858 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cd684-406d-44b6-82b5-671cc0052839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:25.512881 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-6b8cd684-406d-44b6-82b5-671cc0052839 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:25.514083 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-6b8cd684-406d-44b6-82b5-671cc0052839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:25.551698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:25.581325 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6e615-9e16-41e9-8b43-b710aaf0d1cb None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:25.617097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9518c4b-6dde-4d40-bf99-f69a5eeec341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:25.618203 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9518c4b-6dde-4d40-bf99-f69a5eeec341 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:25.618625 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9518c4b-6dde-4d40-bf99-f69a5eeec341 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:25.619066 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9518c4b-6dde-4d40-bf99-f69a5eeec341 None admin] PATH_INFO: `/v3/groups/0506c68c6ac54279bbafd35465886bc5` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:25.620754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9518c4b-6dde-4d40-bf99-f69a5eeec341 None admin] RBAC: Authorizing `identity:get_group(group_id=0506c68c6ac54279bbafd35465886bc5)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:25.622325 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9518c4b-6dde-4d40-bf99-f69a5eeec341 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:25.627647 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 203/400] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jul 19 20:34:25 2022] GET /identity/v3/groups/0506c68c6ac54279bbafd35465886bc5 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:25.631009 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9518c4b-6dde-4d40-bf99-f69a5eeec341 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:25.687283 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 198/401] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:34:25.736422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cd684-406d-44b6-82b5-671cc0052839 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:25.760155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9518c4b-6dde-4d40-bf99-f69a5eeec341 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:25.777637 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:25.828017 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1745474-9ea0-4df9-a204-b72583ad7226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:25.829203 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1745474-9ea0-4df9-a204-b72583ad7226 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:25.830432 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1745474-9ea0-4df9-a204-b72583ad7226 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:25.831110 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1745474-9ea0-4df9-a204-b72583ad7226 None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:25.834590 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1745474-9ea0-4df9-a204-b72583ad7226 None admin] RBAC: Authorizing `identity:get_project(project_id=7763226124204b95a4f39f7d36e13a32)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:25.837460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1745474-9ea0-4df9-a204-b72583ad7226 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:25.842232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 204/402] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:25 2022] GET /identity/v3/projects/7763226124204b95a4f39f7d36e13a32 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:25.848476 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1745474-9ea0-4df9-a204-b72583ad7226 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:25.865357 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:25.917671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cd684-406d-44b6-82b5-671cc0052839 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:25.983469 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e72b26-c8f2-497c-9f16-576d5d6f309b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:25.984289 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e72b26-c8f2-497c-9f16-576d5d6f309b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:25.984654 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e72b26-c8f2-497c-9f16-576d5d6f309b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:25.984936 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e72b26-c8f2-497c-9f16-576d5d6f309b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:26.008640 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e72b26-c8f2-497c-9f16-576d5d6f309b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:26.019636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-36e72b26-c8f2-497c-9f16-576d5d6f309b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:34:26.019636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:26.019636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:26.019636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:26.019636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:26.019636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:26.019636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:26.019636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:26.019636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:26.019636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:26.019636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:26.019636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:26.019636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:26.019636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:26.019636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:26.019636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:26.020569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:26.020569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:26.020569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:26.020569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:26.020569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:26.020569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:26.020569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:26.020569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:26.020569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:26.020569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:26.020569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:26.020569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:26.020569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:26.020569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:26.020569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:26.020569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:26.021369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:26.021369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:26.021369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:26.021369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:26.021369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:26.021369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:26.021369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:26.021369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:26.021369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:26.021369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:26.021369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:34:26.021369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:26.028076 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 199/403] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jul 19 20:34:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:26.031611 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e72b26-c8f2-497c-9f16-576d5d6f309b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:26.038088 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1745474-9ea0-4df9-a204-b72583ad7226 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:26.091825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4138931-d7e9-4e38-8980-781774561718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:26.093553 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4138931-d7e9-4e38-8980-781774561718 None admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:26.094020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4138931-d7e9-4e38-8980-781774561718 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:26.094491 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4138931-d7e9-4e38-8980-781774561718 None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32/groups/0506c68c6ac54279bbafd35465886bc5/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:26.097681 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4138931-d7e9-4e38-8980-781774561718 None admin] RBAC: Authorizing `identity:create_grant(project_id=7763226124204b95a4f39f7d36e13a32, group_id=0506c68c6ac54279bbafd35465886bc5, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:26.099750 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4138931-d7e9-4e38-8980-781774561718 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:26.120170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 205/404] 10.222.0.77 () {58 vars in 1442 bytes} [Tue Jul 19 20:34:25 2022] PUT /identity/v3/projects/7763226124204b95a4f39f7d36e13a32/groups/0506c68c6ac54279bbafd35465886bc5/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:34:26.122600 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c3a81-788b-48ed-a0b1-c3e08657b880 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:26.123035 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c3a81-788b-48ed-a0b1-c3e08657b880 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:26.123484 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c3a81-788b-48ed-a0b1-c3e08657b880 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:26.125430 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 206/405] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:26.133156 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd6050-b25c-415c-b0f2-50420a26789a None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:26.133778 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd6050-b25c-415c-b0f2-50420a26789a None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:26.134379 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd6050-b25c-415c-b0f2-50420a26789a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:26.141186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:26.156456 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-1dbd6050-b25c-415c-b0f2-50420a26789a None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:26.158307 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-1dbd6050-b25c-415c-b0f2-50420a26789a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:26.213859 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e72b26-c8f2-497c-9f16-576d5d6f309b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:26.236332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:26.247544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 207/406] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:34:26.274823 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068003d1-b310-4908-96fe-4de7f543e7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:26.275859 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068003d1-b310-4908-96fe-4de7f543e7a4 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:26.276348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068003d1-b310-4908-96fe-4de7f543e7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:26.276798 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068003d1-b310-4908-96fe-4de7f543e7a4 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:26.277731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068003d1-b310-4908-96fe-4de7f543e7a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:26.278255 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068003d1-b310-4908-96fe-4de7f543e7a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:26.279970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068003d1-b310-4908-96fe-4de7f543e7a4 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:26.284427 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd6050-b25c-415c-b0f2-50420a26789a None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:26.307162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 200/407] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:26.315295 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068003d1-b310-4908-96fe-4de7f543e7a4 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:26.413699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd6050-b25c-415c-b0f2-50420a26789a None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:26.440494 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068003d1-b310-4908-96fe-4de7f543e7a4 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:26.462274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3a608-a642-436c-9dac-b5308de060a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:26.463463 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3a608-a642-436c-9dac-b5308de060a9 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:26.464548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3a608-a642-436c-9dac-b5308de060a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:26.465022 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3a608-a642-436c-9dac-b5308de060a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:26.479870 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8c31f-7f48-4775-bce5-fc2e7b9928e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:26.480696 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3a608-a642-436c-9dac-b5308de060a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:26.480807 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8c31f-7f48-4775-bce5-fc2e7b9928e4 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:26.481169 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8c31f-7f48-4775-bce5-fc2e7b9928e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:26.481518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8c31f-7f48-4775-bce5-fc2e7b9928e4 None admin] PATH_INFO: `/v3/groups/0506c68c6ac54279bbafd35465886bc5` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:26.482946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8c31f-7f48-4775-bce5-fc2e7b9928e4 None admin] RBAC: Authorizing `identity:get_group(group_id=0506c68c6ac54279bbafd35465886bc5)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:26.484538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8c31f-7f48-4775-bce5-fc2e7b9928e4 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:26.486714 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 201/408] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jul 19 20:34:26 2022] GET /identity/v3/groups/0506c68c6ac54279bbafd35465886bc5 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:26.492804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad214c05-6523-42b2-8b20-6ee57dea0971 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:26.492804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad214c05-6523-42b2-8b20-6ee57dea0971 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:26.492804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad214c05-6523-42b2-8b20-6ee57dea0971 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:26.492804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 202/409] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:26.493481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-55b3a608-a642-436c-9dac-b5308de060a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:34:26.493481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:26.493481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:26.493481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:26.493481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:26.493481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:26.493481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:26.493481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:26.493481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:26.493481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:26.493481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:26.493481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:26.493481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:26.493481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:26.493481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:26.493481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:26.494346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:26.494346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:26.494346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:26.494346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:26.494346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:26.494346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:26.494346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:26.494346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:26.494346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:26.494346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:26.494346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:26.494346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:26.494346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:26.494346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:26.494346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:26.494346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:26.495133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:26.495133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:26.495133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:26.495133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:26.495133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:26.495133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:26.495133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:26.495133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:26.495133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:26.495133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:26.495133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:34:26.495133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:26.495769 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad214c05-6523-42b2-8b20-6ee57dea0971 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:26.496564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 208/410] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:34:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:26.504368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a79960-6407-4429-ba5c-ebae8904dbae None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:26.504704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a79960-6407-4429-ba5c-ebae8904dbae None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:26.505102 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a79960-6407-4429-ba5c-ebae8904dbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:26.509719 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:26.526930 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-95a79960-6407-4429-ba5c-ebae8904dbae None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:26.528147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-95a79960-6407-4429-ba5c-ebae8904dbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:26.588437 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:26.610125 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 209/411] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:26.610752 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a79960-6407-4429-ba5c-ebae8904dbae None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:26.636848 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad214c05-6523-42b2-8b20-6ee57dea0971 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:26.683164 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc76eb-2c12-458c-ac41-cca4c27552cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:26.685077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc76eb-2c12-458c-ac41-cca4c27552cc None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:26.685834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc76eb-2c12-458c-ac41-cca4c27552cc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:26.686313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc76eb-2c12-458c-ac41-cca4c27552cc None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:26.688830 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc76eb-2c12-458c-ac41-cca4c27552cc None admin] RBAC: Authorizing `identity:get_project(project_id=7763226124204b95a4f39f7d36e13a32)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:26.690482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc76eb-2c12-458c-ac41-cca4c27552cc None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:26.693241 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 203/412] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:26 2022] GET /identity/v3/projects/7763226124204b95a4f39f7d36e13a32 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:26.697883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc76eb-2c12-458c-ac41-cca4c27552cc None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:26.728908 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a79960-6407-4429-ba5c-ebae8904dbae None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:26.772328 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fc65f-398b-43b1-b9ad-8ad6e9c321eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:26.773885 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fc65f-398b-43b1-b9ad-8ad6e9c321eb None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:26.774351 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fc65f-398b-43b1-b9ad-8ad6e9c321eb None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:26.774802 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fc65f-398b-43b1-b9ad-8ad6e9c321eb None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:26.775764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fc65f-398b-43b1-b9ad-8ad6e9c321eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:26.776419 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fc65f-398b-43b1-b9ad-8ad6e9c321eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:26.778516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fc65f-398b-43b1-b9ad-8ad6e9c321eb None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:26.790896 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 210/413] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:26.792343 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fc65f-398b-43b1-b9ad-8ad6e9c321eb None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:26.795766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:26.827659 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc76eb-2c12-458c-ac41-cca4c27552cc None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:26.851038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:26.873533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c019b11-aa78-459a-9de1-da742549dc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:26.874835 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c019b11-aa78-459a-9de1-da742549dc00 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:26.876108 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c019b11-aa78-459a-9de1-da742549dc00 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:26.876567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c019b11-aa78-459a-9de1-da742549dc00 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:26.897637 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c019b11-aa78-459a-9de1-da742549dc00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:26.904459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-3c019b11-aa78-459a-9de1-da742549dc00 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:34:26.904459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:26.904459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:26.904459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:26.904459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:26.904459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:26.904459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:26.904459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:26.904459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:26.904459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:26.904459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:26.904459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:26.904459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:26.904459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:26.904459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:26.904459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:26.905344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:26.905344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:26.905344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:26.905344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:26.905344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:26.905344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:26.905344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:26.905344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:26.905344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:26.905344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:26.905344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:26.905344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:26.905344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:26.905344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:26.905344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:26.905344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:26.906178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:26.906178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:26.906178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:26.906178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:26.906178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:26.906178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:26.906178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:26.906178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:26.906178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:26.906178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:26.906178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:34:26.906178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:26.911286 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 204/414] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jul 19 20:34:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:26.912132 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c019b11-aa78-459a-9de1-da742549dc00 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:26.926930 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fc65f-398b-43b1-b9ad-8ad6e9c321eb None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:26.973380 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be876a6b-ba08-484f-a2f5-2a4b0684b89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:26.974252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be876a6b-ba08-484f-a2f5-2a4b0684b89d None admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:26.974601 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be876a6b-ba08-484f-a2f5-2a4b0684b89d None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:26.975012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be876a6b-ba08-484f-a2f5-2a4b0684b89d None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32/groups/0506c68c6ac54279bbafd35465886bc5/roles/92567de587bf40dab488cc1eb666b221` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:26.977404 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be876a6b-ba08-484f-a2f5-2a4b0684b89d None admin] RBAC: Authorizing `identity:create_grant(project_id=7763226124204b95a4f39f7d36e13a32, group_id=0506c68c6ac54279bbafd35465886bc5, role_id=92567de587bf40dab488cc1eb666b221)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:26.978970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be876a6b-ba08-484f-a2f5-2a4b0684b89d None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:27.001108 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 211/415] 10.222.0.77 () {58 vars in 1442 bytes} [Tue Jul 19 20:34:26 2022] PUT /identity/v3/projects/7763226124204b95a4f39f7d36e13a32/groups/0506c68c6ac54279bbafd35465886bc5/roles/92567de587bf40dab488cc1eb666b221 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:34:27.001108 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be876a6b-ba08-484f-a2f5-2a4b0684b89d None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:27.074697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c019b11-aa78-459a-9de1-da742549dc00 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:27.139704 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18f734-b783-42c4-9a28-f2cbd4f53726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:27.140691 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18f734-b783-42c4-9a28-f2cbd4f53726 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:27.140976 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18f734-b783-42c4-9a28-f2cbd4f53726 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:27.141247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18f734-b783-42c4-9a28-f2cbd4f53726 None admin] PATH_INFO: `/v3/groups/6a77a1f352424c2eb05b26ba51ccd006` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:27.142460 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18f734-b783-42c4-9a28-f2cbd4f53726 None admin] RBAC: Authorizing `identity:get_group(group_id=6a77a1f352424c2eb05b26ba51ccd006)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:27.144527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18f734-b783-42c4-9a28-f2cbd4f53726 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:27.146214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 205/416] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jul 19 20:34:26 2022] GET /identity/v3/groups/6a77a1f352424c2eb05b26ba51ccd006 => generated 229 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:27.156434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18f734-b783-42c4-9a28-f2cbd4f53726 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:27.160972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be876a6b-ba08-484f-a2f5-2a4b0684b89d None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:27.161093 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:27.172817 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:27.203426 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbfd7b-d247-4047-8f47-c7b10d1bc428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:27.204352 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbfd7b-d247-4047-8f47-c7b10d1bc428 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:27.204732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbfd7b-d247-4047-8f47-c7b10d1bc428 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:27.205107 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbfd7b-d247-4047-8f47-c7b10d1bc428 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:27.206078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbfd7b-d247-4047-8f47-c7b10d1bc428 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:27.206980 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbfd7b-d247-4047-8f47-c7b10d1bc428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:27.208467 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbfd7b-d247-4047-8f47-c7b10d1bc428 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:27.217736 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 212/417] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:27.223699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbfd7b-d247-4047-8f47-c7b10d1bc428 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:27.266304 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18f734-b783-42c4-9a28-f2cbd4f53726 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:27.302110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e0b0f-b233-401b-922b-8492795b47d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:27.302984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e0b0f-b233-401b-922b-8492795b47d1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:27.303284 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e0b0f-b233-401b-922b-8492795b47d1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:27.303573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e0b0f-b233-401b-922b-8492795b47d1 None admin] PATH_INFO: `/v3/projects/f4e53da4f0744609812a487b0656c7b7` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:27.304795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e0b0f-b233-401b-922b-8492795b47d1 None admin] RBAC: Authorizing `identity:get_project(project_id=f4e53da4f0744609812a487b0656c7b7)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:27.306252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e0b0f-b233-401b-922b-8492795b47d1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:27.308375 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 206/418] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:27 2022] GET /identity/v3/projects/f4e53da4f0744609812a487b0656c7b7 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:27.320616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e0b0f-b233-401b-922b-8492795b47d1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:27.402508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:27.406830 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbfd7b-d247-4047-8f47-c7b10d1bc428 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:27.440512 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e0b0f-b233-401b-922b-8492795b47d1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:27.479235 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6551c70-5c97-4e5e-99f1-ac4f6f9797a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:27.479691 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5feca2-a0c8-48d5-b375-ceebdf3399ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:27.480339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6551c70-5c97-4e5e-99f1-ac4f6f9797a4 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:27.480651 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5feca2-a0c8-48d5-b375-ceebdf3399ca None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:27.480948 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5feca2-a0c8-48d5-b375-ceebdf3399ca None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:27.481087 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6551c70-5c97-4e5e-99f1-ac4f6f9797a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:27.481248 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5feca2-a0c8-48d5-b375-ceebdf3399ca None admin] PATH_INFO: `/v3/projects/f4e53da4f0744609812a487b0656c7b7/groups/6a77a1f352424c2eb05b26ba51ccd006/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:27.481634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6551c70-5c97-4e5e-99f1-ac4f6f9797a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:27.483435 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5feca2-a0c8-48d5-b375-ceebdf3399ca None admin] RBAC: Authorizing `identity:create_grant(project_id=f4e53da4f0744609812a487b0656c7b7, group_id=6a77a1f352424c2eb05b26ba51ccd006, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:27.484888 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5feca2-a0c8-48d5-b375-ceebdf3399ca None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:27.500394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 207/419] 10.222.0.77 () {58 vars in 1442 bytes} [Tue Jul 19 20:34:27 2022] PUT /identity/v3/projects/f4e53da4f0744609812a487b0656c7b7/groups/6a77a1f352424c2eb05b26ba51ccd006/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:34:27.501697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3b8f0-21c0-401e-a3ad-36e3f9d3ecc5 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:27.512743 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3b8f0-21c0-401e-a3ad-36e3f9d3ecc5 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:27.513055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3b8f0-21c0-401e-a3ad-36e3f9d3ecc5 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:27.515118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 208/420] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:27 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:27.521265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c05b2e-e366-4184-88ea-62b4844c6270 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:27.521549 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c05b2e-e366-4184-88ea-62b4844c6270 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:27.521832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c05b2e-e366-4184-88ea-62b4844c6270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:27.532252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:27.560656 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-60c05b2e-e366-4184-88ea-62b4844c6270 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:27.562003 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-60c05b2e-e366-4184-88ea-62b4844c6270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:27.568874 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6551c70-5c97-4e5e-99f1-ac4f6f9797a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:27.571131 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6551c70-5c97-4e5e-99f1-ac4f6f9797a4 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:27.703024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 209/421] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:34:27.716078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 213/422] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:27.721417 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c05b2e-e366-4184-88ea-62b4844c6270 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:27.738020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6551c70-5c97-4e5e-99f1-ac4f6f9797a4 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:27.791028 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:27.818660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:27.836963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c05b2e-e366-4184-88ea-62b4844c6270 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:27.857812 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6551c70-5c97-4e5e-99f1-ac4f6f9797a4 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:27.881824 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40e0ce-d2bc-4251-a784-bbc7e8e5eca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:27.882700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40e0ce-d2bc-4251-a784-bbc7e8e5eca3 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:27.882980 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40e0ce-d2bc-4251-a784-bbc7e8e5eca3 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:27.883254 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40e0ce-d2bc-4251-a784-bbc7e8e5eca3 None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:27.885255 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40e0ce-d2bc-4251-a784-bbc7e8e5eca3 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf9c36dd93649fb92ed3e7f9f20258d)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:27.886750 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f40e0ce-d2bc-4251-a784-bbc7e8e5eca3 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:27.894377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 210/423] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:27 2022] GET /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:27.894377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40e0ce-d2bc-4251-a784-bbc7e8e5eca3 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:27.922669 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f807b7f-c8b5-4b47-a8e0-efcedb8787d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:27.923530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f807b7f-c8b5-4b47-a8e0-efcedb8787d4 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:27.923814 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f807b7f-c8b5-4b47-a8e0-efcedb8787d4 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:27.924090 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f807b7f-c8b5-4b47-a8e0-efcedb8787d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:27.950602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f807b7f-c8b5-4b47-a8e0-efcedb8787d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:27.963336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-3f807b7f-c8b5-4b47-a8e0-efcedb8787d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:27.963336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:27.963336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:27.963336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:27.963336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:27.963336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:27.963336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:27.963336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:27.963336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:27.963336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:27.963336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:27.963336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:27.963336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:27.963336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:27.963336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:27.963336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:27.964237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:27.964237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:27.964237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:27.964237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:27.964237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:27.964237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:27.964237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:27.964237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:27.964237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:27.964237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:27.964237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:27.964237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:27.964237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:27.964237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:27.964237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:27.964237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:27.965031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:27.965031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:27.965031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:27.965031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:27.965031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:27.965031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:27.965031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:27.965031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:27.965031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:27.965031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:27.965031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:27.965031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:27.965031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 214/424] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:27.971302 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f807b7f-c8b5-4b47-a8e0-efcedb8787d4 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:28.056476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f40e0ce-d2bc-4251-a784-bbc7e8e5eca3 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:28.089261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:28.099976 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaca09f-3fd9-433f-827d-24fe39fa64bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:28.100401 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f807b7f-c8b5-4b47-a8e0-efcedb8787d4 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:28.100932 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaca09f-3fd9-433f-827d-24fe39fa64bb None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:28.101219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaca09f-3fd9-433f-827d-24fe39fa64bb None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:28.101493 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaca09f-3fd9-433f-827d-24fe39fa64bb None admin] PATH_INFO: `/v3/groups/0506c68c6ac54279bbafd35465886bc5` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:28.108129 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaca09f-3fd9-433f-827d-24fe39fa64bb None admin] RBAC: Authorizing `identity:get_group(group_id=0506c68c6ac54279bbafd35465886bc5)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:28.109744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaca09f-3fd9-433f-827d-24fe39fa64bb None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:28.111886 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 211/425] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jul 19 20:34:27 2022] GET /identity/v3/groups/0506c68c6ac54279bbafd35465886bc5 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:28.117757 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaca09f-3fd9-433f-827d-24fe39fa64bb None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:28.135779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:28.138485 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913616b-622d-4d6c-8be2-0cee18ece745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:28.139239 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913616b-622d-4d6c-8be2-0cee18ece745 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:28.139670 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913616b-622d-4d6c-8be2-0cee18ece745 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:28.139962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913616b-622d-4d6c-8be2-0cee18ece745 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:28.140890 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913616b-622d-4d6c-8be2-0cee18ece745 None admin] RBAC: Adding query filter params (name=member) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:28.141309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913616b-622d-4d6c-8be2-0cee18ece745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:28.142950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913616b-622d-4d6c-8be2-0cee18ece745 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:28.157366 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 215/426] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:34:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:28.158902 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913616b-622d-4d6c-8be2-0cee18ece745 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:28.295022 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaca09f-3fd9-433f-827d-24fe39fa64bb None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:28.313960 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913616b-622d-4d6c-8be2-0cee18ece745 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:28.351885 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4480f-7d5e-4999-8863-ceaa14d9cc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:28.352663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4480f-7d5e-4999-8863-ceaa14d9cc3b None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:28.353031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4480f-7d5e-4999-8863-ceaa14d9cc3b None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:28.353409 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4480f-7d5e-4999-8863-ceaa14d9cc3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:28.426621 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:28.429914 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312dec1-64d0-4c83-8901-e03ef2dc262c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:28.430646 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312dec1-64d0-4c83-8901-e03ef2dc262c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:28.430932 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312dec1-64d0-4c83-8901-e03ef2dc262c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:28.431205 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312dec1-64d0-4c83-8901-e03ef2dc262c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:28.431905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4480f-7d5e-4999-8863-ceaa14d9cc3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:28.432318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312dec1-64d0-4c83-8901-e03ef2dc262c None admin] RBAC: Adding query filter params (group.id=0506c68c6ac54279bbafd35465886bc5, role.id=92567de587bf40dab488cc1eb666b221, scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:28.432482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312dec1-64d0-4c83-8901-e03ef2dc262c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:28.433965 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312dec1-64d0-4c83-8901-e03ef2dc262c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:28.434525 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4480f-7d5e-4999-8863-ceaa14d9cc3b None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:28.452546 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 212/427] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Jul 19 20:34:28 2022] GET /identity/v3/role_assignments?group.id=0506c68c6ac54279bbafd35465886bc5&scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d&role.id=92567de587bf40dab488cc1eb666b221 => generated 611 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:28.557703 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 216/428] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 20:34:28.559528 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312dec1-64d0-4c83-8901-e03ef2dc262c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:28.583765 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee00ddf-0fde-4ad5-bf31-0414dd3dbc2c None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:28.584909 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee00ddf-0fde-4ad5-bf31-0414dd3dbc2c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:28.585404 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee00ddf-0fde-4ad5-bf31-0414dd3dbc2c None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:28.587437 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 217/429] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:34:28.599342 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567307f-9859-4a72-8993-2109c952e7e3 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:28.599977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567307f-9859-4a72-8993-2109c952e7e3 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:28.600599 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567307f-9859-4a72-8993-2109c952e7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:28.622059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-8567307f-9859-4a72-8993-2109c952e7e3 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:28.623694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-8567307f-9859-4a72-8993-2109c952e7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:28.693354 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:28.714914 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 218/430] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:34:28.743420 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567307f-9859-4a72-8993-2109c952e7e3 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:28.748279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312dec1-64d0-4c83-8901-e03ef2dc262c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:28.783616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c339b-1057-47bb-9ca9-118b0bb46111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:28.785132 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:28.785341 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c339b-1057-47bb-9ca9-118b0bb46111 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:28.785586 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c339b-1057-47bb-9ca9-118b0bb46111 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:28.785860 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c339b-1057-47bb-9ca9-118b0bb46111 None admin] PATH_INFO: `/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:28.787342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c339b-1057-47bb-9ca9-118b0bb46111 None admin] RBAC: Authorizing `identity:get_project(project_id=8bf9c36dd93649fb92ed3e7f9f20258d)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:28.789010 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c339b-1057-47bb-9ca9-118b0bb46111 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:28.790710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 213/431] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:28 2022] GET /identity/v3/projects/8bf9c36dd93649fb92ed3e7f9f20258d => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:28.798379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c339b-1057-47bb-9ca9-118b0bb46111 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:28.883971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567307f-9859-4a72-8993-2109c952e7e3 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:28.927741 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452607b3-63cc-443a-92aa-32bbf82b945f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:28.928571 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452607b3-63cc-443a-92aa-32bbf82b945f None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:28.928854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452607b3-63cc-443a-92aa-32bbf82b945f None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:28.929128 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452607b3-63cc-443a-92aa-32bbf82b945f None admin] PATH_INFO: `/v3/roles/member` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:28.936695 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c339b-1057-47bb-9ca9-118b0bb46111 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:28.940481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452607b3-63cc-443a-92aa-32bbf82b945f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:28.948243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-452607b3-63cc-443a-92aa-32bbf82b945f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:28.948243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:28.948243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:28.948243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:28.948243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:28.948243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:28.948243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:28.948243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:28.948243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:28.948243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:28.948243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:28.948243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:28.948243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:28.948243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:28.948243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:28.948243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:28.949161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:28.949161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:28.949161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:28.949161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:28.949161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:28.949161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:28.949161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:28.949161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:28.949161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:28.949161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:28.949161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:28.949161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:28.949161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:28.949161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:28.949161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:28.949161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:28.949971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:28.949971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:28.949971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:28.949971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:28.949971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:28.949971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:28.949971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:28.949971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:28.949971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:28.949971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:28.949971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 20:34:28.949971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:28.954512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 219/432] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:34:28.955792 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452607b3-63cc-443a-92aa-32bbf82b945f None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:28.978834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:28.984748 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839141c2-6418-4814-81cb-fc4bfe50ddea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:28.986271 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839141c2-6418-4814-81cb-fc4bfe50ddea None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:28.986991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839141c2-6418-4814-81cb-fc4bfe50ddea None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:28.987474 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839141c2-6418-4814-81cb-fc4bfe50ddea None admin] PATH_INFO: `/v3/groups/0506c68c6ac54279bbafd35465886bc5` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:28.989564 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839141c2-6418-4814-81cb-fc4bfe50ddea None admin] RBAC: Authorizing `identity:get_group(group_id=0506c68c6ac54279bbafd35465886bc5)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:28.991731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839141c2-6418-4814-81cb-fc4bfe50ddea None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:28.999128 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 214/433] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jul 19 20:34:28 2022] GET /identity/v3/groups/0506c68c6ac54279bbafd35465886bc5 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:29.000698 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839141c2-6418-4814-81cb-fc4bfe50ddea None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:29.053036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:29.076624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452607b3-63cc-443a-92aa-32bbf82b945f None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:29.126813 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe1979-8fde-4648-b79b-7e660597bc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:29.128043 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe1979-8fde-4648-b79b-7e660597bc9e None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:29.129350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe1979-8fde-4648-b79b-7e660597bc9e None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:29.129802 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe1979-8fde-4648-b79b-7e660597bc9e None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:29.131374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe1979-8fde-4648-b79b-7e660597bc9e None admin] RBAC: Adding query filter params (name=member) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:29.131882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe1979-8fde-4648-b79b-7e660597bc9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:29.134419 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe1979-8fde-4648-b79b-7e660597bc9e None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:29.136439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839141c2-6418-4814-81cb-fc4bfe50ddea None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:29.146064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 220/434] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:34:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:29.150877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe1979-8fde-4648-b79b-7e660597bc9e None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:29.176716 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32adb00-e088-4575-84fa-0e26ced336be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:29.177681 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32adb00-e088-4575-84fa-0e26ced336be None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:29.178135 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32adb00-e088-4575-84fa-0e26ced336be None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:29.178573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32adb00-e088-4575-84fa-0e26ced336be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:29.179614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32adb00-e088-4575-84fa-0e26ced336be None admin] RBAC: Adding query filter params (group.id=0506c68c6ac54279bbafd35465886bc5, role.id=a2021efb2e4e459cbfa73f6987297bca, scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:29.180204 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32adb00-e088-4575-84fa-0e26ced336be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:29.181797 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32adb00-e088-4575-84fa-0e26ced336be None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:29.188228 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 215/435] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Jul 19 20:34:28 2022] GET /identity/v3/role_assignments?group.id=0506c68c6ac54279bbafd35465886bc5&scope.project.id=8bf9c36dd93649fb92ed3e7f9f20258d&role.id=a2021efb2e4e459cbfa73f6987297bca => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:29.266514 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe1979-8fde-4648-b79b-7e660597bc9e None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:29.305501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d366e-9601-45f9-9048-466230604703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:29.306174 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d366e-9601-45f9-9048-466230604703 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:29.306464 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d366e-9601-45f9-9048-466230604703 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:29.306743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d366e-9601-45f9-9048-466230604703 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:29.324324 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:29.384174 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d366e-9601-45f9-9048-466230604703 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:29.385683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d366e-9601-45f9-9048-466230604703 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:29.426981 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d711b-48b8-4626-8bd4-2a5120bc90e1 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:29.427330 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d711b-48b8-4626-8bd4-2a5120bc90e1 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:29.427570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d711b-48b8-4626-8bd4-2a5120bc90e1 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:29.429170 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 216/436] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:29.434290 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016b055-cc64-418f-a8fd-1d4e39d29e5b None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:29.434578 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016b055-cc64-418f-a8fd-1d4e39d29e5b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:29.434856 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016b055-cc64-418f-a8fd-1d4e39d29e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:29.452383 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-0016b055-cc64-418f-a8fd-1d4e39d29e5b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:29.453578 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-0016b055-cc64-418f-a8fd-1d4e39d29e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:29.506620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 221/437] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 20:34:29.514994 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d366e-9601-45f9-9048-466230604703 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:29.544320 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:29.557658 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 217/438] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:34:29.580582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:29.581277 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016b055-cc64-418f-a8fd-1d4e39d29e5b None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:29.646869 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d366e-9601-45f9-9048-466230604703 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:29.699132 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a141e79-ecbe-466f-b623-581f42b79e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:29.700066 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a141e79-ecbe-466f-b623-581f42b79e12 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:29.700348 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a141e79-ecbe-466f-b623-581f42b79e12 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:29.700621 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a141e79-ecbe-466f-b623-581f42b79e12 None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:29.701829 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a141e79-ecbe-466f-b623-581f42b79e12 None admin] RBAC: Authorizing `identity:get_project(project_id=7763226124204b95a4f39f7d36e13a32)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:29.703288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a141e79-ecbe-466f-b623-581f42b79e12 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:29.705177 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 222/439] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:29 2022] GET /identity/v3/projects/7763226124204b95a4f39f7d36e13a32 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:29.710905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a141e79-ecbe-466f-b623-581f42b79e12 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:29.735866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016b055-cc64-418f-a8fd-1d4e39d29e5b None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:29.783125 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952f077-21d3-41e9-9cce-5e8410d8e8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:29.784235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952f077-21d3-41e9-9cce-5e8410d8e8e3 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:29.784538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952f077-21d3-41e9-9cce-5e8410d8e8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:29.784812 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c952f077-21d3-41e9-9cce-5e8410d8e8e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:29.798082 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c952f077-21d3-41e9-9cce-5e8410d8e8e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:29.809496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-c952f077-21d3-41e9-9cce-5e8410d8e8e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:34:29.809496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:29.809496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:29.809496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:29.809496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:29.809496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:29.809496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:29.809496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:29.809496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:29.809496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:29.809496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:29.809496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:29.809496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:29.809496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:29.809496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:29.809496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:29.810459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:29.810459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:29.810459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:29.810459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:29.810459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:29.810459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:29.810459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:29.810459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:29.810459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:29.810459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:29.810459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:29.810459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:29.810459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:29.810459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:29.810459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:29.810459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:29.811308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:29.811308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:29.811308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:29.811308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:29.811308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:29.811308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:29.811308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:29.811308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:29.811308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:29.811308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:29.811308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:34:29.811308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:29.811308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 218/440] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jul 19 20:34:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:34:29.818030 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952f077-21d3-41e9-9cce-5e8410d8e8e3 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:29.844415 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a141e79-ecbe-466f-b623-581f42b79e12 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:29.862551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:29.889833 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798e2ab-2994-4c00-8441-533a352762cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:29.891704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798e2ab-2994-4c00-8441-533a352762cb None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:29.892132 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798e2ab-2994-4c00-8441-533a352762cb None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:29.892579 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798e2ab-2994-4c00-8441-533a352762cb None admin] PATH_INFO: `/v3/groups/0506c68c6ac54279bbafd35465886bc5` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:29.895316 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798e2ab-2994-4c00-8441-533a352762cb None admin] RBAC: Authorizing `identity:get_group(group_id=0506c68c6ac54279bbafd35465886bc5)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:29.897073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798e2ab-2994-4c00-8441-533a352762cb None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:29.899003 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 223/441] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jul 19 20:34:29 2022] GET /identity/v3/groups/0506c68c6ac54279bbafd35465886bc5 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:29.905880 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798e2ab-2994-4c00-8441-533a352762cb None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:29.906699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:29.955069 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c952f077-21d3-41e9-9cce-5e8410d8e8e3 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:29.991284 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cec4e-411c-4c3e-a7ae-5e10889a4a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:29.991958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cec4e-411c-4c3e-a7ae-5e10889a4a8a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:29.992250 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cec4e-411c-4c3e-a7ae-5e10889a4a8a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:29.992526 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cec4e-411c-4c3e-a7ae-5e10889a4a8a None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:29.993275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cec4e-411c-4c3e-a7ae-5e10889a4a8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:29.993585 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cec4e-411c-4c3e-a7ae-5e10889a4a8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:29.994952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810cec4e-411c-4c3e-a7ae-5e10889a4a8a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:30.007835 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 219/442] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:30.008883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cec4e-411c-4c3e-a7ae-5e10889a4a8a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:30.016810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798e2ab-2994-4c00-8441-533a352762cb None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:30.054320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7daa8b3-0816-4571-9e14-f14a6897018b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:30.054978 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7daa8b3-0816-4571-9e14-f14a6897018b None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:30.055337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7daa8b3-0816-4571-9e14-f14a6897018b None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:30.055622 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7daa8b3-0816-4571-9e14-f14a6897018b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:30.056634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7daa8b3-0816-4571-9e14-f14a6897018b None admin] RBAC: Adding query filter params (group.id=0506c68c6ac54279bbafd35465886bc5, role.id=a2021efb2e4e459cbfa73f6987297bca, scope.project.id=7763226124204b95a4f39f7d36e13a32) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:30.057044 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7daa8b3-0816-4571-9e14-f14a6897018b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:30.058478 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7daa8b3-0816-4571-9e14-f14a6897018b None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:30.064506 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 224/443] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Jul 19 20:34:29 2022] GET /identity/v3/role_assignments?group.id=0506c68c6ac54279bbafd35465886bc5&scope.project.id=7763226124204b95a4f39f7d36e13a32&role.id=a2021efb2e4e459cbfa73f6987297bca => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:30.065651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29307b78-ccd7-4dcf-b029-9eb0c187a576 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:30.066472 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29307b78-ccd7-4dcf-b029-9eb0c187a576 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:30.066753 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29307b78-ccd7-4dcf-b029-9eb0c187a576 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:30.068297 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 225/444] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:30.073778 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe975b-5acb-4fe5-8932-829bea0911bd None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:30.074531 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe975b-5acb-4fe5-8932-829bea0911bd None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:30.074813 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe975b-5acb-4fe5-8932-829bea0911bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:30.093462 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-b7fe975b-5acb-4fe5-8932-829bea0911bd None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:30.095061 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b7fe975b-5acb-4fe5-8932-829bea0911bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:30.123130 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cec4e-411c-4c3e-a7ae-5e10889a4a8a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:30.140765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:30.141444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:30.166928 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2701e-cdc1-452a-a989-839508dc5685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:30.167580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2701e-cdc1-452a-a989-839508dc5685 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:30.167864 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2701e-cdc1-452a-a989-839508dc5685 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:30.168173 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2701e-cdc1-452a-a989-839508dc5685 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:30.174925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 226/445] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:30.199445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe975b-5acb-4fe5-8932-829bea0911bd None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:30.245189 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2701e-cdc1-452a-a989-839508dc5685 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:30.246910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2701e-cdc1-452a-a989-839508dc5685 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:30.315153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe975b-5acb-4fe5-8932-829bea0911bd None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:30.355078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0920a-e58e-4859-82d5-24e2ea1bf132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:30.355917 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0920a-e58e-4859-82d5-24e2ea1bf132 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:30.356205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0920a-e58e-4859-82d5-24e2ea1bf132 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:30.356491 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0920a-e58e-4859-82d5-24e2ea1bf132 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:30.368447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0920a-e58e-4859-82d5-24e2ea1bf132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:30.370388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 220/446] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 20:34:30.375947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-68c0920a-e58e-4859-82d5-24e2ea1bf132 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:34:30.375947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:30.375947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:30.375947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:30.375947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:30.375947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:30.375947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:30.375947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:30.375947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:30.375947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:30.375947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:30.375947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:30.375947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:30.375947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:30.375947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:30.375947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:30.377049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:30.377049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:30.377049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:30.377049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:30.377049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:30.377049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:30.377049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:30.377049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:30.377049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:30.377049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:30.377049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:30.377049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:30.377049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:30.377049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:30.377049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:30.377049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:30.378048 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:30.378048 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:30.378048 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:30.378048 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:30.378048 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:30.378048 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:30.378048 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:30.378048 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:30.378048 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:30.378048 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:30.378048 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:34:30.378048 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:30.378048 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 227/447] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:34:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:34:30.379157 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2701e-cdc1-452a-a989-839508dc5685 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:30.382656 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0920a-e58e-4859-82d5-24e2ea1bf132 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:30.396474 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:30.427881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:30.490382 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2701e-cdc1-452a-a989-839508dc5685 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:30.495679 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0920a-e58e-4859-82d5-24e2ea1bf132 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:30.524266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c492d2-3c01-4110-b06f-687ce2ab7532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:30.525122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c492d2-3c01-4110-b06f-687ce2ab7532 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:30.525401 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c492d2-3c01-4110-b06f-687ce2ab7532 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:30.525685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c492d2-3c01-4110-b06f-687ce2ab7532 None admin] PATH_INFO: `/v3/projects/7763226124204b95a4f39f7d36e13a32` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:30.526853 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c492d2-3c01-4110-b06f-687ce2ab7532 None admin] RBAC: Authorizing `identity:get_project(project_id=7763226124204b95a4f39f7d36e13a32)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:30.528315 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c492d2-3c01-4110-b06f-687ce2ab7532 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:30.529833 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884c6f5-3020-4cc3-b2e4-40d6fb393c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:30.530475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 221/448] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:30 2022] GET /identity/v3/projects/7763226124204b95a4f39f7d36e13a32 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:30.530579 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884c6f5-3020-4cc3-b2e4-40d6fb393c7a None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:30.530847 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884c6f5-3020-4cc3-b2e4-40d6fb393c7a None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:30.531146 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884c6f5-3020-4cc3-b2e4-40d6fb393c7a None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:30.531910 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884c6f5-3020-4cc3-b2e4-40d6fb393c7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:30.532217 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884c6f5-3020-4cc3-b2e4-40d6fb393c7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:30.533686 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884c6f5-3020-4cc3-b2e4-40d6fb393c7a None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:30.536523 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c492d2-3c01-4110-b06f-687ce2ab7532 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:30.543285 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 228/449] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:30.548798 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884c6f5-3020-4cc3-b2e4-40d6fb393c7a None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:30.617616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:30.636664 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c492d2-3c01-4110-b06f-687ce2ab7532 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:30.642468 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:30.649361 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884c6f5-3020-4cc3-b2e4-40d6fb393c7a None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:30.670709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877d579-984c-4bf7-aa33-9afe83d3fbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:30.671593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877d579-984c-4bf7-aa33-9afe83d3fbf2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:30.671874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877d579-984c-4bf7-aa33-9afe83d3fbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:30.672154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877d579-984c-4bf7-aa33-9afe83d3fbf2 None admin] PATH_INFO: `/v3/groups/0506c68c6ac54279bbafd35465886bc5` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:30.673382 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877d579-984c-4bf7-aa33-9afe83d3fbf2 None admin] RBAC: Authorizing `identity:get_group(group_id=0506c68c6ac54279bbafd35465886bc5)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:30.674760 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877d579-984c-4bf7-aa33-9afe83d3fbf2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:30.676434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 222/450] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jul 19 20:34:30 2022] GET /identity/v3/groups/0506c68c6ac54279bbafd35465886bc5 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:30.682171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877d579-984c-4bf7-aa33-9afe83d3fbf2 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:30.682772 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5b3c8-8d6a-4c64-9ebb-42c7a39a2724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:30.683525 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5b3c8-8d6a-4c64-9ebb-42c7a39a2724 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:30.683813 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5b3c8-8d6a-4c64-9ebb-42c7a39a2724 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:30.684093 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5b3c8-8d6a-4c64-9ebb-42c7a39a2724 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:30.753789 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5b3c8-8d6a-4c64-9ebb-42c7a39a2724 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:30.755368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5b3c8-8d6a-4c64-9ebb-42c7a39a2724 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:30.782445 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877d579-984c-4bf7-aa33-9afe83d3fbf2 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:30.815467 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acd4fc-498a-479c-bb70-c2507697cca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:30.816620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acd4fc-498a-479c-bb70-c2507697cca8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:30.816898 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acd4fc-498a-479c-bb70-c2507697cca8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:30.817167 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acd4fc-498a-479c-bb70-c2507697cca8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:30.817981 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acd4fc-498a-479c-bb70-c2507697cca8 None admin] RBAC: Adding query filter params (group.id=0506c68c6ac54279bbafd35465886bc5, role.id=92567de587bf40dab488cc1eb666b221, scope.project.id=7763226124204b95a4f39f7d36e13a32) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:30.818290 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acd4fc-498a-479c-bb70-c2507697cca8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:30.819724 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33acd4fc-498a-479c-bb70-c2507697cca8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:30.826047 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 223/451] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Jul 19 20:34:30 2022] GET /identity/v3/role_assignments?group.id=0506c68c6ac54279bbafd35465886bc5&scope.project.id=7763226124204b95a4f39f7d36e13a32&role.id=92567de587bf40dab488cc1eb666b221 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:30.848429 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:30.862360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 229/452] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 20:34:30.863696 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acd4fc-498a-479c-bb70-c2507697cca8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:30.881094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:30.975152 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33acd4fc-498a-479c-bb70-c2507697cca8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:31.011628 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b414649-10c4-4f02-8a6e-dfc2a6082f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:31.012492 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b414649-10c4-4f02-8a6e-dfc2a6082f22 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:31.012775 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b414649-10c4-4f02-8a6e-dfc2a6082f22 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:31.013044 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b414649-10c4-4f02-8a6e-dfc2a6082f22 None admin] PATH_INFO: `/v3/projects/f4e53da4f0744609812a487b0656c7b7` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:31.014309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b414649-10c4-4f02-8a6e-dfc2a6082f22 None admin] RBAC: Authorizing `identity:get_project(project_id=f4e53da4f0744609812a487b0656c7b7)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:31.015805 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b414649-10c4-4f02-8a6e-dfc2a6082f22 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:31.017538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 224/453] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:34:30 2022] GET /identity/v3/projects/f4e53da4f0744609812a487b0656c7b7 => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:31.023127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5b3c8-8d6a-4c64-9ebb-42c7a39a2724 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:31.127781 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5b3c8-8d6a-4c64-9ebb-42c7a39a2724 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:31.162475 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d3814-5d5f-4bf5-b4ab-517bd474d4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:31.163430 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d3814-5d5f-4bf5-b4ab-517bd474d4a9 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:31.163721 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d3814-5d5f-4bf5-b4ab-517bd474d4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:31.163998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d3814-5d5f-4bf5-b4ab-517bd474d4a9 None admin] PATH_INFO: `/v3/groups/6a77a1f352424c2eb05b26ba51ccd006` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:31.165189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d3814-5d5f-4bf5-b4ab-517bd474d4a9 None admin] RBAC: Authorizing `identity:get_group(group_id=6a77a1f352424c2eb05b26ba51ccd006)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:31.166619 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619d3814-5d5f-4bf5-b4ab-517bd474d4a9 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:31.168286 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 230/454] 10.222.0.77 () {56 vars in 1180 bytes} [Tue Jul 19 20:34:31 2022] GET /identity/v3/groups/6a77a1f352424c2eb05b26ba51ccd006 => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:31.174242 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b414649-10c4-4f02-8a6e-dfc2a6082f22 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:31.271952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:31.290231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b414649-10c4-4f02-8a6e-dfc2a6082f22 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:31.323283 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3eea7-a35d-4ad7-9947-e62a6534e95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:31.323943 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3eea7-a35d-4ad7-9947-e62a6534e95f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:31.324222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3eea7-a35d-4ad7-9947-e62a6534e95f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:31.324495 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3eea7-a35d-4ad7-9947-e62a6534e95f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:31.325310 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3eea7-a35d-4ad7-9947-e62a6534e95f None admin] RBAC: Adding query filter params (group.id=6a77a1f352424c2eb05b26ba51ccd006, role.id=b30f01ef95004a1b84fc029830bdf053, scope.project.id=f4e53da4f0744609812a487b0656c7b7) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:31.325615 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3eea7-a35d-4ad7-9947-e62a6534e95f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:31.327030 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea3eea7-a35d-4ad7-9947-e62a6534e95f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:31.332695 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 225/455] 10.222.0.77 () {56 vars in 1376 bytes} [Tue Jul 19 20:34:31 2022] GET /identity/v3/role_assignments?group.id=6a77a1f352424c2eb05b26ba51ccd006&scope.project.id=f4e53da4f0744609812a487b0656c7b7&role.id=b30f01ef95004a1b84fc029830bdf053 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:33.794521 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50787b2-b348-471f-a3ae-db65cfc9e14d None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:33.795535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50787b2-b348-471f-a3ae-db65cfc9e14d None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:33.796038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50787b2-b348-471f-a3ae-db65cfc9e14d None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:33.797893 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 231/456] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:33.808851 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f837e5-fe08-4019-ab5e-7e4cd7196675 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:33.809803 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f837e5-fe08-4019-ab5e-7e4cd7196675 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:33.810304 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f837e5-fe08-4019-ab5e-7e4cd7196675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:33.833610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-c8f837e5-fe08-4019-ab5e-7e4cd7196675 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:33.835117 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c8f837e5-fe08-4019-ab5e-7e4cd7196675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:33.932703 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 226/457] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:33.969996 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50787b2-b348-471f-a3ae-db65cfc9e14d None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:34.061741 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:34.088373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c10c4-6ef4-4921-8fb6-e97479e325e2 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:34.088720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c10c4-6ef4-4921-8fb6-e97479e325e2 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:34.088933 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c10c4-6ef4-4921-8fb6-e97479e325e2 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:34.090479 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 227/458] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:34:34.095685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba911f-7757-452a-a96b-5a08454a198d None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:34.096203 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba911f-7757-452a-a96b-5a08454a198d None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:34.096679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba911f-7757-452a-a96b-5a08454a198d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:34.124495 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-e7ba911f-7757-452a-a96b-5a08454a198d None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:34.125708 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e7ba911f-7757-452a-a96b-5a08454a198d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:34.130265 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50787b2-b348-471f-a3ae-db65cfc9e14d None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:34.198246 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d62d3f-c2d7-48d9-96e9-a3ab6f4e19d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:34.199062 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d62d3f-c2d7-48d9-96e9-a3ab6f4e19d9 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:34.199374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d62d3f-c2d7-48d9-96e9-a3ab6f4e19d9 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:34.199657 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d62d3f-c2d7-48d9-96e9-a3ab6f4e19d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:34.212306 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 228/459] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:34:34.213188 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d62d3f-c2d7-48d9-96e9-a3ab6f4e19d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:34.214137 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c4cf8-f558-4527-84f5-cfe63655f249 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:34.214648 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c4cf8-f558-4527-84f5-cfe63655f249 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:34.214752 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d62d3f-c2d7-48d9-96e9-a3ab6f4e19d9 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:34.215422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c4cf8-f558-4527-84f5-cfe63655f249 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:34.217196 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 229/460] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:34.224493 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff2f45-2b5e-4184-8f5e-202cdbf40ada None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:34.225013 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff2f45-2b5e-4184-8f5e-202cdbf40ada None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:34.225513 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff2f45-2b5e-4184-8f5e-202cdbf40ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:34.239662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-e5d62d3f-c2d7-48d9-96e9-a3ab6f4e19d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:34.239662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:34.239662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:34.239662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:34.239662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:34.239662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:34.239662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:34.239662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:34.239662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:34.239662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:34.239662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:34.239662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:34.239662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:34.239662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:34.239662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:34.240568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:34.240568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:34.240568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:34.240568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:34.240568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:34.240568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:34.240568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:34.240568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:34.240568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:34.240568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:34.240568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:34.240568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:34.240568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:34.240568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:34.240568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:34.240568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:34.240568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:34.241408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:34.241408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:34.241408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:34.241408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:34.241630 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:34.243837 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 232/461] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:34.250101 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d62d3f-c2d7-48d9-96e9-a3ab6f4e19d9 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:34.256310 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-39ff2f45-2b5e-4184-8f5e-202cdbf40ada None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:34.257591 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-39ff2f45-2b5e-4184-8f5e-202cdbf40ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:34.339484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 230/462] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:34.340791 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff2f45-2b5e-4184-8f5e-202cdbf40ada None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:34.361896 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d62d3f-c2d7-48d9-96e9-a3ab6f4e19d9 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:34.379333 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:34.406320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f15183-5d36-45c3-915a-9b88e272f634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:34.407426 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f15183-5d36-45c3-915a-9b88e272f634 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:34.407922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f15183-5d36-45c3-915a-9b88e272f634 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:34.408398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f15183-5d36-45c3-915a-9b88e272f634 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:34.409589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f15183-5d36-45c3-915a-9b88e272f634 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:34.410159 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f15183-5d36-45c3-915a-9b88e272f634 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:34.411789 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f15183-5d36-45c3-915a-9b88e272f634 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:34.424988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 233/463] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:34.426237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f15183-5d36-45c3-915a-9b88e272f634 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:34.466746 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff2f45-2b5e-4184-8f5e-202cdbf40ada None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:34.504957 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7ae11-6bb4-4288-bf53-25a399a89126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:34.506117 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7ae11-6bb4-4288-bf53-25a399a89126 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:34.506579 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7ae11-6bb4-4288-bf53-25a399a89126 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:34.507132 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7ae11-6bb4-4288-bf53-25a399a89126 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:34.510315 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:34.520887 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7ae11-6bb4-4288-bf53-25a399a89126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:34.522886 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7ae11-6bb4-4288-bf53-25a399a89126 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:34.531494 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f15183-5d36-45c3-915a-9b88e272f634 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:34.542793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-06e7ae11-6bb4-4288-bf53-25a399a89126 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:34.542793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:34.542793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:34.542793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:34.542793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:34.542793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:34.542793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:34.542793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:34.542793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:34.542793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:34.542793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:34.542793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:34.542793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:34.542793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:34.542793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:34.543685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:34.543685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:34.543685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:34.543685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:34.543685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:34.543685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:34.543685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:34.543685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:34.543685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:34.543685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:34.543685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:34.543685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:34.543685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:34.543685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:34.543685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:34.543685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:34.543685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:34.544608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:34.544608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:34.544608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:34.544608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:34.546746 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 231/464] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:34.547791 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7ae11-6bb4-4288-bf53-25a399a89126 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:34.576152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08564817-21fa-41ea-a455-9d0f6b890460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:34.577158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08564817-21fa-41ea-a455-9d0f6b890460 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:34.577570 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08564817-21fa-41ea-a455-9d0f6b890460 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:34.577852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08564817-21fa-41ea-a455-9d0f6b890460 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:34.589724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08564817-21fa-41ea-a455-9d0f6b890460 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:34.591115 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08564817-21fa-41ea-a455-9d0f6b890460 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:34.610931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-08564817-21fa-41ea-a455-9d0f6b890460 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:34.610931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:34.610931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:34.610931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:34.610931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:34.610931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:34.610931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:34.610931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:34.610931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:34.610931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:34.610931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:34.610931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:34.610931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:34.610931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:34.610931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:34.611859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:34.611859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:34.611859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:34.611859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:34.611859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:34.611859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:34.611859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:34.611859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:34.611859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:34.611859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:34.611859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:34.611859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:34.611859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:34.611859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:34.611859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:34.611859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:34.611859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:34.612710 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:34.612710 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:34.612710 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:34.612710 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:34.612710 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 234/465] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:34.613615 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08564817-21fa-41ea-a455-9d0f6b890460 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:34.646139 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:34.662139 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7ae11-6bb4-4288-bf53-25a399a89126 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:34.699005 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b06039-c5c7-498e-9537-20d2f33b3a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:34.699796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b06039-c5c7-498e-9537-20d2f33b3a2d None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:34.700180 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b06039-c5c7-498e-9537-20d2f33b3a2d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:34.700553 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b06039-c5c7-498e-9537-20d2f33b3a2d None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:34.701507 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b06039-c5c7-498e-9537-20d2f33b3a2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:34.703248 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b06039-c5c7-498e-9537-20d2f33b3a2d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:34.724613 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 232/466] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jul 19 20:34:34 2022] POST /identity/v3/users => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:34:34.726162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98dd2b-2e29-4df6-85d3-4e546bb371f6 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:34.726523 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98dd2b-2e29-4df6-85d3-4e546bb371f6 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:34.726805 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98dd2b-2e29-4df6-85d3-4e546bb371f6 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:34.728295 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 233/467] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:34.732167 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98dd2b-2e29-4df6-85d3-4e546bb371f6 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:34.736430 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08564817-21fa-41ea-a455-9d0f6b890460 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:34.779551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8da830-db29-4979-942d-d11d2e8d2e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:34.780300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8da830-db29-4979-942d-d11d2e8d2e84 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:34.780591 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8da830-db29-4979-942d-d11d2e8d2e84 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:34.780870 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8da830-db29-4979-942d-d11d2e8d2e84 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:34.781636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8da830-db29-4979-942d-d11d2e8d2e84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:34.782044 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8da830-db29-4979-942d-d11d2e8d2e84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:34.783680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8da830-db29-4979-942d-d11d2e8d2e84 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:34.787408 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:34.807702 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 235/468] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:34.809808 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f3f17-08b1-4d9f-80bf-c81d008c3fe6 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:34.810323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f3f17-08b1-4d9f-80bf-c81d008c3fe6 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:34.810797 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f3f17-08b1-4d9f-80bf-c81d008c3fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:34.831097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-390f3f17-08b1-4d9f-80bf-c81d008c3fe6 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:34.833416 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-390f3f17-08b1-4d9f-80bf-c81d008c3fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:34.871459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98dd2b-2e29-4df6-85d3-4e546bb371f6 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:34.917482 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 236/469] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:34.918734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f3f17-08b1-4d9f-80bf-c81d008c3fe6 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:34.923769 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae968d6c-920a-42bc-ae59-5eed4c76b690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:34.924441 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae968d6c-920a-42bc-ae59-5eed4c76b690 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:34.924724 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae968d6c-920a-42bc-ae59-5eed4c76b690 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:34.924998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae968d6c-920a-42bc-ae59-5eed4c76b690 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:34.926290 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae968d6c-920a-42bc-ae59-5eed4c76b690 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:34.926596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae968d6c-920a-42bc-ae59-5eed4c76b690 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:34.928150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae968d6c-920a-42bc-ae59-5eed4c76b690 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:34.945012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:34.946313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 234/470] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:34.953702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae968d6c-920a-42bc-ae59-5eed4c76b690 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:35.049141 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f3f17-08b1-4d9f-80bf-c81d008c3fe6 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:35.073945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae968d6c-920a-42bc-ae59-5eed4c76b690 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:35.078127 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:35.100821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433de8cc-fc8e-447b-a49f-e73b19e28e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:35.102209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433de8cc-fc8e-447b-a49f-e73b19e28e3d None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:35.102987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433de8cc-fc8e-447b-a49f-e73b19e28e3d None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:35.103924 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433de8cc-fc8e-447b-a49f-e73b19e28e3d None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:35.105127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433de8cc-fc8e-447b-a49f-e73b19e28e3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:35.107779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433de8cc-fc8e-447b-a49f-e73b19e28e3d None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:35.114968 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401b44a-be06-4be7-a49b-162a049d2870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:35.115991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401b44a-be06-4be7-a49b-162a049d2870 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:35.116443 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401b44a-be06-4be7-a49b-162a049d2870 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:35.116921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401b44a-be06-4be7-a49b-162a049d2870 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:35.131320 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401b44a-be06-4be7-a49b-162a049d2870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:35.133311 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401b44a-be06-4be7-a49b-162a049d2870 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:35.143289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 237/471] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jul 19 20:34:34 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:34:35.143289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433de8cc-fc8e-447b-a49f-e73b19e28e3d None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:35.169428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-b401b44a-be06-4be7-a49b-162a049d2870 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:35.169428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:35.169428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:35.169428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:35.169428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:35.169428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:35.169428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:35.169428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:35.169428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:35.169428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:35.169428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:35.169428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:35.169428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:35.169428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:35.169428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:35.170334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:35.170334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:35.170334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:35.170334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:35.170334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:35.170334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:35.170334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:35.170334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:35.170334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:35.170334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:35.170334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:35.170334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:35.170334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:35.170334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:35.170334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:35.170334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:35.170334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:35.171193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:35.171193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:35.171193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:35.171193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:35.181554 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 235/472] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:35.188538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401b44a-be06-4be7-a49b-162a049d2870 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:35.250347 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:35.287461 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433de8cc-fc8e-447b-a49f-e73b19e28e3d None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:35.333221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7e5d1-a79c-4fb5-8a95-7b7aba3319da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:35.334253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7e5d1-a79c-4fb5-8a95-7b7aba3319da None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:35.334543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7e5d1-a79c-4fb5-8a95-7b7aba3319da None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:35.335491 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7e5d1-a79c-4fb5-8a95-7b7aba3319da None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:35.336262 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7e5d1-a79c-4fb5-8a95-7b7aba3319da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:35.337761 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7e5d1-a79c-4fb5-8a95-7b7aba3319da None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:35.382509 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 238/473] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jul 19 20:34:35 2022] POST /identity/v3/users => generated 248 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:34:35.392470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1791147-0126-4a25-a671-69056156d7b6 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:35.392989 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1791147-0126-4a25-a671-69056156d7b6 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:35.394751 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1791147-0126-4a25-a671-69056156d7b6 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:35.396852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 239/474] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:34:35.404029 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27528d92-d734-4bb5-8d2c-5dd476bff513 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:35.404381 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27528d92-d734-4bb5-8d2c-5dd476bff513 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:35.404917 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27528d92-d734-4bb5-8d2c-5dd476bff513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:35.417114 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401b44a-be06-4be7-a49b-162a049d2870 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:35.427654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-27528d92-d734-4bb5-8d2c-5dd476bff513 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:35.429641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-27528d92-d734-4bb5-8d2c-5dd476bff513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:35.466563 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39715380-6cf7-4227-94b2-31e42908f9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:35.467289 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39715380-6cf7-4227-94b2-31e42908f9d2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:35.467757 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39715380-6cf7-4227-94b2-31e42908f9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:35.468431 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39715380-6cf7-4227-94b2-31e42908f9d2 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:35.469464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39715380-6cf7-4227-94b2-31e42908f9d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:35.469780 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39715380-6cf7-4227-94b2-31e42908f9d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:35.471776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39715380-6cf7-4227-94b2-31e42908f9d2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:35.491252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 236/475] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:35.496287 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39715380-6cf7-4227-94b2-31e42908f9d2 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:35.525097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:35.534582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 240/476] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:34:35.567210 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27528d92-d734-4bb5-8d2c-5dd476bff513 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:35.637834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39715380-6cf7-4227-94b2-31e42908f9d2 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:35.648136 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:35.686743 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a93152-3c66-47ad-8d40-daf405786b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:35.687455 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a93152-3c66-47ad-8d40-daf405786b4e None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:35.687742 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a93152-3c66-47ad-8d40-daf405786b4e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:35.688021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a93152-3c66-47ad-8d40-daf405786b4e None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:35.688851 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a93152-3c66-47ad-8d40-daf405786b4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:35.690416 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a93152-3c66-47ad-8d40-daf405786b4e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:35.700609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27528d92-d734-4bb5-8d2c-5dd476bff513 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:35.713928 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 237/477] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jul 19 20:34:35 2022] POST /identity/v3/users => generated 249 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:34:35.750340 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdfa1a-6e9d-492c-b943-40c8b5cbfe04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:35.751407 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdfa1a-6e9d-492c-b943-40c8b5cbfe04 None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:35.751932 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdfa1a-6e9d-492c-b943-40c8b5cbfe04 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:35.752457 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdfa1a-6e9d-492c-b943-40c8b5cbfe04 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:35.753530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cdfa1a-6e9d-492c-b943-40c8b5cbfe04 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:35.755423 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cdfa1a-6e9d-492c-b943-40c8b5cbfe04 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:35.763599 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.sql.core [None req-f5cdfa1a-6e9d-492c-b943-40c8b5cbfe04 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 19 20:34:35.763599 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 19 20:34:35.763599 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [parameters: {'id': '6bcc6d6a12b34558a986c7bd9b9528cf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 19 20:34:35.763599 dv-cinder-749155-8-smb devstack@keystone.service[92087]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92087) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 20:34:35.782344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-f5cdfa1a-6e9d-492c-b943-40c8b5cbfe04 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 19 20:34:35.782344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:35.782344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 20:34:35.782344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 20:34:35.782344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 20:34:35.782344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 20:34:35.782344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 20:34:35.782344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 20:34:35.782344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 20:34:35.782344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application conn.query(q) Jul 19 20:34:35.782344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 20:34:35.782344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 20:34:35.782344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 20:34:35.782344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application result.read() Jul 19 20:34:35.782344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 20:34:35.783313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 20:34:35.783313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 20:34:35.783313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 20:34:35.783313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 20:34:35.783313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 20:34:35.783313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 20:34:35.783313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 20:34:35.783313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 19 20:34:35.783313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:35.783313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 20:34:35.783313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:35.783313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:35.783313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 20:34:35.783313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 20:34:35.783313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 19 20:34:35.783313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return ref.to_dict() Jul 19 20:34:35.783313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 20:34:35.783313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application next(self.gen) Jul 19 20:34:35.784530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 20:34:35.784530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application yield resource Jul 19 20:34:35.784530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 20:34:35.784530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application next(self.gen) Jul 19 20:34:35.784530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 20:34:35.784530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 20:34:35.784530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 20:34:35.784530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 20:34:35.784530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 20:34:35.784530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise self.value Jul 19 20:34:35.784530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 20:34:35.784530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 20:34:35.784530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 20:34:35.784530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application session.commit() Jul 19 20:34:35.784530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 20:34:35.784530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 20:34:35.784530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 20:34:35.785501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 20:34:35.785501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 20:34:35.785501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self.session.flush() Jul 19 20:34:35.785501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 20:34:35.785501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 20:34:35.785501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 20:34:35.785501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 20:34:35.785501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 20:34:35.785501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application compat.raise_( Jul 19 20:34:35.785501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 20:34:35.785501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception Jul 19 20:34:35.785501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 20:34:35.785501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 20:34:35.785501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 20:34:35.785501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 20:34:35.785501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 20:34:35.785501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 20:34:35.786597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 20:34:35.786597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 20:34:35.786597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 19 20:34:35.786597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 19 20:34:35.786597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 20:34:35.786597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 20:34:35.786597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 20:34:35.786597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 20:34:35.786597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 20:34:35.786597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 20:34:35.786597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 20:34:35.786597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 20:34:35.786597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 20:34:35.786597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 20:34:35.786597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 20:34:35.786597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception Jul 19 20:34:35.787565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 20:34:35.787565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 20:34:35.787565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 20:34:35.787565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 20:34:35.787565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 20:34:35.787565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 20:34:35.787565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 20:34:35.787565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application conn.query(q) Jul 19 20:34:35.787565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 20:34:35.787565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 20:34:35.787565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 20:34:35.787565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application result.read() Jul 19 20:34:35.787565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 20:34:35.787565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 20:34:35.787565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 20:34:35.787565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 20:34:35.788554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 20:34:35.788554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 20:34:35.788554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 20:34:35.788554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 20:34:35.788554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 19 20:34:35.788554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 19 20:34:35.788554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [parameters: {'id': '6bcc6d6a12b34558a986c7bd9b9528cf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 19 20:34:35.788554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 20:34:35.788554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:35.788554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:34:35.788554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:35.788554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:35.788554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:35.788554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:35.788554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:35.788554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:35.789445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:35.789445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:35.789445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:35.789445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:35.789445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:35.789445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:35.789445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 19 20:34:35.789445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 19 20:34:35.789445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:35.789445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:35.789445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 19 20:34:35.789445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 19 20:34:35.789445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 20:34:35.789445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 20:34:35.789445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 19 20:34:35.789445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:35.792307 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 241/478] 10.222.0.77 () {60 vars in 1131 bytes} [Tue Jul 19 20:34:35 2022] POST /identity/v3/roles => generated 144 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:35.798220 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a93152-3c66-47ad-8d40-daf405786b4e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:35.891367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:35.931048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a93152-3c66-47ad-8d40-daf405786b4e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:35.968124 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bded996-ee2e-4344-8b45-d2ed1f17844b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:35.968953 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bded996-ee2e-4344-8b45-d2ed1f17844b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:35.969239 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bded996-ee2e-4344-8b45-d2ed1f17844b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:35.969519 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bded996-ee2e-4344-8b45-d2ed1f17844b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:35.983183 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bded996-ee2e-4344-8b45-d2ed1f17844b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:35.991552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-2bded996-ee2e-4344-8b45-d2ed1f17844b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:34:35.991552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:35.991552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:35.991552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:35.991552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:35.991552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:35.991552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:35.991552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:35.991552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:35.991552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:35.991552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:35.991552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:35.991552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:35.991552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:35.991552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:35.991552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:35.992428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:35.992428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:35.992428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:35.992428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:35.992428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:35.992428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:35.992428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:35.992428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:35.992428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:35.992428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:35.992428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:35.992428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:35.992428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:35.992428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:35.992428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:35.992428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:35.993219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:35.993219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:35.993219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:35.993219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:35.993219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:35.993219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:35.993219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:35.993219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:35.993219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:35.993219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:35.993219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 20:34:35.993219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:35.993219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 238/479] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jul 19 20:34:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:34:35.998407 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdfa1a-6e9d-492c-b943-40c8b5cbfe04 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:36.116514 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdfa1a-6e9d-492c-b943-40c8b5cbfe04 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:36.142213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:36.155152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4233e5-cdb4-4ef5-b5dd-c55bfe7fd5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:36.155992 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4233e5-cdb4-4ef5-b5dd-c55bfe7fd5df None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:36.156553 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4233e5-cdb4-4ef5-b5dd-c55bfe7fd5df None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:36.156857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4233e5-cdb4-4ef5-b5dd-c55bfe7fd5df None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:36.157692 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4233e5-cdb4-4ef5-b5dd-c55bfe7fd5df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:36.159016 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4233e5-cdb4-4ef5-b5dd-c55bfe7fd5df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:36.161367 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4233e5-cdb4-4ef5-b5dd-c55bfe7fd5df None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:36.173140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 242/480] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:37.272878 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3c894-0157-4228-a5ce-17a7e2d4ae5d None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:37.273418 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3c894-0157-4228-a5ce-17a7e2d4ae5d None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:37.273504 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3c894-0157-4228-a5ce-17a7e2d4ae5d None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:37.275164 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 239/481] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:37.280860 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a9982-997c-44e6-bcd3-9169f50caf0f None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:37.281268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a9982-997c-44e6-bcd3-9169f50caf0f None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:37.281451 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a9982-997c-44e6-bcd3-9169f50caf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:37.298737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-975a9982-997c-44e6-bcd3-9169f50caf0f None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:37.299959 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-975a9982-997c-44e6-bcd3-9169f50caf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:37.390569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 243/482] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:37.414998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3c894-0157-4228-a5ce-17a7e2d4ae5d None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:37.563752 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3c894-0157-4228-a5ce-17a7e2d4ae5d None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:37.595945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:37.602432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c80f6-044c-4feb-aeb7-8af0f6072637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:37.603317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c80f6-044c-4feb-aeb7-8af0f6072637 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:37.603761 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c80f6-044c-4feb-aeb7-8af0f6072637 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:37.604232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c80f6-044c-4feb-aeb7-8af0f6072637 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:37.618927 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c80f6-044c-4feb-aeb7-8af0f6072637 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:37.631594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-ed6c80f6-044c-4feb-aeb7-8af0f6072637 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:37.631594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:37.631594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:37.631594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:37.631594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:37.631594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:37.631594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:37.631594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:37.631594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:37.631594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:37.631594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:37.631594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:37.631594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:37.631594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:37.631594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:37.631594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:37.632471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:37.632471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:37.632471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:37.632471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:37.632471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:37.632471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:37.632471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:37.632471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:37.632471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:37.632471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:37.632471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:37.632471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:37.632471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:37.632471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:37.632471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:37.632471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:37.633334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:37.633334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:37.633334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:37.633334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:37.633334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:37.633334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:37.633334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:37.633334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:37.633334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:37.633334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:37.633334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:37.633334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:37.633334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 240/483] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:34:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:37.638889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a9982-997c-44e6-bcd3-9169f50caf0f None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:37.773632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a9982-997c-44e6-bcd3-9169f50caf0f None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:37.798873 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:37.828963 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b40c8-c445-41dc-ade3-98025e161f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:37.829569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b40c8-c445-41dc-ade3-98025e161f6c None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:37.829857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b40c8-c445-41dc-ade3-98025e161f6c None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:37.830135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b40c8-c445-41dc-ade3-98025e161f6c None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:37.830897 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b40c8-c445-41dc-ade3-98025e161f6c None admin] RBAC: Adding query filter params (name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:37.831205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b40c8-c445-41dc-ade3-98025e161f6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:37.833144 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b40c8-c445-41dc-ade3-98025e161f6c None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:37.835664 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6906d-ee91-413f-bb99-fa1e0b0bbcdc None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:37.835954 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6906d-ee91-413f-bb99-fa1e0b0bbcdc None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:37.836231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6906d-ee91-413f-bb99-fa1e0b0bbcdc None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:37.837719 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 241/484] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:34:37.844886 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059c6f5-78e4-4e2d-bbcc-3271d5c678a1 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:37.844886 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059c6f5-78e4-4e2d-bbcc-3271d5c678a1 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:37.844886 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059c6f5-78e4-4e2d-bbcc-3271d5c678a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:37.849526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 244/485] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jul 19 20:34:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:37.855663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b40c8-c445-41dc-ade3-98025e161f6c None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:37.872400 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-4059c6f5-78e4-4e2d-bbcc-3271d5c678a1 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:37.873935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-4059c6f5-78e4-4e2d-bbcc-3271d5c678a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:37.998140 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 242/486] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:38.039398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b40c8-c445-41dc-ade3-98025e161f6c None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:38.058961 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059c6f5-78e4-4e2d-bbcc-3271d5c678a1 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:38.081983 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b05188-35d0-42b3-b611-a7be48de3bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:38.083112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b05188-35d0-42b3-b611-a7be48de3bd0 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:38.083638 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b05188-35d0-42b3-b611-a7be48de3bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:38.084112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b05188-35d0-42b3-b611-a7be48de3bd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:38.097884 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b05188-35d0-42b3-b611-a7be48de3bd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:38.100395 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b05188-35d0-42b3-b611-a7be48de3bd0 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:38.122519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-46b05188-35d0-42b3-b611-a7be48de3bd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:38.122519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:38.122519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:38.122519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:38.122519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:38.122519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:38.122519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:38.122519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:38.122519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:38.122519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:38.122519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:38.122519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:38.122519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:38.122519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:38.122519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:38.123495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:38.123495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:38.123495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:38.123495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:38.123495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:38.123495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:38.123495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:38.123495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:38.123495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:38.123495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:38.123495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:38.123495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:38.123495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:38.123495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:38.123495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:38.123495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:38.123495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:38.124359 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:38.124359 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:38.124359 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:38.124359 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:38.125254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 245/487] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:38.126337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd61d28-36cc-4adf-957d-1aed5f6e4605 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:38.126621 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd61d28-36cc-4adf-957d-1aed5f6e4605 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:38.126895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd61d28-36cc-4adf-957d-1aed5f6e4605 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:38.128168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 246/488] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:38.132138 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd61d28-36cc-4adf-957d-1aed5f6e4605 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:38.165668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:38.176791 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059c6f5-78e4-4e2d-bbcc-3271d5c678a1 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:38.202714 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:38.215777 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a6b7b4-8150-4bf8-95b8-05e75234f018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:38.216984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6b7b4-8150-4bf8-95b8-05e75234f018 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:38.217530 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6b7b4-8150-4bf8-95b8-05e75234f018 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:38.218001 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a6b7b4-8150-4bf8-95b8-05e75234f018 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:38.229811 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a6b7b4-8150-4bf8-95b8-05e75234f018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:38.239107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-f8a6b7b4-8150-4bf8-95b8-05e75234f018 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:38.239107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:38.239107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:38.239107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:38.239107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:38.239107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:38.239107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:38.239107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:38.239107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:38.239107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:38.239107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:38.239107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:38.239107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:38.239107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:38.239107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:38.239107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:38.240062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:38.240062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:38.240062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:38.240062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:38.240062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:38.240062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:38.240062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:38.240062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:38.240062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:38.240062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:38.240062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:38.240062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:38.240062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:38.240062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:38.240062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:38.240062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:38.240863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:38.240863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:38.240863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:38.240863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:38.240863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:38.240863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:38.240863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:38.240863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:38.240863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:38.240863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:38.240863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:38.240863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:38.247980 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd61d28-36cc-4adf-957d-1aed5f6e4605 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:38.248426 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 243/489] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:34:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:34:38.249912 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1eebc0-c109-4ffb-9acc-f5293cbc8a75 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:38.250399 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1eebc0-c109-4ffb-9acc-f5293cbc8a75 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:38.250874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1eebc0-c109-4ffb-9acc-f5293cbc8a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:38.268733 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-7e1eebc0-c109-4ffb-9acc-f5293cbc8a75 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:38.270346 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7e1eebc0-c109-4ffb-9acc-f5293cbc8a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:38.280422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5378ef7-1091-4509-860c-c1eb4cd3e510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:38.281227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5378ef7-1091-4509-860c-c1eb4cd3e510 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:38.281756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5378ef7-1091-4509-860c-c1eb4cd3e510 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:38.281756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5378ef7-1091-4509-860c-c1eb4cd3e510 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:38.282523 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5378ef7-1091-4509-860c-c1eb4cd3e510 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:38.282823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5378ef7-1091-4509-860c-c1eb4cd3e510 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:38.284662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5378ef7-1091-4509-860c-c1eb4cd3e510 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:38.298732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 247/490] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:38.299674 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5378ef7-1091-4509-860c-c1eb4cd3e510 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:38.351958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 244/491] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:38.353649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1eebc0-c109-4ffb-9acc-f5293cbc8a75 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:38.396112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:38.406081 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5378ef7-1091-4509-860c-c1eb4cd3e510 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:38.443643 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe46f7b-1acb-41ba-a830-88a1c9fba1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:38.444357 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe46f7b-1acb-41ba-a830-88a1c9fba1ce None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:38.444655 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe46f7b-1acb-41ba-a830-88a1c9fba1ce None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:38.444912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe46f7b-1acb-41ba-a830-88a1c9fba1ce None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:38.445659 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe46f7b-1acb-41ba-a830-88a1c9fba1ce None admin] RBAC: Adding query filter params (name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:38.445961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe46f7b-1acb-41ba-a830-88a1c9fba1ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:38.447496 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe46f7b-1acb-41ba-a830-88a1c9fba1ce None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:38.456317 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 248/492] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jul 19 20:34:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:38.457710 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe46f7b-1acb-41ba-a830-88a1c9fba1ce None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:38.482557 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1eebc0-c109-4ffb-9acc-f5293cbc8a75 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:38.497772 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:38.524308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5fd9e-0e9a-4bff-bf59-c55b043be02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:38.525502 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5fd9e-0e9a-4bff-bf59-c55b043be02c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:38.526290 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5fd9e-0e9a-4bff-bf59-c55b043be02c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:38.526792 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5fd9e-0e9a-4bff-bf59-c55b043be02c None admin] PATH_INFO: `/v3/users/nova` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:38.540667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5fd9e-0e9a-4bff-bf59-c55b043be02c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:38.543048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5fd9e-0e9a-4bff-bf59-c55b043be02c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:38.566717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-b4a5fd9e-0e9a-4bff-bf59-c55b043be02c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 20:34:38.566717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:38.566717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:38.566717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:38.566717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:38.566717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:38.566717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:38.566717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:38.566717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:38.566717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:38.566717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:38.566717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:38.566717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:34:38.566717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:34:38.566717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:34:38.566717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:34:38.567727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:38.567727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:38.567727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:34:38.567727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:38.567727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:34:38.567727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:38.567727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:38.567727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:38.567727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:38.567727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:38.567727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:38.567727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:38.567727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:38.567727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:38.567727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:38.567727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:38.567727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:38.567727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:38.569024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:38.569024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:38.569024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:34:38.569024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:34:38.569024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:34:38.569024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:34:38.569024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:34:38.569024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:34:38.569024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 20:34:38.569024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:38.569784 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe46f7b-1acb-41ba-a830-88a1c9fba1ce None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:38.569858 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 245/493] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Jul 19 20:34:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:38.572574 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5fd9e-0e9a-4bff-bf59-c55b043be02c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:38.618309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5984f2-eda6-4853-a211-4ccea381afa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:38.619198 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5984f2-eda6-4853-a211-4ccea381afa2 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:38.619904 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5984f2-eda6-4853-a211-4ccea381afa2 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:38.620465 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5984f2-eda6-4853-a211-4ccea381afa2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:38.637154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5984f2-eda6-4853-a211-4ccea381afa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:38.648732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-0e5984f2-eda6-4853-a211-4ccea381afa2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:38.648732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:38.648732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:38.648732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:38.648732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:38.648732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:38.648732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:38.648732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:38.648732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:38.648732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:38.648732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:38.648732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:38.648732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:38.648732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:38.648732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:38.648732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:38.650906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:38.650906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:38.650906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:38.650906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:38.650906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:38.650906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:38.650906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:38.650906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:38.650906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:38.650906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:38.650906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:38.650906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:38.650906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:38.650906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:38.650906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:38.650906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:38.652818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:38.652818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:38.652818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:38.652818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:38.652818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:38.652818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:38.652818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:38.652818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:38.652818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:38.652818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:38.652818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:38.652818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:38.652818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 249/494] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:34:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:38.652818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5984f2-eda6-4853-a211-4ccea381afa2 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:38.667868 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:38.679432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5fd9e-0e9a-4bff-bf59-c55b043be02c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:38.712717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8820d2e-b70b-4037-9af3-c84d07a07f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:38.713541 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8820d2e-b70b-4037-9af3-c84d07a07f29 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:38.713820 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8820d2e-b70b-4037-9af3-c84d07a07f29 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:38.714093 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8820d2e-b70b-4037-9af3-c84d07a07f29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:38.724218 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8820d2e-b70b-4037-9af3-c84d07a07f29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:38.725666 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8820d2e-b70b-4037-9af3-c84d07a07f29 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:38.743834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-b8820d2e-b70b-4037-9af3-c84d07a07f29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:38.743834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:38.743834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:38.743834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:38.743834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:38.743834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:38.743834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:38.743834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:38.743834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:38.743834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:38.743834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:38.743834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:38.743834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:38.743834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:38.743834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:38.744736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:38.744736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:38.744736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:38.744736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:38.744736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:38.744736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:38.744736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:38.744736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:38.744736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:38.744736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:38.744736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:38.744736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:38.744736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:38.744736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:38.744736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:38.744736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:38.744736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:38.750781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:38.750781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:38.750781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:38.750781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:38.750781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 246/495] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:38.750781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acaeb7-a987-4784-b9fc-10c530f20a2f None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:38.750781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acaeb7-a987-4784-b9fc-10c530f20a2f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:38.750781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acaeb7-a987-4784-b9fc-10c530f20a2f None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:38.750781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 247/496] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:38.751332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acaeb7-a987-4784-b9fc-10c530f20a2f None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:38.768005 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5984f2-eda6-4853-a211-4ccea381afa2 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:38.784774 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:38.805365 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e28eaf-7bcd-49d8-b344-8db0f0d44dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:38.806040 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e28eaf-7bcd-49d8-b344-8db0f0d44dcd None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:38.806678 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e28eaf-7bcd-49d8-b344-8db0f0d44dcd None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:38.806956 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e28eaf-7bcd-49d8-b344-8db0f0d44dcd None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:38.808135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e28eaf-7bcd-49d8-b344-8db0f0d44dcd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:38.808577 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e28eaf-7bcd-49d8-b344-8db0f0d44dcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:38.809960 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e28eaf-7bcd-49d8-b344-8db0f0d44dcd None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:38.848394 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 250/497] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Jul 19 20:34:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:38.848837 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e28eaf-7bcd-49d8-b344-8db0f0d44dcd None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:38.872967 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acaeb7-a987-4784-b9fc-10c530f20a2f None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:38.912991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173f7f6-fd9c-4b82-baf5-68adc281346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:38.913665 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173f7f6-fd9c-4b82-baf5-68adc281346c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:38.913939 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173f7f6-fd9c-4b82-baf5-68adc281346c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:38.914210 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173f7f6-fd9c-4b82-baf5-68adc281346c None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:38.914952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173f7f6-fd9c-4b82-baf5-68adc281346c None admin] RBAC: Adding query filter params (name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:38.915254 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173f7f6-fd9c-4b82-baf5-68adc281346c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:38.916632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173f7f6-fd9c-4b82-baf5-68adc281346c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:38.923526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:38.924523 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 248/498] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jul 19 20:34:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:38.926268 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7987f-379b-44da-b17c-0198390a768a None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:38.926590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7987f-379b-44da-b17c-0198390a768a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:38.926817 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7987f-379b-44da-b17c-0198390a768a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:38.942484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-79e7987f-379b-44da-b17c-0198390a768a None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:38.943710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-79e7987f-379b-44da-b17c-0198390a768a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:38.955878 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e28eaf-7bcd-49d8-b344-8db0f0d44dcd None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:38.990579 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c1af1-9a61-41a0-a9d7-753e83814cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:38.991577 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c1af1-9a61-41a0-a9d7-753e83814cc8 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:38.991880 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c1af1-9a61-41a0-a9d7-753e83814cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:38.992181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c1af1-9a61-41a0-a9d7-753e83814cc8 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:38.992931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c1af1-9a61-41a0-a9d7-753e83814cc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:38.993266 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c1af1-9a61-41a0-a9d7-753e83814cc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:38.994757 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c1af1-9a61-41a0-a9d7-753e83814cc8 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:39.005833 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 251/499] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:39.006621 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c1af1-9a61-41a0-a9d7-753e83814cc8 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:39.009888 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 249/500] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:39.011191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032d7ba-3525-4cbc-b586-52d49b241488 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:39.011533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032d7ba-3525-4cbc-b586-52d49b241488 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:39.011844 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032d7ba-3525-4cbc-b586-52d49b241488 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:39.013141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 250/501] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:39.013836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032d7ba-3525-4cbc-b586-52d49b241488 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:39.038797 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:39.116397 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c1af1-9a61-41a0-a9d7-753e83814cc8 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:39.121563 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b032d7ba-3525-4cbc-b586-52d49b241488 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:39.144637 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:39.150624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4d437-9bd6-44e9-a127-4b17563635a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:39.151282 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4d437-9bd6-44e9-a127-4b17563635a2 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:39.151582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4d437-9bd6-44e9-a127-4b17563635a2 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:39.151863 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4d437-9bd6-44e9-a127-4b17563635a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:39.156331 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28173204-b411-4e56-b80c-3e5774eb6f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:39.157119 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28173204-b411-4e56-b80c-3e5774eb6f49 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:39.157400 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28173204-b411-4e56-b80c-3e5774eb6f49 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:39.157672 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28173204-b411-4e56-b80c-3e5774eb6f49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:39.168492 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28173204-b411-4e56-b80c-3e5774eb6f49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:39.169931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28173204-b411-4e56-b80c-3e5774eb6f49 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:39.187970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-28173204-b411-4e56-b80c-3e5774eb6f49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:39.187970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:39.187970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:39.187970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:39.187970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:39.187970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:39.187970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:39.187970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:39.187970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:39.187970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:39.187970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:39.187970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:39.187970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:39.187970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:39.187970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:39.188946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:39.188946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:39.188946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:39.188946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:39.188946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:39.188946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:39.188946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:39.188946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:39.188946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:39.188946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:39.188946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:39.188946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:39.188946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:39.188946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:39.188946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:39.188946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:39.188946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:39.189904 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:39.189904 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:39.189904 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:39.189904 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:39.189904 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 251/502] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:39.190454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28173204-b411-4e56-b80c-3e5774eb6f49 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:39.224466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4d437-9bd6-44e9-a127-4b17563635a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:39.225953 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4d437-9bd6-44e9-a127-4b17563635a2 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:39.255869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:39.289295 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28173204-b411-4e56-b80c-3e5774eb6f49 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:39.323514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c9995-a71b-40a6-baa1-734647bc76e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:39.323712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 252/503] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:39.324314 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c9995-a71b-40a6-baa1-734647bc76e5 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:39.324591 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c9995-a71b-40a6-baa1-734647bc76e5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:39.324793 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5952147-f7d2-49f2-9577-1fb37896f968 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:39.324904 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c9995-a71b-40a6-baa1-734647bc76e5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:39.325079 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5952147-f7d2-49f2-9577-1fb37896f968 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:39.325353 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5952147-f7d2-49f2-9577-1fb37896f968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:39.335648 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c9995-a71b-40a6-baa1-734647bc76e5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:39.337082 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c9995-a71b-40a6-baa1-734647bc76e5 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:39.343306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-b5952147-f7d2-49f2-9577-1fb37896f968 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:39.344489 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b5952147-f7d2-49f2-9577-1fb37896f968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:39.352161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-e66c9995-a71b-40a6-baa1-734647bc76e5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 20:34:39.352161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:39.352161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:39.352161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:39.352161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:39.352161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:39.352161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:39.352161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:39.352161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:39.352161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:39.352161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:39.352161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:39.352161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:34:39.352161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:34:39.352161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:34:39.352161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:34:39.353459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:39.353459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:39.353459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:34:39.353459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:39.353459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:34:39.353459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:39.353459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:39.353459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:39.353459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:39.353459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:39.353459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:39.353459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:39.353459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:39.353459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:39.353459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:39.353459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:39.353459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:39.353459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:39.354357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:39.354357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:39.354357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:34:39.354357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:34:39.354357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:34:39.354357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:34:39.354357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:34:39.354357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:34:39.354357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 20:34:39.354357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:39.354357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 252/504] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:39.354357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c9995-a71b-40a6-baa1-734647bc76e5 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:39.372064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:39.416604 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 253/505] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:39.417679 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5952147-f7d2-49f2-9577-1fb37896f968 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:39.464861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c9995-a71b-40a6-baa1-734647bc76e5 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:39.492854 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:39.502025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f784e6-0233-45c0-a297-44557a63261c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:39.502823 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f784e6-0233-45c0-a297-44557a63261c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:39.503107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f784e6-0233-45c0-a297-44557a63261c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:39.503415 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f784e6-0233-45c0-a297-44557a63261c None admin] PATH_INFO: `/v3/roles/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:39.514064 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f784e6-0233-45c0-a297-44557a63261c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:39.518631 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5952147-f7d2-49f2-9577-1fb37896f968 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:39.522385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-a5f784e6-0233-45c0-a297-44557a63261c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:39.522385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:39.522385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:39.522385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:39.522385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:39.522385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:39.522385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:39.522385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:39.522385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:39.522385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:39.522385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:39.522385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:39.522385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:39.522385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:39.522385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:39.522385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:39.523477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:39.523477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:39.523477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:39.523477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:39.523477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:39.523477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:39.523477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:39.523477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:39.523477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:39.523477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:39.523477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:39.523477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:39.523477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:39.523477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:39.523477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:39.523477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:39.524355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:39.524355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:39.524355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:39.524355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:39.524355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:39.524355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:39.524355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:39.524355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:39.524355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:39.524355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:39.524355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:39.524355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:39.524355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 253/506] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:34:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:39.525064 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f784e6-0233-45c0-a297-44557a63261c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:39.556606 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e0593-b562-420d-be2e-565e8d10190b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:39.557264 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e0593-b562-420d-be2e-565e8d10190b None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:39.557546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e0593-b562-420d-be2e-565e8d10190b None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:39.557823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e0593-b562-420d-be2e-565e8d10190b None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:39.558547 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e0593-b562-420d-be2e-565e8d10190b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:39.558853 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e0593-b562-420d-be2e-565e8d10190b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:39.560260 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329e0593-b562-420d-be2e-565e8d10190b None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:39.571233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 254/507] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:39.574714 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e0593-b562-420d-be2e-565e8d10190b None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:39.598150 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:39.625641 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f784e6-0233-45c0-a297-44557a63261c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:39.658935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a87f4-13a0-4464-84d1-ce9b68276a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:39.660070 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a87f4-13a0-4464-84d1-ce9b68276a8f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:39.660339 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a87f4-13a0-4464-84d1-ce9b68276a8f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:39.660611 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a87f4-13a0-4464-84d1-ce9b68276a8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:39.671043 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a87f4-13a0-4464-84d1-ce9b68276a8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:39.672465 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78a87f4-13a0-4464-84d1-ce9b68276a8f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:39.677557 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e0593-b562-420d-be2e-565e8d10190b None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:39.689313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-f78a87f4-13a0-4464-84d1-ce9b68276a8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:39.689313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:39.689313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:39.689313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:39.689313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:39.689313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:39.689313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:39.689313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:39.689313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:39.689313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:39.689313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:39.689313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:39.689313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:39.689313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:39.689313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:39.690257 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:39.690257 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:39.690257 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:39.690257 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:39.690257 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:39.690257 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:39.690257 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:39.690257 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:39.690257 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:39.690257 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:39.690257 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:39.690257 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:39.690257 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:39.690257 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:39.690257 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:39.690257 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:39.690257 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:39.696672 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:39.696672 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:39.696672 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:39.696672 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:39.696672 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 254/508] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:39.696672 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a87f4-13a0-4464-84d1-ce9b68276a8f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:39.712782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb80c48-7775-4923-8d18-1570b0863462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:39.713468 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb80c48-7775-4923-8d18-1570b0863462 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:39.713738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb80c48-7775-4923-8d18-1570b0863462 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:39.714013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb80c48-7775-4923-8d18-1570b0863462 None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:39.714856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb80c48-7775-4923-8d18-1570b0863462 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:39.715164 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb80c48-7775-4923-8d18-1570b0863462 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:39.716621 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb80c48-7775-4923-8d18-1570b0863462 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:39.733137 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:39.734123 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 255/509] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Jul 19 20:34:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:39.734963 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb80c48-7775-4923-8d18-1570b0863462 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:39.799399 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78a87f4-13a0-4464-84d1-ce9b68276a8f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:39.834000 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:39.835336 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb2294-de1d-48d2-b9be-663a7f658935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:39.836224 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb2294-de1d-48d2-b9be-663a7f658935 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:39.836505 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb2294-de1d-48d2-b9be-663a7f658935 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:39.836778 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb2294-de1d-48d2-b9be-663a7f658935 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:39.847217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb2294-de1d-48d2-b9be-663a7f658935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:39.848717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb2294-de1d-48d2-b9be-663a7f658935 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:39.856367 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb80c48-7775-4923-8d18-1570b0863462 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:39.865539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-7beb2294-de1d-48d2-b9be-663a7f658935 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:39.865539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:39.865539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:39.865539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:39.865539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:39.865539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:39.865539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:39.865539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:39.865539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:39.865539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:39.865539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:39.865539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:39.865539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:39.865539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:39.865539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:39.866567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:39.866567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:39.866567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:39.866567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:39.866567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:39.866567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:39.866567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:39.866567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:39.866567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:39.866567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:39.866567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:39.866567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:39.866567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:39.866567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:39.866567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:39.866567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:39.866567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:39.867470 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:39.867470 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:39.867470 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:39.867470 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:39.867470 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 255/510] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:39.867744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb2294-de1d-48d2-b9be-663a7f658935 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:39.897065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f74e19-6862-42a4-a9e5-fb683495f135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:39.897745 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f74e19-6862-42a4-a9e5-fb683495f135 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:39.898037 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f74e19-6862-42a4-a9e5-fb683495f135 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:39.898313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f74e19-6862-42a4-a9e5-fb683495f135 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:39.899100 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f74e19-6862-42a4-a9e5-fb683495f135 None admin] RBAC: Adding query filter params (name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:39.899462 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f74e19-6862-42a4-a9e5-fb683495f135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:39.900898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f74e19-6862-42a4-a9e5-fb683495f135 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:39.909099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 256/511] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jul 19 20:34:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:39.910647 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f74e19-6862-42a4-a9e5-fb683495f135 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:39.964833 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:39.973974 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb2294-de1d-48d2-b9be-663a7f658935 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:40.007457 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cee85-7f10-44f6-a35d-edc4bef1329d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:40.008243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cee85-7f10-44f6-a35d-edc4bef1329d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:40.008528 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cee85-7f10-44f6-a35d-edc4bef1329d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:40.008801 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7cee85-7f10-44f6-a35d-edc4bef1329d None admin] PATH_INFO: `/v3/users/glance` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:40.010493 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f74e19-6862-42a4-a9e5-fb683495f135 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:40.016214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7cee85-7f10-44f6-a35d-edc4bef1329d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:40.017659 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7cee85-7f10-44f6-a35d-edc4bef1329d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:40.032027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-5d7cee85-7f10-44f6-a35d-edc4bef1329d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 19 20:34:40.032027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:40.032027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:40.032027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:40.032027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:40.032027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:40.032027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:40.032027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:40.032027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:40.032027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:40.032027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:40.032027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:40.032027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:34:40.032027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:34:40.032027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:34:40.032027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:34:40.032896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:40.032896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:40.032896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:34:40.032896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:40.032896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:34:40.032896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:40.032896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:40.032896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:40.032896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:40.032896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:40.032896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:40.032896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:40.032896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:40.032896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:40.032896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:40.032896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:40.032896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:40.032896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:40.033991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:40.033991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:40.033991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:34:40.033991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:34:40.033991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:34:40.033991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:34:40.033991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:34:40.033991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:34:40.033991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 19 20:34:40.033991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:40.033991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 256/512] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:40.035103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cee85-7f10-44f6-a35d-edc4bef1329d None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:40.048412 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becb4e5-a75f-4b4f-a69c-53909b1ab31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:40.049075 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becb4e5-a75f-4b4f-a69c-53909b1ab31f None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:40.049361 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becb4e5-a75f-4b4f-a69c-53909b1ab31f None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:40.049637 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becb4e5-a75f-4b4f-a69c-53909b1ab31f None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:40.050361 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6becb4e5-a75f-4b4f-a69c-53909b1ab31f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:40.051189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6becb4e5-a75f-4b4f-a69c-53909b1ab31f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:40.052583 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6becb4e5-a75f-4b4f-a69c-53909b1ab31f None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:40.061298 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:40.064868 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 257/513] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:40.065911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becb4e5-a75f-4b4f-a69c-53909b1ab31f None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:40.145723 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7cee85-7f10-44f6-a35d-edc4bef1329d None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:40.172401 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becb4e5-a75f-4b4f-a69c-53909b1ab31f None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:40.179925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13f98d-bb4d-4579-92b4-dd18f5df1a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:40.180570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13f98d-bb4d-4579-92b4-dd18f5df1a0b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:40.180852 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13f98d-bb4d-4579-92b4-dd18f5df1a0b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:40.181128 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13f98d-bb4d-4579-92b4-dd18f5df1a0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:40.202597 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:40.208532 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff24b9-0fec-4407-9e1d-a15a833bc711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:40.209190 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff24b9-0fec-4407-9e1d-a15a833bc711 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:40.209462 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff24b9-0fec-4407-9e1d-a15a833bc711 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:40.209749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff24b9-0fec-4407-9e1d-a15a833bc711 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:40.210462 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff24b9-0fec-4407-9e1d-a15a833bc711 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:40.210769 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff24b9-0fec-4407-9e1d-a15a833bc711 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:40.212176 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff24b9-0fec-4407-9e1d-a15a833bc711 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:40.223705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 258/514] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:40.224229 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff24b9-0fec-4407-9e1d-a15a833bc711 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:40.252254 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13f98d-bb4d-4579-92b4-dd18f5df1a0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:40.254318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13f98d-bb4d-4579-92b4-dd18f5df1a0b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:40.285733 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:40.327411 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff24b9-0fec-4407-9e1d-a15a833bc711 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:40.351939 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 257/515] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:40.352772 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13f98d-bb4d-4579-92b4-dd18f5df1a0b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:40.364106 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647041b6-6b09-4983-a335-3e57dae76c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:40.364906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647041b6-6b09-4983-a335-3e57dae76c7a None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:40.365188 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647041b6-6b09-4983-a335-3e57dae76c7a None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:40.365465 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647041b6-6b09-4983-a335-3e57dae76c7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:40.375848 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647041b6-6b09-4983-a335-3e57dae76c7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:40.377313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647041b6-6b09-4983-a335-3e57dae76c7a None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:40.395104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-647041b6-6b09-4983-a335-3e57dae76c7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:40.395104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:40.395104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:40.395104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:40.395104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:40.395104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:40.395104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:40.395104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:40.395104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:40.395104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:40.395104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:40.395104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:40.395104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:40.395104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:40.395104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:40.396152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:40.396152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:40.396152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:40.396152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:40.396152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:40.396152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:40.396152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:40.396152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:40.396152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:40.396152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:40.396152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:40.396152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:40.396152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:40.396152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:40.396152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:40.396152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:40.396152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:40.397017 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:40.397017 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:40.397017 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:40.397017 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:40.399406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 259/516] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:40.400440 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647041b6-6b09-4983-a335-3e57dae76c7a None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:40.407255 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:40.459357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13f98d-bb4d-4579-92b4-dd18f5df1a0b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:40.492844 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1432d-e6de-4335-af7b-7af95374c301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:40.493438 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1432d-e6de-4335-af7b-7af95374c301 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:40.493720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1432d-e6de-4335-af7b-7af95374c301 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:40.493995 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1432d-e6de-4335-af7b-7af95374c301 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:40.494825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1432d-e6de-4335-af7b-7af95374c301 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:40.495131 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1432d-e6de-4335-af7b-7af95374c301 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:40.496574 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1432d-e6de-4335-af7b-7af95374c301 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:40.501672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647041b6-6b09-4983-a335-3e57dae76c7a None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:40.514914 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:40.532990 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 258/517] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Jul 19 20:34:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:40.533699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1432d-e6de-4335-af7b-7af95374c301 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:40.541741 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62fa22-8af4-4015-8ecf-630ef8adce00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:40.542544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62fa22-8af4-4015-8ecf-630ef8adce00 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:40.542838 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62fa22-8af4-4015-8ecf-630ef8adce00 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:40.543148 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62fa22-8af4-4015-8ecf-630ef8adce00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:40.550147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62fa22-8af4-4015-8ecf-630ef8adce00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:40.552177 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62fa22-8af4-4015-8ecf-630ef8adce00 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:40.566990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-8a62fa22-8af4-4015-8ecf-630ef8adce00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:40.566990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:40.566990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:40.566990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:40.566990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:40.566990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:40.566990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:40.566990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:40.566990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:40.566990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:40.566990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:40.566990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:40.566990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:34:40.566990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:34:40.566990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:34:40.567998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:34:40.567998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:40.567998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:40.567998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:40.567998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:40.567998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:40.567998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:40.567998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:40.567998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:40.567998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:40.567998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:40.567998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:40.567998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:40.567998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:40.567998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:40.567998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:40.567998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:40.568865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:34:40.568865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:34:40.568865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:34:40.568865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:34:40.568865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:34:40.568865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:34:40.568865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:40.568865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:40.568865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 260/518] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:40.569331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62fa22-8af4-4015-8ecf-630ef8adce00 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:40.637768 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1432d-e6de-4335-af7b-7af95374c301 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:40.648067 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:40.668643 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62fa22-8af4-4015-8ecf-630ef8adce00 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:40.671686 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e261a-5135-439c-bd36-03917ae9197f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:40.672355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e261a-5135-439c-bd36-03917ae9197f None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:40.672641 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e261a-5135-439c-bd36-03917ae9197f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:40.672922 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e261a-5135-439c-bd36-03917ae9197f None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:40.673628 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e261a-5135-439c-bd36-03917ae9197f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:40.675106 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e261a-5135-439c-bd36-03917ae9197f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:40.694669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 259/519] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jul 19 20:34:40 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:34:40.695504 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e261a-5135-439c-bd36-03917ae9197f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:40.718213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1829b9b-c2a6-43c3-878b-08509dadd87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:40.719037 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1829b9b-c2a6-43c3-878b-08509dadd87e None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:40.719357 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1829b9b-c2a6-43c3-878b-08509dadd87e None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:40.719639 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1829b9b-c2a6-43c3-878b-08509dadd87e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:40.732661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1829b9b-c2a6-43c3-878b-08509dadd87e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:40.734224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1829b9b-c2a6-43c3-878b-08509dadd87e None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:40.758320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-a1829b9b-c2a6-43c3-878b-08509dadd87e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:40.758320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:40.758320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:40.758320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:40.758320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:40.758320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:40.758320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:40.758320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:40.758320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:40.758320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:40.758320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:40.758320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:40.758320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:40.758320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:40.758320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:40.759435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:40.759435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:40.759435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:40.759435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:40.759435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:40.759435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:40.759435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:40.759435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:40.759435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:40.759435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:40.759435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:40.759435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:40.759435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:40.759435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:40.759435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:40.759435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:40.759435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:40.760308 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:40.760308 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:40.760308 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:40.760308 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:40.760308 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 261/520] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:40.761103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1829b9b-c2a6-43c3-878b-08509dadd87e None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:40.789303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:40.826765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e261a-5135-439c-bd36-03917ae9197f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:40.865871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0e033-5462-4e66-9c68-194eb77ac890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:40.866540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0e033-5462-4e66-9c68-194eb77ac890 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:40.866818 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0e033-5462-4e66-9c68-194eb77ac890 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:40.867090 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0e033-5462-4e66-9c68-194eb77ac890 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:40.867918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0e033-5462-4e66-9c68-194eb77ac890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:40.868218 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0e033-5462-4e66-9c68-194eb77ac890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:40.869591 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0e033-5462-4e66-9c68-194eb77ac890 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:40.872417 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1829b9b-c2a6-43c3-878b-08509dadd87e None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:40.891252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 260/521] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:40.892212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0e033-5462-4e66-9c68-194eb77ac890 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:40.918349 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecb11e-5f9c-442c-956e-a599420cd30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:40.919004 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecb11e-5f9c-442c-956e-a599420cd30a None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:40.919307 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecb11e-5f9c-442c-956e-a599420cd30a None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:40.919649 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecb11e-5f9c-442c-956e-a599420cd30a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:40.925618 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:40.988749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecb11e-5f9c-442c-956e-a599420cd30a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:40.990203 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecb11e-5f9c-442c-956e-a599420cd30a None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:41.003193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0e033-5462-4e66-9c68-194eb77ac890 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:41.014777 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:41.042416 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3c321-7a15-490d-9476-6e6a1a7e0295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:41.043134 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3c321-7a15-490d-9476-6e6a1a7e0295 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:41.043478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3c321-7a15-490d-9476-6e6a1a7e0295 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:41.043758 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3c321-7a15-490d-9476-6e6a1a7e0295 None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:41.044560 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3c321-7a15-490d-9476-6e6a1a7e0295 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:41.044875 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3c321-7a15-490d-9476-6e6a1a7e0295 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:41.046376 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3c321-7a15-490d-9476-6e6a1a7e0295 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:41.064803 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 261/522] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:34:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:41.065647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3c321-7a15-490d-9476-6e6a1a7e0295 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:41.099765 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 262/523] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:41.100611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecb11e-5f9c-442c-956e-a599420cd30a None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:41.157678 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:41.174553 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3c321-7a15-490d-9476-6e6a1a7e0295 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:41.203203 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecb11e-5f9c-442c-956e-a599420cd30a None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:41.213777 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd7c43-aa48-4a13-8aa3-106209be22e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:41.214438 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd7c43-aa48-4a13-8aa3-106209be22e1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:41.214722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd7c43-aa48-4a13-8aa3-106209be22e1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:41.215000 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd7c43-aa48-4a13-8aa3-106209be22e1 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:41.215768 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd7c43-aa48-4a13-8aa3-106209be22e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:41.216077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd7c43-aa48-4a13-8aa3-106209be22e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:41.217478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd7c43-aa48-4a13-8aa3-106209be22e1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:41.227603 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:41.235353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 262/524] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:41.235353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd7c43-aa48-4a13-8aa3-106209be22e1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:41.244520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7bd01-4ac9-4683-8988-00238dedefe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:41.245378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7bd01-4ac9-4683-8988-00238dedefe7 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:41.245714 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7bd01-4ac9-4683-8988-00238dedefe7 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:41.245996 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7bd01-4ac9-4683-8988-00238dedefe7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:41.253471 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7bd01-4ac9-4683-8988-00238dedefe7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:41.255491 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7bd01-4ac9-4683-8988-00238dedefe7 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:41.272398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-1af7bd01-4ac9-4683-8988-00238dedefe7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 20:34:41.272398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:41.272398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:41.272398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:41.272398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:41.272398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:41.272398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:41.272398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:41.272398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:41.272398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:41.272398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:41.272398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:41.272398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:34:41.272398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:34:41.272398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:34:41.272398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:34:41.273344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:41.273344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:41.273344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:34:41.273344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:41.273344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:34:41.273344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:41.273344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:41.273344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:41.273344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:41.273344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:41.273344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:41.273344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:41.273344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:41.273344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:41.273344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:41.273344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:41.273344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:41.273344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:41.274257 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:41.274257 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:41.274257 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:34:41.274257 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:34:41.274257 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:34:41.274257 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:34:41.274257 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:34:41.274257 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:34:41.274257 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 20:34:41.274257 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:41.274257 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 263/525] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:34:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:41.274821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7bd01-4ac9-4683-8988-00238dedefe7 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:41.344626 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd7c43-aa48-4a13-8aa3-106209be22e1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:41.375795 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7bd01-4ac9-4683-8988-00238dedefe7 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:41.379992 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5124658-5184-4943-995f-57773c1d2d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:41.380646 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5124658-5184-4943-995f-57773c1d2d71 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:41.380929 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5124658-5184-4943-995f-57773c1d2d71 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:41.381205 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5124658-5184-4943-995f-57773c1d2d71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:41.382037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5124658-5184-4943-995f-57773c1d2d71 None admin] RBAC: Adding query filter params (role.id=e5e7de76725748df9add27e3c837d8ef, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=6dbbb8f7b3f2449fb9c64ca3815b6c1b) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:41.382350 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5124658-5184-4943-995f-57773c1d2d71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:41.383817 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5124658-5184-4943-995f-57773c1d2d71 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:41.389562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 263/526] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:34:41 2022] GET /identity/v3/role_assignments?user.id=6dbbb8f7b3f2449fb9c64ca3815b6c1b&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=e5e7de76725748df9add27e3c837d8ef => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:41.390349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5124658-5184-4943-995f-57773c1d2d71 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:41.415690 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:41.423485 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dbca5-70fd-49b2-907e-4c86e6bb4e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:41.424562 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dbca5-70fd-49b2-907e-4c86e6bb4e8d None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:41.426228 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dbca5-70fd-49b2-907e-4c86e6bb4e8d None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:41.426530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dbca5-70fd-49b2-907e-4c86e6bb4e8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:41.443047 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30dbca5-70fd-49b2-907e-4c86e6bb4e8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:41.445546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30dbca5-70fd-49b2-907e-4c86e6bb4e8d None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:41.468966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-c30dbca5-70fd-49b2-907e-4c86e6bb4e8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:41.468966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:41.468966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:41.468966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:41.468966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:41.468966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:41.468966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:41.468966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:41.468966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:41.468966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:41.468966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:41.468966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:41.468966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:41.468966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:41.468966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:41.469912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:41.469912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:41.469912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:41.469912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:41.469912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:41.469912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:41.469912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:41.469912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:41.469912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:41.469912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:41.469912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:41.469912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:41.469912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:41.469912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:41.469912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:41.469912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:41.469912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:41.470766 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:41.470766 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:41.470766 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:41.470766 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:41.472852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 264/527] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:41.474067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dbca5-70fd-49b2-907e-4c86e6bb4e8d None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:41.513964 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:41.514300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5124658-5184-4943-995f-57773c1d2d71 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:41.555134 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7fa96-fba1-45a2-8ab4-6e86e978b3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:41.555887 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7fa96-fba1-45a2-8ab4-6e86e978b3bc None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:41.556175 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7fa96-fba1-45a2-8ab4-6e86e978b3bc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:41.556459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7fa96-fba1-45a2-8ab4-6e86e978b3bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:41.564864 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7fa96-fba1-45a2-8ab4-6e86e978b3bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:41.566380 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7fa96-fba1-45a2-8ab4-6e86e978b3bc None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:41.583923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-a0b7fa96-fba1-45a2-8ab4-6e86e978b3bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:41.583923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:41.583923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:41.583923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:41.583923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:41.583923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:41.583923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:41.583923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:41.583923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:41.583923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:41.583923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:41.583923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:41.583923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:34:41.583923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:34:41.583923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:34:41.584903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:34:41.584903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:41.584903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:41.584903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:41.584903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:41.584903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:41.584903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:41.584903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:41.584903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:41.584903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:41.584903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:41.584903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:41.584903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:41.584903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:41.584903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:41.584903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:41.584903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:41.586385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:34:41.586385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:34:41.586385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:34:41.586385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:34:41.586385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:34:41.586385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:34:41.586385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:41.586385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:41.586385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 264/528] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:41.586385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7fa96-fba1-45a2-8ab4-6e86e978b3bc None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:41.591847 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dbca5-70fd-49b2-907e-4c86e6bb4e8d None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:41.628744 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ce7d1-5c74-40ac-b7ba-85726d8d0c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:41.630382 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ce7d1-5c74-40ac-b7ba-85726d8d0c68 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:41.630882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ce7d1-5c74-40ac-b7ba-85726d8d0c68 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:41.631432 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ce7d1-5c74-40ac-b7ba-85726d8d0c68 None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:41.632504 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ce7d1-5c74-40ac-b7ba-85726d8d0c68 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:41.633012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ce7d1-5c74-40ac-b7ba-85726d8d0c68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:41.634700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ce7d1-5c74-40ac-b7ba-85726d8d0c68 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:41.657318 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 265/529] 10.222.0.77 () {56 vars in 1139 bytes} [Tue Jul 19 20:34:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:41.658495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ce7d1-5c74-40ac-b7ba-85726d8d0c68 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:41.682325 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:41.728091 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7fa96-fba1-45a2-8ab4-6e86e978b3bc None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:41.766591 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:41.767009 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b61ede-dd9e-43f1-8b21-5bea56223e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:41.768914 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b61ede-dd9e-43f1-8b21-5bea56223e2e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:41.769422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b61ede-dd9e-43f1-8b21-5bea56223e2e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:41.770128 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b61ede-dd9e-43f1-8b21-5bea56223e2e None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:41.772090 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b61ede-dd9e-43f1-8b21-5bea56223e2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:41.772619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b61ede-dd9e-43f1-8b21-5bea56223e2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:41.774043 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ce7d1-5c74-40ac-b7ba-85726d8d0c68 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:41.774431 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b61ede-dd9e-43f1-8b21-5bea56223e2e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:41.788556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 265/530] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:41.789759 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b61ede-dd9e-43f1-8b21-5bea56223e2e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:41.818645 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09020140-53b0-43ce-9539-5a0dda844639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:41.819612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09020140-53b0-43ce-9539-5a0dda844639 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:41.819912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09020140-53b0-43ce-9539-5a0dda844639 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:41.820186 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09020140-53b0-43ce-9539-5a0dda844639 None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:41.821436 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09020140-53b0-43ce-9539-5a0dda844639 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:41.821827 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09020140-53b0-43ce-9539-5a0dda844639 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:41.823810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09020140-53b0-43ce-9539-5a0dda844639 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:41.855376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 266/531] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:34:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:41.856957 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09020140-53b0-43ce-9539-5a0dda844639 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:41.926384 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b61ede-dd9e-43f1-8b21-5bea56223e2e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:41.960345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:41.968058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f32d36-ed31-485b-9958-585f587d7363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:41.969098 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f32d36-ed31-485b-9958-585f587d7363 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:41.969584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f32d36-ed31-485b-9958-585f587d7363 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:41.970151 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f32d36-ed31-485b-9958-585f587d7363 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:42.002925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09020140-53b0-43ce-9539-5a0dda844639 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:42.046462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f32d36-ed31-485b-9958-585f587d7363 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:42.048366 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f32d36-ed31-485b-9958-585f587d7363 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:42.048851 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67881b-a589-4047-9834-85e6e8122a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:42.049661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67881b-a589-4047-9834-85e6e8122a2c None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:42.049967 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67881b-a589-4047-9834-85e6e8122a2c None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:42.050266 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67881b-a589-4047-9834-85e6e8122a2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:42.060006 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67881b-a589-4047-9834-85e6e8122a2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:42.062428 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67881b-a589-4047-9834-85e6e8122a2c None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:42.081634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-6b67881b-a589-4047-9834-85e6e8122a2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:42.081634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:42.081634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:42.081634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:42.081634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:42.081634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:42.081634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:42.081634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:42.081634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:42.081634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:42.081634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:42.081634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:42.081634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:34:42.081634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:34:42.081634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:34:42.082633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:34:42.082633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:42.082633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:42.082633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:42.082633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:42.082633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:42.082633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:42.082633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:42.082633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:42.082633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:42.082633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:42.082633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:42.082633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:42.082633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:42.082633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:42.082633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:42.082633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:42.083490 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:34:42.083490 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:34:42.083490 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:34:42.083490 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:34:42.083490 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:34:42.083490 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:34:42.083490 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:42.083490 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:42.086005 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 267/532] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:42.087111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67881b-a589-4047-9834-85e6e8122a2c None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:42.107213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:42.169573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 266/533] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:42.175136 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f32d36-ed31-485b-9958-585f587d7363 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:42.208607 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:42.230175 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67881b-a589-4047-9834-85e6e8122a2c None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:42.269120 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28ce9b-87d7-4723-832d-2bae2ccd2db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:42.270265 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28ce9b-87d7-4723-832d-2bae2ccd2db9 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:42.270798 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28ce9b-87d7-4723-832d-2bae2ccd2db9 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:42.271295 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28ce9b-87d7-4723-832d-2bae2ccd2db9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:42.272504 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28ce9b-87d7-4723-832d-2bae2ccd2db9 None admin] RBAC: Adding query filter params (role.id=e5e7de76725748df9add27e3c837d8ef, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=1ab64f417fe74fc585f32691aa7fb515) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:42.273018 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28ce9b-87d7-4723-832d-2bae2ccd2db9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:42.274713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c28ce9b-87d7-4723-832d-2bae2ccd2db9 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:42.281300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 268/534] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:34:42 2022] GET /identity/v3/role_assignments?user.id=1ab64f417fe74fc585f32691aa7fb515&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=e5e7de76725748df9add27e3c837d8ef => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:42.282311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28ce9b-87d7-4723-832d-2bae2ccd2db9 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:42.312580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f32d36-ed31-485b-9958-585f587d7363 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:42.396826 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76afe4-9b11-46de-8159-927beb499bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:42.398325 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76afe4-9b11-46de-8159-927beb499bd9 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:42.398834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76afe4-9b11-46de-8159-927beb499bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:42.399347 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76afe4-9b11-46de-8159-927beb499bd9 None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:42.400468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76afe4-9b11-46de-8159-927beb499bd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:42.401001 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76afe4-9b11-46de-8159-927beb499bd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:42.404551 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76afe4-9b11-46de-8159-927beb499bd9 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:42.425218 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:42.431947 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 267/535] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:34:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:42.437880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76afe4-9b11-46de-8159-927beb499bd9 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:42.498245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28ce9b-87d7-4723-832d-2bae2ccd2db9 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:42.561969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:42.565948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762298d-30ca-425e-9021-6bc1c5b3883e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:42.567365 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762298d-30ca-425e-9021-6bc1c5b3883e None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:42.567654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762298d-30ca-425e-9021-6bc1c5b3883e None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:42.567997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762298d-30ca-425e-9021-6bc1c5b3883e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:42.584845 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76afe4-9b11-46de-8159-927beb499bd9 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:42.587905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762298d-30ca-425e-9021-6bc1c5b3883e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:42.589366 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762298d-30ca-425e-9021-6bc1c5b3883e None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:42.616911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-1762298d-30ca-425e-9021-6bc1c5b3883e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:42.616911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:42.616911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:42.616911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:42.616911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:42.616911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:42.616911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:42.616911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:42.616911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:42.616911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:42.616911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:42.616911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:42.616911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:42.616911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:42.616911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:42.617834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:42.617834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:42.617834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:42.617834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:42.617834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:42.617834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:42.617834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:42.617834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:42.617834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:42.617834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:42.617834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:42.617834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:42.617834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:42.617834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:42.617834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:42.617834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:42.617834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:42.618688 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:42.618688 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:42.618688 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:42.618688 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:42.619519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 269/536] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:42.628322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762298d-30ca-425e-9021-6bc1c5b3883e None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:42.649037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e157cf-0797-4573-b2e7-66429edb0c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:42.649622 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e157cf-0797-4573-b2e7-66429edb0c24 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:42.649907 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e157cf-0797-4573-b2e7-66429edb0c24 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:42.650184 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e157cf-0797-4573-b2e7-66429edb0c24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:42.651031 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e157cf-0797-4573-b2e7-66429edb0c24 None admin] RBAC: Adding query filter params (role.id=e5e7de76725748df9add27e3c837d8ef, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=7d9a41e10cb64ee9972debaf856503d4) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:42.651373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e157cf-0797-4573-b2e7-66429edb0c24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:42.652825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e157cf-0797-4573-b2e7-66429edb0c24 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:42.662036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 268/537] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:34:42 2022] GET /identity/v3/role_assignments?user.id=7d9a41e10cb64ee9972debaf856503d4&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=e5e7de76725748df9add27e3c837d8ef => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:42.795255 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762298d-30ca-425e-9021-6bc1c5b3883e None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:42.815692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b5b3d-f5c2-4e74-b95e-911af42c834e None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:42.816654 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b5b3d-f5c2-4e74-b95e-911af42c834e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:42.817347 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b5b3d-f5c2-4e74-b95e-911af42c834e None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:42.819761 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 269/538] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:42.825353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409f9bb-ee02-468d-a0e2-c0f4d9abd7b5 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:42.825891 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409f9bb-ee02-468d-a0e2-c0f4d9abd7b5 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:42.826505 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409f9bb-ee02-468d-a0e2-c0f4d9abd7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:42.831969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:42.835852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27dddf-a25b-4509-afef-30444af0102f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:42.837126 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27dddf-a25b-4509-afef-30444af0102f None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:42.837673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27dddf-a25b-4509-afef-30444af0102f None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:42.838306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27dddf-a25b-4509-afef-30444af0102f None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:42.839055 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27dddf-a25b-4509-afef-30444af0102f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:42.839648 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27dddf-a25b-4509-afef-30444af0102f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:42.841465 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27dddf-a25b-4509-afef-30444af0102f None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:42.856251 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 270/539] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:42.865701 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-a409f9bb-ee02-468d-a0e2-c0f4d9abd7b5 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:42.867020 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a409f9bb-ee02-468d-a0e2-c0f4d9abd7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:42.871716 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27dddf-a25b-4509-afef-30444af0102f None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:42.956133 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 270/540] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:42.980579 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409f9bb-ee02-468d-a0e2-c0f4d9abd7b5 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:43.043097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27dddf-a25b-4509-afef-30444af0102f None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:43.075291 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:43.088620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409f9bb-ee02-468d-a0e2-c0f4d9abd7b5 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:43.098253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffa9bb-3af7-47d3-bbba-238f19989526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:43.099375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffa9bb-3af7-47d3-bbba-238f19989526 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:43.099880 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffa9bb-3af7-47d3-bbba-238f19989526 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:43.100356 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffa9bb-3af7-47d3-bbba-238f19989526 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:43.107745 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffa9bb-3af7-47d3-bbba-238f19989526 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:43.109489 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffa9bb-3af7-47d3-bbba-238f19989526 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:43.130384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-abffa9bb-3af7-47d3-bbba-238f19989526 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:43.130384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:43.130384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:43.130384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:43.130384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:43.130384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:43.130384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:43.130384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:43.130384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:43.130384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:43.130384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:43.130384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:43.130384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:34:43.130384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:34:43.130384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:34:43.131303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:34:43.131303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:43.131303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:43.131303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:43.131303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:43.131303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:43.131303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:43.131303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:43.131303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:43.131303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:43.131303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:43.131303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:43.131303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:43.131303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:43.131303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:43.131303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:43.131303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:43.132163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:34:43.132163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:34:43.132163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:34:43.132163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:34:43.132163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:34:43.132163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:34:43.132163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:43.132163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:43.150333 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 271/541] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:34:43.153670 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffa9bb-3af7-47d3-bbba-238f19989526 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:43.177831 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac03de0-aeb0-4078-811a-d2efd3b85d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:43.178994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac03de0-aeb0-4078-811a-d2efd3b85d9f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:43.179527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac03de0-aeb0-4078-811a-d2efd3b85d9f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:43.180090 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac03de0-aeb0-4078-811a-d2efd3b85d9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:43.203696 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac03de0-aeb0-4078-811a-d2efd3b85d9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:43.224420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-7ac03de0-aeb0-4078-811a-d2efd3b85d9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:43.224420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:43.224420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:43.224420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:43.224420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:43.224420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:43.224420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:43.224420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:43.224420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:43.224420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:43.224420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:43.224420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:43.224420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:43.224420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:43.224420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:43.224420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:43.225379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:43.225379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:43.225379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:43.225379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:43.225379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:43.225379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:43.225379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:43.225379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:43.225379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:43.225379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:43.225379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:43.225379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:43.225379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:43.225379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:43.225379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:43.225379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:43.226616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:43.226616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:43.226616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:43.226616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:43.226616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:43.226616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:43.226616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:43.226616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:43.226616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:43.226616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:43.226616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:43.226616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:43.226616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 271/542] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:34:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:34:43.236288 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac03de0-aeb0-4078-811a-d2efd3b85d9f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:43.252088 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:43.344814 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffa9bb-3af7-47d3-bbba-238f19989526 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:43.345008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac03de0-aeb0-4078-811a-d2efd3b85d9f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:43.380904 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac46d48-5d38-49ec-ac39-fadf553fa749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:43.381579 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac46d48-5d38-49ec-ac39-fadf553fa749 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:43.381866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac46d48-5d38-49ec-ac39-fadf553fa749 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:43.382176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac46d48-5d38-49ec-ac39-fadf553fa749 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:43.382934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac46d48-5d38-49ec-ac39-fadf553fa749 None admin] RBAC: Adding query filter params (name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:43.383243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac46d48-5d38-49ec-ac39-fadf553fa749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:43.384669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac46d48-5d38-49ec-ac39-fadf553fa749 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:43.394297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 272/543] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jul 19 20:34:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:43.399751 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac46d48-5d38-49ec-ac39-fadf553fa749 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:43.412188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:43.425988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76898a47-d3a5-4747-9649-fe252086b67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:43.426670 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76898a47-d3a5-4747-9649-fe252086b67d None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:43.427102 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76898a47-d3a5-4747-9649-fe252086b67d None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:43.427411 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76898a47-d3a5-4747-9649-fe252086b67d None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:43.428548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76898a47-d3a5-4747-9649-fe252086b67d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:43.429136 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76898a47-d3a5-4747-9649-fe252086b67d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:43.430761 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76898a47-d3a5-4747-9649-fe252086b67d None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:43.460017 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 272/544] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:34:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:43.464279 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76898a47-d3a5-4747-9649-fe252086b67d None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:43.556436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac46d48-5d38-49ec-ac39-fadf553fa749 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:43.618835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76898a47-d3a5-4747-9649-fe252086b67d None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:43.627526 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12845a29-eda9-497a-a56b-9e68039070c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:43.628355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12845a29-eda9-497a-a56b-9e68039070c0 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:43.628645 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12845a29-eda9-497a-a56b-9e68039070c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:43.628959 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12845a29-eda9-497a-a56b-9e68039070c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:43.630910 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:43.656093 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260f1be-0fc8-47c2-9ad5-899af8d900f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:43.656351 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12845a29-eda9-497a-a56b-9e68039070c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:43.656898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260f1be-0fc8-47c2-9ad5-899af8d900f5 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:43.657315 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260f1be-0fc8-47c2-9ad5-899af8d900f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:43.657667 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260f1be-0fc8-47c2-9ad5-899af8d900f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:43.657821 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12845a29-eda9-497a-a56b-9e68039070c0 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:43.658638 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260f1be-0fc8-47c2-9ad5-899af8d900f5 None admin] RBAC: Adding query filter params (role.id=e5e7de76725748df9add27e3c837d8ef, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=5b2c0f24d666462aa14ea4eee0592062) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:43.659021 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260f1be-0fc8-47c2-9ad5-899af8d900f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:43.661428 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260f1be-0fc8-47c2-9ad5-899af8d900f5 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:43.670418 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 273/545] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:34:43 2022] GET /identity/v3/role_assignments?user.id=5b2c0f24d666462aa14ea4eee0592062&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=e5e7de76725748df9add27e3c837d8ef => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:43.671847 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15826fab-9898-4de7-9410-82b1ccc62167 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:43.672147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15826fab-9898-4de7-9410-82b1ccc62167 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:43.672429 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15826fab-9898-4de7-9410-82b1ccc62167 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:43.673923 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 274/546] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:43.679669 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8f878-704f-488a-84e2-ddd7852b9cf7 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:43.679978 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8f878-704f-488a-84e2-ddd7852b9cf7 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:43.680230 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8f878-704f-488a-84e2-ddd7852b9cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:43.689054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-12845a29-eda9-497a-a56b-9e68039070c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:43.689054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:43.689054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:43.689054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:43.689054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:43.689054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:43.689054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:43.689054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:43.689054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:43.689054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:43.689054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:43.689054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:43.689054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:43.689054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:43.689054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:43.691161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:43.691161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:43.691161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:43.691161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:43.691161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:43.691161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:43.691161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:43.691161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:43.691161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:43.691161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:43.691161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:43.691161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:43.691161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:43.691161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:43.691161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:43.691161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:43.691161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:43.693829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:43.693829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:43.693829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:43.693829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:43.693829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 273/547] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:43.700218 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12845a29-eda9-497a-a56b-9e68039070c0 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:43.721426 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-e6c8f878-704f-488a-84e2-ddd7852b9cf7 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:43.725573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e6c8f878-704f-488a-84e2-ddd7852b9cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:43.848748 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:43.860158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 275/548] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:43.888024 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8f878-704f-488a-84e2-ddd7852b9cf7 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:43.889358 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12845a29-eda9-497a-a56b-9e68039070c0 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:43.938007 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73334ffe-ca4f-48f3-950b-2cd07b68e404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:43.938679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73334ffe-ca4f-48f3-950b-2cd07b68e404 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:43.938960 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73334ffe-ca4f-48f3-950b-2cd07b68e404 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:43.939236 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73334ffe-ca4f-48f3-950b-2cd07b68e404 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:43.939989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73334ffe-ca4f-48f3-950b-2cd07b68e404 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:43.940297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73334ffe-ca4f-48f3-950b-2cd07b68e404 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:43.941728 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73334ffe-ca4f-48f3-950b-2cd07b68e404 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:43.959960 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 274/549] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:43.966760 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73334ffe-ca4f-48f3-950b-2cd07b68e404 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:44.026064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8f878-704f-488a-84e2-ddd7852b9cf7 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:44.033969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:44.097677 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d61eab-b29c-4dee-ac51-e540d8de2d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:44.098495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d61eab-b29c-4dee-ac51-e540d8de2d96 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:44.098832 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d61eab-b29c-4dee-ac51-e540d8de2d96 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:44.099051 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d61eab-b29c-4dee-ac51-e540d8de2d96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:44.124359 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d61eab-b29c-4dee-ac51-e540d8de2d96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:44.132573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-15d61eab-b29c-4dee-ac51-e540d8de2d96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:44.132573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:44.132573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:44.132573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:44.132573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:44.132573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:44.132573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:44.132573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:44.132573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:44.132573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:44.132573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:44.132573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:44.132573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:44.132573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:44.132573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:44.132573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:44.133972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:44.133972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:44.133972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:44.133972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:44.133972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:44.133972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:44.133972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:44.133972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:44.133972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:44.133972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:44.133972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:44.133972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:44.133972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:44.133972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:44.133972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:44.133972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:44.135695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:44.135695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:44.135695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:44.135695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:44.135695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:44.135695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:44.135695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:44.135695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:44.135695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:44.135695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:44.135695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:44.135695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:44.135695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 276/550] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:34:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:44.140859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d61eab-b29c-4dee-ac51-e540d8de2d96 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:44.150966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73334ffe-ca4f-48f3-950b-2cd07b68e404 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:44.194931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:44.233141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fb2b6-9832-488f-bb7a-4bfad114300f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:44.233952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fb2b6-9832-488f-bb7a-4bfad114300f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:44.234229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fb2b6-9832-488f-bb7a-4bfad114300f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:44.234505 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fb2b6-9832-488f-bb7a-4bfad114300f None admin] PATH_INFO: `/v3/users/swift` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:44.247070 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fb2b6-9832-488f-bb7a-4bfad114300f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:44.250686 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fb2b6-9832-488f-bb7a-4bfad114300f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:44.273305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-727fb2b6-9832-488f-bb7a-4bfad114300f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 20:34:44.273305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:44.273305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:44.273305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:44.273305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:44.273305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:44.273305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:44.273305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:44.273305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:44.273305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:44.273305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:44.273305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:44.273305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:34:44.273305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:34:44.273305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:34:44.273305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:34:44.274294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:44.274294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:44.274294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:34:44.274294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:44.274294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:34:44.274294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:44.274294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:44.274294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:44.274294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:44.274294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:44.274294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:44.274294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:44.274294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:44.274294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:44.274294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:44.274294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:44.274294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:44.274294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:44.275542 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:44.275542 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:44.275542 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:34:44.275542 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:34:44.275542 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:34:44.275542 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:34:44.275542 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:34:44.275542 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:34:44.275542 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 20:34:44.275542 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:44.276545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 275/551] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:34:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:34:44.288831 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fb2b6-9832-488f-bb7a-4bfad114300f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:44.306645 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d61eab-b29c-4dee-ac51-e540d8de2d96 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:44.368899 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b3c7b-e6e6-4aa7-990f-9ce1f2b21a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:44.369490 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b3c7b-e6e6-4aa7-990f-9ce1f2b21a1f None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:44.369776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b3c7b-e6e6-4aa7-990f-9ce1f2b21a1f None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:44.370051 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b3c7b-e6e6-4aa7-990f-9ce1f2b21a1f None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:44.370806 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b3c7b-e6e6-4aa7-990f-9ce1f2b21a1f None admin] RBAC: Adding query filter params (name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:44.371112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b3c7b-e6e6-4aa7-990f-9ce1f2b21a1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:44.372536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b3c7b-e6e6-4aa7-990f-9ce1f2b21a1f None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:44.390682 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 277/552] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jul 19 20:34:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:44.397088 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b3c7b-e6e6-4aa7-990f-9ce1f2b21a1f None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:44.447437 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:44.470924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fb2b6-9832-488f-bb7a-4bfad114300f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:44.526956 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c277e-5ade-4e90-8fe2-6751b076bf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:44.527679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c277e-5ade-4e90-8fe2-6751b076bf4d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:44.527956 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c277e-5ade-4e90-8fe2-6751b076bf4d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:44.528234 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c277e-5ade-4e90-8fe2-6751b076bf4d None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:44.529076 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c277e-5ade-4e90-8fe2-6751b076bf4d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:44.529386 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c277e-5ade-4e90-8fe2-6751b076bf4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:44.530822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c277e-5ade-4e90-8fe2-6751b076bf4d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:44.550923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 276/553] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Jul 19 20:34:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:44.556601 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c277e-5ade-4e90-8fe2-6751b076bf4d None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:44.593124 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b3c7b-e6e6-4aa7-990f-9ce1f2b21a1f None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:44.617008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:44.659501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc55f96-0eeb-496b-a469-1c08130ce41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:44.660574 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc55f96-0eeb-496b-a469-1c08130ce41d None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:44.660855 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc55f96-0eeb-496b-a469-1c08130ce41d None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:44.661134 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc55f96-0eeb-496b-a469-1c08130ce41d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:44.683122 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc55f96-0eeb-496b-a469-1c08130ce41d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:44.684614 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc55f96-0eeb-496b-a469-1c08130ce41d None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:44.710515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-acc55f96-0eeb-496b-a469-1c08130ce41d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:44.710515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:44.710515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:44.710515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:44.710515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:44.710515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:44.710515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:44.710515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:44.710515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:44.710515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:44.710515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:44.710515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:44.710515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:44.710515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:44.710515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:44.711632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:44.711632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:44.711632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:44.711632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:44.711632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:44.711632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:44.711632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:44.711632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:44.711632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:44.711632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:44.711632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:44.711632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:44.711632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:44.711632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:44.711632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:44.711632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:44.711632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:44.713065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:44.713065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:44.713065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:44.713065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:44.713065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 278/554] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:44.713333 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962eb54-53b9-487e-8228-09bc4c40a1bb None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:44.713615 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962eb54-53b9-487e-8228-09bc4c40a1bb None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:44.713898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962eb54-53b9-487e-8228-09bc4c40a1bb None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:44.715521 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 279/555] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:44.720823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962eb54-53b9-487e-8228-09bc4c40a1bb None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:44.726752 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c277e-5ade-4e90-8fe2-6751b076bf4d None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:44.765637 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441abf95-ccd7-43cc-bab1-2535ce2267a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:44.766743 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441abf95-ccd7-43cc-bab1-2535ce2267a9 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:44.767231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441abf95-ccd7-43cc-bab1-2535ce2267a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:44.767728 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441abf95-ccd7-43cc-bab1-2535ce2267a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:44.830750 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:44.839963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441abf95-ccd7-43cc-bab1-2535ce2267a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:44.841730 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441abf95-ccd7-43cc-bab1-2535ce2267a9 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:44.861166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962eb54-53b9-487e-8228-09bc4c40a1bb None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:44.888956 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:44.912971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7dee8-aa67-4f81-a0fe-b975a6887ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:44.913968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7dee8-aa67-4f81-a0fe-b975a6887ed9 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:44.914467 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7dee8-aa67-4f81-a0fe-b975a6887ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:44.914936 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7dee8-aa67-4f81-a0fe-b975a6887ed9 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:44.915886 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7dee8-aa67-4f81-a0fe-b975a6887ed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:44.916387 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7dee8-aa67-4f81-a0fe-b975a6887ed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:44.918026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7dee8-aa67-4f81-a0fe-b975a6887ed9 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:44.931925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 280/556] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:44.933647 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f47d95-9d90-4f99-a291-1416e712efae None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:44.934165 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f47d95-9d90-4f99-a291-1416e712efae None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:44.934671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f47d95-9d90-4f99-a291-1416e712efae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:44.951594 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-e4f47d95-9d90-4f99-a291-1416e712efae None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:44.953165 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e4f47d95-9d90-4f99-a291-1416e712efae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:44.975346 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 277/557] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 20:34:44.976552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441abf95-ccd7-43cc-bab1-2535ce2267a9 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:45.027700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 281/558] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:45.029053 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f47d95-9d90-4f99-a291-1416e712efae None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:45.115215 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441abf95-ccd7-43cc-bab1-2535ce2267a9 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:45.130531 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f47d95-9d90-4f99-a291-1416e712efae None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:45.147946 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:45.150649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174365c5-f250-458b-a8da-485150b0d4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:45.151473 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174365c5-f250-458b-a8da-485150b0d4d6 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:45.151755 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174365c5-f250-458b-a8da-485150b0d4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:45.152028 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174365c5-f250-458b-a8da-485150b0d4d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:45.154940 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:45.162382 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174365c5-f250-458b-a8da-485150b0d4d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:45.163910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174365c5-f250-458b-a8da-485150b0d4d6 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:45.170863 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b366f-dec3-4088-89ce-37152ce7905a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:45.171939 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b366f-dec3-4088-89ce-37152ce7905a None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:45.172421 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b366f-dec3-4088-89ce-37152ce7905a None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:45.172891 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b366f-dec3-4088-89ce-37152ce7905a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:45.179610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-174365c5-f250-458b-a8da-485150b0d4d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 20:34:45.179610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:45.179610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:45.179610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:45.179610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:45.179610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:45.179610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:45.179610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:45.179610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:45.179610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:45.179610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:45.179610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:45.179610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:34:45.179610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:34:45.179610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:34:45.179610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:34:45.180589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:45.180589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:45.180589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:34:45.180589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:45.180589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:34:45.180589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:45.180589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:45.180589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:45.180589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:45.180589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:45.180589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:45.180589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:45.180589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:45.180589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:45.180589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:45.180589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:45.180589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:45.180589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:45.182162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:45.182162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:45.182162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:34:45.182162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:34:45.182162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:34:45.182162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:34:45.182162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:34:45.182162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:34:45.182162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 20:34:45.182162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:45.182162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 278/559] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Jul 19 20:34:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:45.182162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174365c5-f250-458b-a8da-485150b0d4d6 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:45.188200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b366f-dec3-4088-89ce-37152ce7905a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:45.189975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b366f-dec3-4088-89ce-37152ce7905a None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:45.209474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-728b366f-dec3-4088-89ce-37152ce7905a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:45.209474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:45.209474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:45.209474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:45.209474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:45.209474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:45.209474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:45.209474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:45.209474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:45.209474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:45.209474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:45.209474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:45.209474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:45.209474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:45.209474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:45.210458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:45.210458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:45.210458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:45.210458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:45.210458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:45.210458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:45.210458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:45.210458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:45.210458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:45.210458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:45.210458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:45.210458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:45.210458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:45.210458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:45.210458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:45.210458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:45.210458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:45.211356 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:45.211356 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:45.211356 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:45.211356 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:45.213623 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 282/560] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:45.214663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b366f-dec3-4088-89ce-37152ce7905a None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:45.293048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174365c5-f250-458b-a8da-485150b0d4d6 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:45.322865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b366f-dec3-4088-89ce-37152ce7905a None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:45.330547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c68815-61ec-4020-bbe7-07307a49265d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:45.331518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68815-61ec-4020-bbe7-07307a49265d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:45.331798 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68815-61ec-4020-bbe7-07307a49265d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:45.332095 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68815-61ec-4020-bbe7-07307a49265d None admin] PATH_INFO: `/v3/roles/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:45.344147 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c68815-61ec-4020-bbe7-07307a49265d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:45.346577 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:45.353021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-d7c68815-61ec-4020-bbe7-07307a49265d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:45.353021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:45.353021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:45.353021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:45.353021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:45.353021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:45.353021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:45.353021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:45.353021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:45.353021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:45.353021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:45.353021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:45.353021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:45.353021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:45.353021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:45.353021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:45.354142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:45.354142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:45.354142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:45.354142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:45.354142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:45.354142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:45.354142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:45.354142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:45.354142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:45.354142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:45.354142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:45.354142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:45.354142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:45.354142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:45.354142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:45.354142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:45.355052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:45.355052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:45.355052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:45.355052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:45.355052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:45.355052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:45.355052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:45.355052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:45.355052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:45.355052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:45.355052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:45.355052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:45.355052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 279/561] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:34:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:45.355052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c68815-61ec-4020-bbe7-07307a49265d None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:45.368007 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8bb12-24c0-4594-8370-05df45587ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:45.368691 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8bb12-24c0-4594-8370-05df45587ddb None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:45.368976 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8bb12-24c0-4594-8370-05df45587ddb None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:45.369254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8bb12-24c0-4594-8370-05df45587ddb None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:45.370102 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8bb12-24c0-4594-8370-05df45587ddb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:45.370416 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8bb12-24c0-4594-8370-05df45587ddb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:45.372161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8bb12-24c0-4594-8370-05df45587ddb None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:45.391452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 283/562] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Jul 19 20:34:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:45.392812 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd179bd-dad6-450e-8af5-ec6ad4bdab96 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:45.393128 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd179bd-dad6-450e-8af5-ec6ad4bdab96 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:45.393388 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd179bd-dad6-450e-8af5-ec6ad4bdab96 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:45.398623 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 284/563] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:45.398623 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd179bd-dad6-450e-8af5-ec6ad4bdab96 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:45.423572 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:45.470468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c68815-61ec-4020-bbe7-07307a49265d None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:45.500112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd179bd-dad6-450e-8af5-ec6ad4bdab96 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:45.505449 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10178e-064e-4441-9a81-ca752ebb0975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:45.506147 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10178e-064e-4441-9a81-ca752ebb0975 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:45.506401 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10178e-064e-4441-9a81-ca752ebb0975 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:45.506676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10178e-064e-4441-9a81-ca752ebb0975 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:45.507432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10178e-064e-4441-9a81-ca752ebb0975 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:45.507741 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10178e-064e-4441-9a81-ca752ebb0975 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:45.509176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10178e-064e-4441-9a81-ca752ebb0975 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:45.521971 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 280/564] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:45.523050 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10178e-064e-4441-9a81-ca752ebb0975 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:45.543417 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c50bcc-e21e-4488-afc2-9eca9d6c3329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:45.544088 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c50bcc-e21e-4488-afc2-9eca9d6c3329 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:45.544366 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c50bcc-e21e-4488-afc2-9eca9d6c3329 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:45.544636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c50bcc-e21e-4488-afc2-9eca9d6c3329 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:45.545378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c50bcc-e21e-4488-afc2-9eca9d6c3329 None admin] RBAC: Adding query filter params (name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:45.545806 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c50bcc-e21e-4488-afc2-9eca9d6c3329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:45.547185 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c50bcc-e21e-4488-afc2-9eca9d6c3329 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:45.556165 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 285/565] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jul 19 20:34:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:45.556165 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec80ce-ac8f-4efa-bd62-6751655490c7 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:45.556165 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec80ce-ac8f-4efa-bd62-6751655490c7 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:45.556165 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec80ce-ac8f-4efa-bd62-6751655490c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:45.574161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-6bec80ce-ac8f-4efa-bd62-6751655490c7 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:45.575376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-6bec80ce-ac8f-4efa-bd62-6751655490c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:45.612707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:45.636988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10178e-064e-4441-9a81-ca752ebb0975 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:45.657452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 286/566] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:45.657452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec80ce-ac8f-4efa-bd62-6751655490c7 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:45.662979 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:45.683925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eba19e-fcbc-4866-a1df-7a1b6ea93520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:45.684648 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eba19e-fcbc-4866-a1df-7a1b6ea93520 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:45.684946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eba19e-fcbc-4866-a1df-7a1b6ea93520 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:45.685206 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eba19e-fcbc-4866-a1df-7a1b6ea93520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:45.695552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eba19e-fcbc-4866-a1df-7a1b6ea93520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:45.697011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eba19e-fcbc-4866-a1df-7a1b6ea93520 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:45.715225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-31eba19e-fcbc-4866-a1df-7a1b6ea93520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:45.715225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:45.715225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:45.715225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:45.715225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:45.715225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:45.715225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:45.715225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:45.715225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:45.715225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:45.715225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:45.715225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:45.715225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:45.715225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:45.715225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:45.716166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:45.716166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:45.716166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:45.716166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:45.716166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:45.716166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:45.716166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:45.716166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:45.716166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:45.716166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:45.716166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:45.716166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:45.716166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:45.716166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:45.716166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:45.716166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:45.716166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:45.717054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:45.717054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:45.717054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:45.717054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:45.717054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 281/567] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:45.717341 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eba19e-fcbc-4866-a1df-7a1b6ea93520 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:45.770222 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec80ce-ac8f-4efa-bd62-6751655490c7 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:45.807737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5857d4-ddbf-4fc0-9088-141450a8b807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:45.808542 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5857d4-ddbf-4fc0-9088-141450a8b807 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:45.808828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5857d4-ddbf-4fc0-9088-141450a8b807 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:45.809104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5857d4-ddbf-4fc0-9088-141450a8b807 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:45.815883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5857d4-ddbf-4fc0-9088-141450a8b807 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:45.817858 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5857d4-ddbf-4fc0-9088-141450a8b807 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:45.824378 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eba19e-fcbc-4866-a1df-7a1b6ea93520 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:45.831687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-5e5857d4-ddbf-4fc0-9088-141450a8b807 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:45.831687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:45.831687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:45.831687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:45.831687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:45.831687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:45.831687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:45.831687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:45.831687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:45.831687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:45.831687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:45.831687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:45.831687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:34:45.831687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:34:45.831687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:34:45.833374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:34:45.833374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:45.833374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:45.833374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:45.833374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:45.833374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:45.833374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:45.833374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:45.833374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:45.833374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:45.833374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:45.833374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:45.833374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:45.833374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:45.833374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:45.833374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:45.833374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:45.834250 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:34:45.834250 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:34:45.834250 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:34:45.834250 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:34:45.834250 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:34:45.834250 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:34:45.834250 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:45.834250 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:45.834250 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 287/568] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:45.834250 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5857d4-ddbf-4fc0-9088-141450a8b807 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:45.867414 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:45.868713 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2b058-2d42-415b-847d-81332d2b7b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:45.869140 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2b058-2d42-415b-847d-81332d2b7b75 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:45.869420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2b058-2d42-415b-847d-81332d2b7b75 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:45.869692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2b058-2d42-415b-847d-81332d2b7b75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:45.881184 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2b058-2d42-415b-847d-81332d2b7b75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:45.883400 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2b058-2d42-415b-847d-81332d2b7b75 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:45.907433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-ccd2b058-2d42-415b-847d-81332d2b7b75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:45.907433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:45.907433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:45.907433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:45.907433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:45.907433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:45.907433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:45.907433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:45.907433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:45.907433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:45.907433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:45.907433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:45.907433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:45.907433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:45.907433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:45.908392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:45.908392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:45.908392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:45.908392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:45.908392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:45.908392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:45.908392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:45.908392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:45.908392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:45.908392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:45.908392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:45.908392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:45.908392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:45.908392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:45.908392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:45.908392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:45.908392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:45.914877 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:45.914877 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:45.914877 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:45.914877 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:45.914877 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 282/569] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:45.914877 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2b058-2d42-415b-847d-81332d2b7b75 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:45.933002 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:45.960797 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5857d4-ddbf-4fc0-9088-141450a8b807 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:45.994862 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1e6cf-f83a-4f53-b3e4-53685b365f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:45.995683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1e6cf-f83a-4f53-b3e4-53685b365f75 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:45.995974 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1e6cf-f83a-4f53-b3e4-53685b365f75 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:45.996252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1e6cf-f83a-4f53-b3e4-53685b365f75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:46.006330 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1e6cf-f83a-4f53-b3e4-53685b365f75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:46.009600 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2b058-2d42-415b-847d-81332d2b7b75 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:46.014248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-b7f1e6cf-f83a-4f53-b3e4-53685b365f75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:46.014248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:46.014248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:46.014248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:46.014248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:46.014248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:46.014248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:46.014248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:46.014248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:46.014248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:46.014248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:46.014248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:46.014248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:46.014248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:46.014248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:46.014248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:46.015173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:46.015173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:46.015173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:46.015173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:46.015173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:46.015173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:46.015173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:46.015173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:46.015173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:46.015173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:46.015173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:46.015173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:46.015173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:46.015173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:46.015173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:46.015173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:46.016057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:46.016057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:46.016057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:46.016057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:46.016057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:46.016057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:46.016057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:46.016057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:46.016057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:46.016057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:46.016057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:46.016057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:46.016057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 288/570] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:34:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:46.016819 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1e6cf-f83a-4f53-b3e4-53685b365f75 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:46.048389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f94d7-bba7-4bd7-9158-96e3387cd578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:46.049048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f94d7-bba7-4bd7-9158-96e3387cd578 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:46.049330 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f94d7-bba7-4bd7-9158-96e3387cd578 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:46.049607 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f94d7-bba7-4bd7-9158-96e3387cd578 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:46.050329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f94d7-bba7-4bd7-9158-96e3387cd578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:46.050631 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f94d7-bba7-4bd7-9158-96e3387cd578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:46.052029 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f94d7-bba7-4bd7-9158-96e3387cd578 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:46.063646 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 283/571] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:46.064431 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f94d7-bba7-4bd7-9158-96e3387cd578 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:46.110970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:46.121210 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1e6cf-f83a-4f53-b3e4-53685b365f75 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:46.146004 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:46.155516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99732dd8-0984-4550-8ffb-069e368d4add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:46.156175 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99732dd8-0984-4550-8ffb-069e368d4add None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:46.156452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99732dd8-0984-4550-8ffb-069e368d4add None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:46.156724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99732dd8-0984-4550-8ffb-069e368d4add None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:46.157508 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99732dd8-0984-4550-8ffb-069e368d4add None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:46.157814 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99732dd8-0984-4550-8ffb-069e368d4add None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:46.159234 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99732dd8-0984-4550-8ffb-069e368d4add None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:46.165608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f94d7-bba7-4bd7-9158-96e3387cd578 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:46.171848 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 289/572] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:34:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:46.173070 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cad854-7f3d-4166-94f4-37799517a0d1 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:46.173353 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cad854-7f3d-4166-94f4-37799517a0d1 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:46.173624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cad854-7f3d-4166-94f4-37799517a0d1 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:46.177917 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 290/573] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:46.177917 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cad854-7f3d-4166-94f4-37799517a0d1 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:46.200279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da1047-7c07-417e-ba5e-216d73c0a857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:46.200942 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da1047-7c07-417e-ba5e-216d73c0a857 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:46.201227 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da1047-7c07-417e-ba5e-216d73c0a857 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:46.201506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da1047-7c07-417e-ba5e-216d73c0a857 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:46.202229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da1047-7c07-417e-ba5e-216d73c0a857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:46.202540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da1047-7c07-417e-ba5e-216d73c0a857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:46.203936 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da1047-7c07-417e-ba5e-216d73c0a857 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:46.215941 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 284/574] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:46.216881 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da1047-7c07-417e-ba5e-216d73c0a857 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:46.279584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cad854-7f3d-4166-94f4-37799517a0d1 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:46.313587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b7080-3ae4-46a7-92d5-892d94c367b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:46.314251 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b7080-3ae4-46a7-92d5-892d94c367b3 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:46.314535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b7080-3ae4-46a7-92d5-892d94c367b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:46.314811 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b7080-3ae4-46a7-92d5-892d94c367b3 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:46.315322 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da1047-7c07-417e-ba5e-216d73c0a857 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:46.315592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b7080-3ae4-46a7-92d5-892d94c367b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:46.315900 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b7080-3ae4-46a7-92d5-892d94c367b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:46.317260 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b7080-3ae4-46a7-92d5-892d94c367b3 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:46.330383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 291/575] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jul 19 20:34:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:46.330383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b7080-3ae4-46a7-92d5-892d94c367b3 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:46.343482 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:46.349822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dde33-23c1-4687-951d-edb488d2cdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:46.350616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dde33-23c1-4687-951d-edb488d2cdd2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:46.350901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dde33-23c1-4687-951d-edb488d2cdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:46.351179 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dde33-23c1-4687-951d-edb488d2cdd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:46.358061 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5dde33-23c1-4687-951d-edb488d2cdd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:46.359530 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5dde33-23c1-4687-951d-edb488d2cdd2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:46.361961 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:46.374896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-0f5dde33-23c1-4687-951d-edb488d2cdd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:46.374896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:46.374896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:46.374896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:46.374896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:46.374896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:46.374896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:46.374896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:46.374896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:46.374896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:46.374896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:46.374896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:46.374896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:34:46.374896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:34:46.374896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:34:46.375839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:34:46.375839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:46.375839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:46.375839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:46.375839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:46.375839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:46.375839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:46.375839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:46.375839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:46.375839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:46.375839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:46.375839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:46.375839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:46.375839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:46.375839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:46.375839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:46.375839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:46.376736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:34:46.376736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:34:46.376736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:34:46.376736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:34:46.376736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:34:46.376736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:34:46.376736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:46.376736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:46.376736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 285/576] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:46.377232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67c521-4855-4b1b-85c6-e80c2cfb7301 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:46.377505 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67c521-4855-4b1b-85c6-e80c2cfb7301 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:46.377783 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67c521-4855-4b1b-85c6-e80c2cfb7301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:46.394228 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-db67c521-4855-4b1b-85c6-e80c2cfb7301 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:46.395465 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-db67c521-4855-4b1b-85c6-e80c2cfb7301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:46.433891 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b7080-3ae4-46a7-92d5-892d94c367b3 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:46.460842 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 286/577] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:46.461709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67c521-4855-4b1b-85c6-e80c2cfb7301 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:46.476030 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498198f-6cdb-4066-a8fb-1002327199d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:46.476625 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498198f-6cdb-4066-a8fb-1002327199d6 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:46.476904 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498198f-6cdb-4066-a8fb-1002327199d6 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:46.477483 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498198f-6cdb-4066-a8fb-1002327199d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:46.478035 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498198f-6cdb-4066-a8fb-1002327199d6 None admin] RBAC: Adding query filter params (role.id=e5e7de76725748df9add27e3c837d8ef, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=7987846276ad4ccd90899128ceb1354e) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:46.478345 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498198f-6cdb-4066-a8fb-1002327199d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:46.479825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498198f-6cdb-4066-a8fb-1002327199d6 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:46.485929 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 292/578] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:34:46 2022] GET /identity/v3/role_assignments?user.id=7987846276ad4ccd90899128ceb1354e&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=e5e7de76725748df9add27e3c837d8ef => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:46.486743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498198f-6cdb-4066-a8fb-1002327199d6 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:46.577514 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:46.579739 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67c521-4855-4b1b-85c6-e80c2cfb7301 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:46.604422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498198f-6cdb-4066-a8fb-1002327199d6 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:46.614111 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:46.621658 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf267f-5356-4936-b604-eff810b61c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:46.622487 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf267f-5356-4936-b604-eff810b61c7a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:46.622773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf267f-5356-4936-b604-eff810b61c7a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:46.623051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf267f-5356-4936-b604-eff810b61c7a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:46.631642 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf267f-5356-4936-b604-eff810b61c7a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:46.633119 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf267f-5356-4936-b604-eff810b61c7a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:46.646688 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b15916-bfca-4dff-b5b2-95be9d25fe98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:46.647525 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b15916-bfca-4dff-b5b2-95be9d25fe98 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:46.647809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b15916-bfca-4dff-b5b2-95be9d25fe98 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:46.648081 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b15916-bfca-4dff-b5b2-95be9d25fe98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:46.651059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-27bf267f-5356-4936-b604-eff810b61c7a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 20:34:46.651059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:46.651059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:46.651059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:46.651059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:46.651059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:46.651059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:46.651059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:46.651059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:46.651059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:46.651059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:46.651059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:46.651059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:34:46.651059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:34:46.651059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:34:46.651059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:34:46.652037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:46.652037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:46.652037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:34:46.652037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:46.652037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:34:46.652037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:46.652037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:46.652037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:46.652037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:46.652037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:46.652037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:46.652037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:46.652037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:46.652037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:46.652037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:46.652037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:46.652037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:46.652037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:46.652989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:46.652989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:46.652989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:34:46.652989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:34:46.652989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:34:46.652989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:34:46.652989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:34:46.652989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:34:46.652989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 20:34:46.652989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:46.657249 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 287/579] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:46.658185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf267f-5356-4936-b604-eff810b61c7a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:46.665540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b15916-bfca-4dff-b5b2-95be9d25fe98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:46.667609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b15916-bfca-4dff-b5b2-95be9d25fe98 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:46.689086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-45b15916-bfca-4dff-b5b2-95be9d25fe98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:46.689086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:46.689086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:46.689086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:46.689086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:46.689086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:46.689086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:46.689086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:46.689086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:46.689086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:46.689086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:46.689086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:46.689086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:46.689086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:46.689086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:46.690015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:46.690015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:46.690015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:46.690015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:46.690015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:46.690015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:46.690015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:46.690015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:46.690015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:46.690015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:46.690015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:46.690015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:46.690015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:46.690015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:46.690015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:46.690015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:46.690015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:46.690925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:46.690925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:46.690925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:46.690925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:46.690925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 293/580] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:46.691197 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b15916-bfca-4dff-b5b2-95be9d25fe98 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:46.772351 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf267f-5356-4936-b604-eff810b61c7a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:46.798163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b15916-bfca-4dff-b5b2-95be9d25fe98 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:46.808817 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e2bb3-f523-4362-9674-2934751128c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:46.809482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e2bb3-f523-4362-9674-2934751128c2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:46.809774 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e2bb3-f523-4362-9674-2934751128c2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:46.810045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e2bb3-f523-4362-9674-2934751128c2 None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:46.810846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e2bb3-f523-4362-9674-2934751128c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:46.811161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e2bb3-f523-4362-9674-2934751128c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:46.812637 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e2bb3-f523-4362-9674-2934751128c2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:46.827303 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 288/581] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:34:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:46.827303 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e2bb3-f523-4362-9674-2934751128c2 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:46.830720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:46.839501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ec274-7f84-4f4a-82ec-d60b12170d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:46.840308 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ec274-7f84-4f4a-82ec-d60b12170d78 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:46.840596 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ec274-7f84-4f4a-82ec-d60b12170d78 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:46.840876 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ec274-7f84-4f4a-82ec-d60b12170d78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:46.851702 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ec274-7f84-4f4a-82ec-d60b12170d78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:46.859565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-919ec274-7f84-4f4a-82ec-d60b12170d78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:46.859565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:46.859565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:46.859565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:46.859565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:46.859565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:46.859565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:46.859565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:46.859565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:46.859565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:46.859565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:46.859565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:46.859565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:46.859565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:46.859565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:46.859565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:46.860549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:46.860549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:46.860549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:46.860549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:46.860549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:46.860549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:46.860549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:46.860549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:46.860549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:46.860549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:46.860549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:46.860549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:46.860549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:46.860549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:46.860549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:46.860549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:46.861386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:46.861386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:46.861386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:46.861386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:46.861386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:46.861386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:46.861386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:46.861386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:46.861386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:46.861386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:46.861386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:46.861386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:46.861386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 294/582] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:34:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:46.862079 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ec274-7f84-4f4a-82ec-d60b12170d78 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:46.898676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:46.955240 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e2bb3-f523-4362-9674-2934751128c2 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:46.992186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89804c-9740-44d1-bd59-9f4b93f602b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:46.992864 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89804c-9740-44d1-bd59-9f4b93f602b8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:46.993166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89804c-9740-44d1-bd59-9f4b93f602b8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:46.993409 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89804c-9740-44d1-bd59-9f4b93f602b8 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:46.994237 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89804c-9740-44d1-bd59-9f4b93f602b8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:46.994542 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89804c-9740-44d1-bd59-9f4b93f602b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:46.995988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89804c-9740-44d1-bd59-9f4b93f602b8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:46.996561 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ec274-7f84-4f4a-82ec-d60b12170d78 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:47.018496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 289/583] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Jul 19 20:34:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:47.018496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89804c-9740-44d1-bd59-9f4b93f602b8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:47.038498 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9287f1-17af-4254-aba4-cce6f72ed38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:47.039098 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9287f1-17af-4254-aba4-cce6f72ed38f None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:47.039415 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9287f1-17af-4254-aba4-cce6f72ed38f None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:47.039735 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9287f1-17af-4254-aba4-cce6f72ed38f None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:47.040658 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9287f1-17af-4254-aba4-cce6f72ed38f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:47.040967 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9287f1-17af-4254-aba4-cce6f72ed38f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:47.042332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9287f1-17af-4254-aba4-cce6f72ed38f None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:47.055799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 295/584] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:47.056646 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9287f1-17af-4254-aba4-cce6f72ed38f None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:47.110204 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:47.122060 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89804c-9740-44d1-bd59-9f4b93f602b8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:47.131485 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:47.163951 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9287f1-17af-4254-aba4-cce6f72ed38f None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:47.164176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6cf7b-08e2-4bec-a8d7-a3869ee1ec94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:47.165052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6cf7b-08e2-4bec-a8d7-a3869ee1ec94 None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:47.165588 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6cf7b-08e2-4bec-a8d7-a3869ee1ec94 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:47.165863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6cf7b-08e2-4bec-a8d7-a3869ee1ec94 None admin] PATH_INFO: `/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/6dbbb8f7b3f2449fb9c64ca3815b6c1b/roles/e5e7de76725748df9add27e3c837d8ef` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:47.183883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6cf7b-08e2-4bec-a8d7-a3869ee1ec94 None admin] RBAC: Authorizing `identity:create_grant(project_id=327868f4f62e4e4a9c5bef4acd32fb29, user_id=6dbbb8f7b3f2449fb9c64ca3815b6c1b, role_id=e5e7de76725748df9add27e3c837d8ef)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:47.185836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6cf7b-08e2-4bec-a8d7-a3869ee1ec94 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:47.200812 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54981d05-0ba2-4a3d-8662-691318603b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:47.201479 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54981d05-0ba2-4a3d-8662-691318603b51 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:47.211522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 290/585] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:34:47 2022] PUT /identity/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/6dbbb8f7b3f2449fb9c64ca3815b6c1b/roles/e5e7de76725748df9add27e3c837d8ef => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:34:47.211763 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54981d05-0ba2-4a3d-8662-691318603b51 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:47.211763 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54981d05-0ba2-4a3d-8662-691318603b51 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:47.211938 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6cf7b-08e2-4bec-a8d7-a3869ee1ec94 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:47.212026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54981d05-0ba2-4a3d-8662-691318603b51 None admin] RBAC: Adding query filter params (name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:47.212026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54981d05-0ba2-4a3d-8662-691318603b51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:47.212026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54981d05-0ba2-4a3d-8662-691318603b51 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:47.214324 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 296/586] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jul 19 20:34:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:47.215220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54981d05-0ba2-4a3d-8662-691318603b51 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:47.367757 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54981d05-0ba2-4a3d-8662-691318603b51 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:47.381147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:47.382238 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6cf7b-08e2-4bec-a8d7-a3869ee1ec94 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:47.413865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed191386-0e12-4787-9d06-7e96b473ef01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:47.414670 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed191386-0e12-4787-9d06-7e96b473ef01 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:47.415108 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed191386-0e12-4787-9d06-7e96b473ef01 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:47.415415 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed191386-0e12-4787-9d06-7e96b473ef01 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:47.424580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a71e10-e59d-4255-8a14-bb150b55e7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:47.424767 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed191386-0e12-4787-9d06-7e96b473ef01 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:47.425385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a71e10-e59d-4255-8a14-bb150b55e7f7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:47.425670 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a71e10-e59d-4255-8a14-bb150b55e7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:47.426510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a71e10-e59d-4255-8a14-bb150b55e7f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:47.426759 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed191386-0e12-4787-9d06-7e96b473ef01 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:47.437807 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a71e10-e59d-4255-8a14-bb150b55e7f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:47.439326 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a71e10-e59d-4255-8a14-bb150b55e7f7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:47.443220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-ed191386-0e12-4787-9d06-7e96b473ef01 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 19 20:34:47.443220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:47.443220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:47.443220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:47.443220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:47.443220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:47.443220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:47.443220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:47.443220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:47.443220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:47.443220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:47.443220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:47.443220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:34:47.443220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:34:47.443220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:34:47.443220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:34:47.444200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:47.444200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:47.444200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:34:47.444200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:47.444200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:34:47.444200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:47.444200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:47.444200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:47.444200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:47.444200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:47.444200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:47.444200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:47.444200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:47.444200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:47.444200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:47.444200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:47.444200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:47.444200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:47.445140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:47.445140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:47.445140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:34:47.445140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:34:47.445140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:34:47.445140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:34:47.445140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:34:47.445140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:34:47.445140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 19 20:34:47.445140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:47.445140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 297/587] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:47.445743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed191386-0e12-4787-9d06-7e96b473ef01 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:47.460012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-d9a71e10-e59d-4255-8a14-bb150b55e7f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:47.460012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:47.460012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:47.460012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:47.460012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:47.460012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:47.460012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:47.460012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:47.460012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:47.460012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:47.460012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:47.460012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:47.460012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:47.460012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:47.460012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:47.460963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:47.460963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:47.460963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:47.460963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:47.460963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:47.460963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:47.460963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:47.460963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:47.460963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:47.460963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:47.460963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:47.460963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:47.460963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:47.460963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:47.460963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:47.460963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:47.460963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:47.461862 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:47.461862 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:47.461862 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:47.461862 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:47.462082 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 291/588] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:47.462832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a71e10-e59d-4255-8a14-bb150b55e7f7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:47.482588 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:47.566564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed191386-0e12-4787-9d06-7e96b473ef01 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:47.591292 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a71e10-e59d-4255-8a14-bb150b55e7f7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:47.607966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e6d4e-68fe-45a2-aaef-e7381b6bd834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:47.608875 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e6d4e-68fe-45a2-aaef-e7381b6bd834 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:47.609228 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e6d4e-68fe-45a2-aaef-e7381b6bd834 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:47.609573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e6d4e-68fe-45a2-aaef-e7381b6bd834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:47.625391 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e6d4e-68fe-45a2-aaef-e7381b6bd834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:47.627508 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e6d4e-68fe-45a2-aaef-e7381b6bd834 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:47.633090 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777b716-bee6-4c19-ad4c-58aa04dc2729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:47.633866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777b716-bee6-4c19-ad4c-58aa04dc2729 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:47.634220 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777b716-bee6-4c19-ad4c-58aa04dc2729 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:47.634582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777b716-bee6-4c19-ad4c-58aa04dc2729 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:47.636129 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777b716-bee6-4c19-ad4c-58aa04dc2729 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:47.636528 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777b716-bee6-4c19-ad4c-58aa04dc2729 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:47.638542 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777b716-bee6-4c19-ad4c-58aa04dc2729 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:47.649032 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-3e2e6d4e-68fe-45a2-aaef-e7381b6bd834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:47.649032 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:47.649032 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:47.649032 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:47.649032 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:47.649032 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:47.649032 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:47.649032 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:47.649032 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:47.649032 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:47.649032 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:47.649032 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:47.649032 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:47.649032 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:47.649032 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:47.650256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:47.650256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:47.650256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:47.650256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:47.650256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:47.650256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:47.650256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:47.650256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:47.650256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:47.650256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:47.650256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:47.650256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:47.650256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:47.650256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:47.650256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:47.650256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:47.650256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:47.651223 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:47.651223 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:47.651223 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:47.651223 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:47.653168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 298/589] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:47.653168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e6d4e-68fe-45a2-aaef-e7381b6bd834 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:47.670639 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 292/590] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Jul 19 20:34:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:47.671770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777b716-bee6-4c19-ad4c-58aa04dc2729 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:47.684029 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:47.743852 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:47.775576 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e6d4e-68fe-45a2-aaef-e7381b6bd834 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:47.788334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777b716-bee6-4c19-ad4c-58aa04dc2729 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:47.810359 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa8b18-2d57-4d74-aa69-a153d01d6e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:47.811171 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa8b18-2d57-4d74-aa69-a153d01d6e1c None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:47.811604 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa8b18-2d57-4d74-aa69-a153d01d6e1c None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:47.811604 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa8b18-2d57-4d74-aa69-a153d01d6e1c None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:47.812299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa8b18-2d57-4d74-aa69-a153d01d6e1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:47.812601 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa8b18-2d57-4d74-aa69-a153d01d6e1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:47.813953 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa8b18-2d57-4d74-aa69-a153d01d6e1c None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:47.831182 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 299/591] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:47.831182 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa8b18-2d57-4d74-aa69-a153d01d6e1c None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:47.835379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ccc81-54ee-4063-a294-4f2e2691a9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:47.836297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ccc81-54ee-4063-a294-4f2e2691a9ac None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:47.836808 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ccc81-54ee-4063-a294-4f2e2691a9ac None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:47.837277 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ccc81-54ee-4063-a294-4f2e2691a9ac None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:47.838264 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ccc81-54ee-4063-a294-4f2e2691a9ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:47.838767 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ccc81-54ee-4063-a294-4f2e2691a9ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:47.840402 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ccc81-54ee-4063-a294-4f2e2691a9ac None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:47.857295 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 293/592] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:47.858429 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ccc81-54ee-4063-a294-4f2e2691a9ac None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:47.922924 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:47.943950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa8b18-2d57-4d74-aa69-a153d01d6e1c None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:47.962536 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ccc81-54ee-4063-a294-4f2e2691a9ac None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:47.979131 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c75e3d-12d8-4984-8f3e-1c249693d99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:47.979963 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c75e3d-12d8-4984-8f3e-1c249693d99b None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:47.980237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c75e3d-12d8-4984-8f3e-1c249693d99b None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:47.980511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c75e3d-12d8-4984-8f3e-1c249693d99b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:47.991408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c75e3d-12d8-4984-8f3e-1c249693d99b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:47.993057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c75e3d-12d8-4984-8f3e-1c249693d99b None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:47.996452 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:48.000759 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accba2ca-2c8e-43e0-9342-a9239d606819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:48.001808 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accba2ca-2c8e-43e0-9342-a9239d606819 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:48.002288 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accba2ca-2c8e-43e0-9342-a9239d606819 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:48.002757 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accba2ca-2c8e-43e0-9342-a9239d606819 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:48.011138 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accba2ca-2c8e-43e0-9342-a9239d606819 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:48.012908 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accba2ca-2c8e-43e0-9342-a9239d606819 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:48.013027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-a0c75e3d-12d8-4984-8f3e-1c249693d99b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:48.013027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:48.013027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:48.013027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:48.013027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:48.013027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:48.013027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:48.013027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:48.013027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:48.013027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:48.013027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:48.013027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:48.013027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:48.013027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:48.013027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:48.014041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:48.014041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:48.014041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:48.014041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:48.014041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:48.014041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:48.014041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:48.014041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:48.014041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:48.014041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:48.014041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:48.014041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:48.014041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:48.014041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:48.014041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:48.014041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:48.014041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:48.015300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:48.015300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:48.015300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:48.015300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:48.015300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 300/593] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:48.015599 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c75e3d-12d8-4984-8f3e-1c249693d99b None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:48.031335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-accba2ca-2c8e-43e0-9342-a9239d606819 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:48.031335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:48.031335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:48.031335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:48.031335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:48.031335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:48.031335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:48.031335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:48.031335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:48.031335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:48.031335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:48.031335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:48.031335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:34:48.031335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:34:48.031335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:34:48.032374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:34:48.032374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:48.032374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:48.032374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:48.032374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:48.032374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:48.032374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:48.032374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:48.032374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:48.032374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:48.032374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:48.032374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:48.032374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:48.032374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:48.032374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:48.032374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:48.032374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:48.033264 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:34:48.033264 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:34:48.033264 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:34:48.033264 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:34:48.033264 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:34:48.033264 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:34:48.033264 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:48.033264 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:48.040586 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 294/594] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:48.041631 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accba2ca-2c8e-43e0-9342-a9239d606819 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:48.121112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c75e3d-12d8-4984-8f3e-1c249693d99b None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:48.145194 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accba2ca-2c8e-43e0-9342-a9239d606819 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:48.158388 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d14eb5-ea19-4ebd-a7c4-cff4f26ee78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:48.159303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d14eb5-ea19-4ebd-a7c4-cff4f26ee78c None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:48.159596 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d14eb5-ea19-4ebd-a7c4-cff4f26ee78c None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:48.160121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d14eb5-ea19-4ebd-a7c4-cff4f26ee78c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:48.162654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:48.169360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d14eb5-ea19-4ebd-a7c4-cff4f26ee78c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:48.171779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d14eb5-ea19-4ebd-a7c4-cff4f26ee78c None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:48.182524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e8615-e022-4fb8-9e92-f6b7c0166a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:48.183426 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e8615-e022-4fb8-9e92-f6b7c0166a8d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:48.183938 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e8615-e022-4fb8-9e92-f6b7c0166a8d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:48.184381 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e8615-e022-4fb8-9e92-f6b7c0166a8d None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:48.185299 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e8615-e022-4fb8-9e92-f6b7c0166a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:48.185746 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e8615-e022-4fb8-9e92-f6b7c0166a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:48.187452 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e8615-e022-4fb8-9e92-f6b7c0166a8d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:48.187609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-d2d14eb5-ea19-4ebd-a7c4-cff4f26ee78c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 20:34:48.187609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:48.187609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:48.187609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:48.187609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:48.187609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:48.187609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:48.187609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:48.187609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:48.187609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:48.187609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:48.187609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:48.187609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:34:48.187609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:34:48.187609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:34:48.187609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:34:48.188694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:48.188694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:48.188694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:34:48.188694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:48.188694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:34:48.188694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:48.188694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:48.188694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:48.188694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:48.188694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:48.188694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:48.188694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:48.188694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:48.188694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:48.188694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:48.188694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:48.188694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:48.188694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:48.189660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:48.189660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:48.189660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:34:48.189660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:34:48.189660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:34:48.189660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:34:48.189660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:34:48.189660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:34:48.189660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 20:34:48.189660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:48.194597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 301/595] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:34:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:48.195459 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d14eb5-ea19-4ebd-a7c4-cff4f26ee78c None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:48.204450 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 295/596] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:48.205561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e8615-e022-4fb8-9e92-f6b7c0166a8d None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:48.256602 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:48.307969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d14eb5-ea19-4ebd-a7c4-cff4f26ee78c None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:48.310772 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e8615-e022-4fb8-9e92-f6b7c0166a8d None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:48.345137 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56e9a1-72e8-43dd-92c4-fbec6547d842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:48.345798 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56e9a1-72e8-43dd-92c4-fbec6547d842 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:48.345993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935d8b5-108b-4b34-93cd-caf1c20bc357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:48.346123 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56e9a1-72e8-43dd-92c4-fbec6547d842 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:48.346334 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56e9a1-72e8-43dd-92c4-fbec6547d842 None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:48.347052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935d8b5-108b-4b34-93cd-caf1c20bc357 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:48.347172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56e9a1-72e8-43dd-92c4-fbec6547d842 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:48.347580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56e9a1-72e8-43dd-92c4-fbec6547d842 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:48.347846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935d8b5-108b-4b34-93cd-caf1c20bc357 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:48.348255 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935d8b5-108b-4b34-93cd-caf1c20bc357 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:48.349098 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56e9a1-72e8-43dd-92c4-fbec6547d842 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:48.349381 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935d8b5-108b-4b34-93cd-caf1c20bc357 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:48.349837 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935d8b5-108b-4b34-93cd-caf1c20bc357 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:48.351412 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935d8b5-108b-4b34-93cd-caf1c20bc357 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:48.367030 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 302/597] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:34:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:48.367950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56e9a1-72e8-43dd-92c4-fbec6547d842 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:48.375217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 296/598] 10.222.0.77 () {56 vars in 1139 bytes} [Tue Jul 19 20:34:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:48.376292 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935d8b5-108b-4b34-93cd-caf1c20bc357 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:48.428253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:48.485802 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56e9a1-72e8-43dd-92c4-fbec6547d842 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:48.487933 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935d8b5-108b-4b34-93cd-caf1c20bc357 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:48.498183 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:48.529469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd772c-78d7-4b69-a8c1-c21154bc87a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:48.530415 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd772c-78d7-4b69-a8c1-c21154bc87a4 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:48.530700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd772c-78d7-4b69-a8c1-c21154bc87a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:48.530976 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd772c-78d7-4b69-a8c1-c21154bc87a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:48.532721 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c88172-4e7a-4d6c-a766-fd46161a2a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:48.533714 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c88172-4e7a-4d6c-a766-fd46161a2a6e None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:48.534157 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c88172-4e7a-4d6c-a766-fd46161a2a6e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:48.534470 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c88172-4e7a-4d6c-a766-fd46161a2a6e None admin] PATH_INFO: `/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/1ab64f417fe74fc585f32691aa7fb515/roles/e5e7de76725748df9add27e3c837d8ef` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:48.539558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd772c-78d7-4b69-a8c1-c21154bc87a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:48.541167 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd772c-78d7-4b69-a8c1-c21154bc87a4 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:48.552866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c88172-4e7a-4d6c-a766-fd46161a2a6e None admin] RBAC: Authorizing `identity:create_grant(project_id=327868f4f62e4e4a9c5bef4acd32fb29, user_id=1ab64f417fe74fc585f32691aa7fb515, role_id=e5e7de76725748df9add27e3c837d8ef)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:48.554449 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c88172-4e7a-4d6c-a766-fd46161a2a6e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:48.559296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-01fd772c-78d7-4b69-a8c1-c21154bc87a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:48.559296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:48.559296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:48.559296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:48.559296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:48.559296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:48.559296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:48.559296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:48.559296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:48.559296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:48.559296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:48.559296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:48.559296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:34:48.559296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:34:48.559296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:34:48.560243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:34:48.560243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:48.560243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:48.560243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:48.560243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:48.560243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:48.560243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:48.560243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:48.560243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:48.560243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:48.560243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:48.560243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:48.560243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:48.560243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:48.560243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:48.560243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:48.560243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:48.561775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:34:48.561775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:34:48.561775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:34:48.561775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:34:48.561775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:34:48.561775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:34:48.561775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:48.561775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:48.561775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 303/599] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:48.562304 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd772c-78d7-4b69-a8c1-c21154bc87a4 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:48.578944 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 297/600] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:34:48 2022] PUT /identity/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/1ab64f417fe74fc585f32691aa7fb515/roles/e5e7de76725748df9add27e3c837d8ef => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:34:48.579914 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c88172-4e7a-4d6c-a766-fd46161a2a6e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:48.676872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd772c-78d7-4b69-a8c1-c21154bc87a4 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:48.702041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:48.718740 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7879447-407c-46d7-9e70-2ff9cacceb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:48.719990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7879447-407c-46d7-9e70-2ff9cacceb10 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:48.720568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7879447-407c-46d7-9e70-2ff9cacceb10 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:48.721101 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7879447-407c-46d7-9e70-2ff9cacceb10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:48.733290 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7879447-407c-46d7-9e70-2ff9cacceb10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:48.734072 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c88172-4e7a-4d6c-a766-fd46161a2a6e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:48.735741 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7879447-407c-46d7-9e70-2ff9cacceb10 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:48.755713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-f7879447-407c-46d7-9e70-2ff9cacceb10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:48.755713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:48.755713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:48.755713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:48.755713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:48.755713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:48.755713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:48.755713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:48.755713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:48.755713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:48.755713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:48.755713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:48.755713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:48.755713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:48.755713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:48.756683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:48.756683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:48.756683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:48.756683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:48.756683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:48.756683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:48.756683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:48.756683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:48.756683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:48.756683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:48.756683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:48.756683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:48.756683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:48.756683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:48.756683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:48.756683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:48.756683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:48.757587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:48.757587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:48.757587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:48.757587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:48.759929 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 304/601] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:48.765265 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84d53c-8c66-4120-80ea-cc0400742999 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:48.765265 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84d53c-8c66-4120-80ea-cc0400742999 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:48.765265 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84d53c-8c66-4120-80ea-cc0400742999 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:48.765265 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 305/602] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:48.767306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84d53c-8c66-4120-80ea-cc0400742999 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:48.781890 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4475c9-5770-4492-9366-412a4c4cdb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:48.783232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4475c9-5770-4492-9366-412a4c4cdb8d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:48.783800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4475c9-5770-4492-9366-412a4c4cdb8d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:48.784302 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4475c9-5770-4492-9366-412a4c4cdb8d None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:48.786389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4475c9-5770-4492-9366-412a4c4cdb8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:48.787135 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4475c9-5770-4492-9366-412a4c4cdb8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:48.788873 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4475c9-5770-4492-9366-412a4c4cdb8d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:48.811517 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 298/603] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:34:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:48.811517 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8d53f-c750-4308-84f5-067e019bd0f0 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:48.811517 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8d53f-c750-4308-84f5-067e019bd0f0 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:48.811517 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8d53f-c750-4308-84f5-067e019bd0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:48.826961 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-2ac8d53f-c750-4308-84f5-067e019bd0f0 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:48.828928 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-2ac8d53f-c750-4308-84f5-067e019bd0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:48.843513 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:48.898325 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84d53c-8c66-4120-80ea-cc0400742999 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:48.914677 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 299/604] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:48.915983 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8d53f-c750-4308-84f5-067e019bd0f0 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:48.942914 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40fc66-65ce-4bfd-8823-9e17d220c390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:48.943863 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40fc66-65ce-4bfd-8823-9e17d220c390 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:48.944432 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40fc66-65ce-4bfd-8823-9e17d220c390 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:48.945177 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40fc66-65ce-4bfd-8823-9e17d220c390 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:48.946344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40fc66-65ce-4bfd-8823-9e17d220c390 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:48.946828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40fc66-65ce-4bfd-8823-9e17d220c390 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:48.948695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40fc66-65ce-4bfd-8823-9e17d220c390 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:48.964176 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 306/605] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:48.969603 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40fc66-65ce-4bfd-8823-9e17d220c390 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:49.020201 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:49.048211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8d53f-c750-4308-84f5-067e019bd0f0 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:49.092088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503505dd-c98c-46ba-a094-072463fe438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:49.093881 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503505dd-c98c-46ba-a094-072463fe438e None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:49.094285 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503505dd-c98c-46ba-a094-072463fe438e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:49.094657 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503505dd-c98c-46ba-a094-072463fe438e None admin] PATH_INFO: `/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/7d9a41e10cb64ee9972debaf856503d4/roles/e5e7de76725748df9add27e3c837d8ef` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:49.103602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40fc66-65ce-4bfd-8823-9e17d220c390 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:49.114324 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503505dd-c98c-46ba-a094-072463fe438e None admin] RBAC: Authorizing `identity:create_grant(project_id=327868f4f62e4e4a9c5bef4acd32fb29, user_id=7d9a41e10cb64ee9972debaf856503d4, role_id=e5e7de76725748df9add27e3c837d8ef)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:49.116395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503505dd-c98c-46ba-a094-072463fe438e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:49.121763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:49.146621 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 300/606] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:34:48 2022] PUT /identity/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/7d9a41e10cb64ee9972debaf856503d4/roles/e5e7de76725748df9add27e3c837d8ef => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:34:49.146621 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503505dd-c98c-46ba-a094-072463fe438e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:49.159448 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948d3e4-e168-4e18-8930-771eb237a4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:49.160781 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948d3e4-e168-4e18-8930-771eb237a4bf None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:49.161160 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948d3e4-e168-4e18-8930-771eb237a4bf None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:49.161531 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948d3e4-e168-4e18-8930-771eb237a4bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:49.184421 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948d3e4-e168-4e18-8930-771eb237a4bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:49.200331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-9948d3e4-e168-4e18-8930-771eb237a4bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:49.200331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:49.200331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:49.200331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:49.200331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:49.200331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:49.200331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:49.200331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:49.200331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:49.200331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:49.200331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:49.200331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:49.200331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:49.200331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:49.200331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:49.200331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:49.201595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:49.201595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:49.201595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:49.201595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:49.201595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:49.201595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:49.201595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:49.201595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:49.201595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:49.201595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:49.201595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:49.201595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:49.201595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:49.201595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:49.201595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:49.201595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:49.202636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:49.202636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:49.202636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:49.202636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:49.202636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:49.202636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:49.202636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:49.202636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:49.202636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:49.202636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:49.202636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:49.202636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:49.205542 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 307/607] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:34:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:49.212453 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948d3e4-e168-4e18-8930-771eb237a4bf None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:49.330522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:49.363111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948d3e4-e168-4e18-8930-771eb237a4bf None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:49.387929 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503505dd-c98c-46ba-a094-072463fe438e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:49.404814 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b4e44-5a46-4114-931f-66457f80d1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:49.405892 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b4e44-5a46-4114-931f-66457f80d1f7 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:49.406274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b4e44-5a46-4114-931f-66457f80d1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:49.406649 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b4e44-5a46-4114-931f-66457f80d1f7 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:49.407638 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b4e44-5a46-4114-931f-66457f80d1f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:49.408039 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b4e44-5a46-4114-931f-66457f80d1f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:49.409506 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b4e44-5a46-4114-931f-66457f80d1f7 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:49.420117 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 308/608] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jul 19 20:34:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:49.426274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b4e44-5a46-4114-931f-66457f80d1f7 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:49.437062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17f346-f94a-4032-8756-557c24f94bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:49.438132 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17f346-f94a-4032-8756-557c24f94bed None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:49.438575 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17f346-f94a-4032-8756-557c24f94bed None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:49.439010 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17f346-f94a-4032-8756-557c24f94bed None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:49.448646 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17f346-f94a-4032-8756-557c24f94bed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:49.450102 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17f346-f94a-4032-8756-557c24f94bed None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:49.465989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-7b17f346-f94a-4032-8756-557c24f94bed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:49.465989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:49.465989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:49.465989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:49.465989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:49.465989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:49.465989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:49.465989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:49.465989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:49.465989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:49.465989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:49.465989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:49.465989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:34:49.465989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:34:49.465989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:34:49.467045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:34:49.467045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:49.467045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:49.467045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:49.467045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:49.467045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:49.467045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:49.467045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:49.467045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:49.467045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:49.467045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:49.467045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:49.467045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:49.467045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:49.467045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:49.467045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:49.467045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:49.468217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:34:49.468217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:34:49.468217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:34:49.468217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:34:49.468217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:34:49.468217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:34:49.468217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:49.468217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:49.468217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 301/609] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:49.468735 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c86c30-1c46-4e7c-ac72-9a135cf2ea5e None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:49.468735 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c86c30-1c46-4e7c-ac72-9a135cf2ea5e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:49.470408 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c86c30-1c46-4e7c-ac72-9a135cf2ea5e None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:49.470523 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 302/610] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:49.475577 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c86c30-1c46-4e7c-ac72-9a135cf2ea5e None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:49.538083 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:49.563428 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b4e44-5a46-4114-931f-66457f80d1f7 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:49.588304 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c86c30-1c46-4e7c-ac72-9a135cf2ea5e None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:49.609175 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd9ce4-226b-499c-b2fd-4e75c8a494fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:49.610789 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd9ce4-226b-499c-b2fd-4e75c8a494fa None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:49.611564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd9ce4-226b-499c-b2fd-4e75c8a494fa None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:49.612030 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cd9ce4-226b-499c-b2fd-4e75c8a494fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:49.626161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd9ce4-226b-499c-b2fd-4e75c8a494fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:49.626342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5812b-02b9-4453-a6d1-4eab38b9bd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:49.627021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5812b-02b9-4453-a6d1-4eab38b9bd47 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:49.627407 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5812b-02b9-4453-a6d1-4eab38b9bd47 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:49.627797 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5812b-02b9-4453-a6d1-4eab38b9bd47 None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:49.628652 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5812b-02b9-4453-a6d1-4eab38b9bd47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:49.628770 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cd9ce4-226b-499c-b2fd-4e75c8a494fa None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:49.629547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5812b-02b9-4453-a6d1-4eab38b9bd47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:49.631142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5812b-02b9-4453-a6d1-4eab38b9bd47 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:49.639114 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:49.647788 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 303/611] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:34:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:49.649145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024b47c-289d-4dfa-aa1d-404df3c431fe None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:49.649502 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024b47c-289d-4dfa-aa1d-404df3c431fe None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:49.649849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024b47c-289d-4dfa-aa1d-404df3c431fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:49.652654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-57cd9ce4-226b-499c-b2fd-4e75c8a494fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:49.652654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:49.652654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:49.652654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:49.652654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:49.652654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:49.652654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:49.652654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:49.652654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:49.652654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:49.652654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:49.652654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:49.652654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:49.652654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:49.652654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:49.653567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:49.653567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:49.653567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:49.653567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:49.653567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:49.653567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:49.653567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:49.653567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:49.653567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:49.653567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:49.653567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:49.653567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:49.653567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:49.653567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:49.653567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:49.653567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:49.653567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:49.654468 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:49.654468 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:49.654468 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:49.654468 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:49.654468 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 309/612] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:34:49.655180 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd9ce4-226b-499c-b2fd-4e75c8a494fa None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:49.680034 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-5024b47c-289d-4dfa-aa1d-404df3c431fe None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:49.681668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-5024b47c-289d-4dfa-aa1d-404df3c431fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:49.771589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 304/613] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:49.772498 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024b47c-289d-4dfa-aa1d-404df3c431fe None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:49.780717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cd9ce4-226b-499c-b2fd-4e75c8a494fa None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:49.817545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f547ac7-c974-40ce-a105-f4291390c7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:49.818471 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f547ac7-c974-40ce-a105-f4291390c7ab None admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:49.818756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f547ac7-c974-40ce-a105-f4291390c7ab None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:49.819035 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f547ac7-c974-40ce-a105-f4291390c7ab None admin] PATH_INFO: `/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/5b2c0f24d666462aa14ea4eee0592062/roles/e5e7de76725748df9add27e3c837d8ef` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:49.838454 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f547ac7-c974-40ce-a105-f4291390c7ab None admin] RBAC: Authorizing `identity:create_grant(project_id=327868f4f62e4e4a9c5bef4acd32fb29, user_id=5b2c0f24d666462aa14ea4eee0592062, role_id=e5e7de76725748df9add27e3c837d8ef)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:49.840104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f547ac7-c974-40ce-a105-f4291390c7ab None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:49.843996 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:49.858567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 310/614] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:34:49 2022] PUT /identity/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/5b2c0f24d666462aa14ea4eee0592062/roles/e5e7de76725748df9add27e3c837d8ef => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:34:49.860092 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f547ac7-c974-40ce-a105-f4291390c7ab None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:49.929140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:49.985316 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024b47c-289d-4dfa-aa1d-404df3c431fe None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:49.994446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f547ac7-c974-40ce-a105-f4291390c7ab None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:50.035821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e301e-a5b1-4223-befc-400feb7072b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:50.036881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e301e-a5b1-4223-befc-400feb7072b3 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:50.037301 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e301e-a5b1-4223-befc-400feb7072b3 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:50.037704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e301e-a5b1-4223-befc-400feb7072b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:50.049239 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e301e-a5b1-4223-befc-400feb7072b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:50.058083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-626e301e-a5b1-4223-befc-400feb7072b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:50.058083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:50.058083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:50.058083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:50.058083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:50.058083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:50.058083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:50.058083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:50.058083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:50.058083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:50.058083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:50.058083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:50.058083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:50.058083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:50.058083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:50.058083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:50.059299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:50.059299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:50.059299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:50.059299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:50.059299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:50.059299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:50.059299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:50.059299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:50.059299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:50.059299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:50.059299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:50.059299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:50.059299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:50.059299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:50.059299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:50.059299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:50.060346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:50.060346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:50.060346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:50.060346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:50.060346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:50.060346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:50.060346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:50.060346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:50.060346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:50.060346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:50.060346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:50.060346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:50.062785 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 311/615] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:34:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:50.069701 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e301e-a5b1-4223-befc-400feb7072b3 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:50.072820 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7c050-5c2b-4bbf-b584-350ee5fb1a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:50.073810 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7c050-5c2b-4bbf-b584-350ee5fb1a4a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:50.074096 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7c050-5c2b-4bbf-b584-350ee5fb1a4a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:50.074377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7c050-5c2b-4bbf-b584-350ee5fb1a4a None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:50.076081 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7c050-5c2b-4bbf-b584-350ee5fb1a4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:50.076401 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7c050-5c2b-4bbf-b584-350ee5fb1a4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:50.077777 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7c050-5c2b-4bbf-b584-350ee5fb1a4a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:50.099395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 305/616] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:50.100922 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7c050-5c2b-4bbf-b584-350ee5fb1a4a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:50.207229 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e301e-a5b1-4223-befc-400feb7072b3 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:50.219499 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:50.258377 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59ac22-ab4e-497b-84a4-812ce93d1251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:50.259396 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59ac22-ab4e-497b-84a4-812ce93d1251 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:50.259864 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59ac22-ab4e-497b-84a4-812ce93d1251 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:50.260300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59ac22-ab4e-497b-84a4-812ce93d1251 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:50.261209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59ac22-ab4e-497b-84a4-812ce93d1251 None admin] RBAC: Adding query filter params (name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:50.261682 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59ac22-ab4e-497b-84a4-812ce93d1251 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:50.263205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59ac22-ab4e-497b-84a4-812ce93d1251 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:50.282071 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 312/617] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jul 19 20:34:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:50.287540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7c050-5c2b-4bbf-b584-350ee5fb1a4a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:50.289364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59ac22-ab4e-497b-84a4-812ce93d1251 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:50.303591 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:50.366496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf60c8-b6e3-442f-8270-9a869d71bc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:50.367228 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf60c8-b6e3-442f-8270-9a869d71bc4f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:50.367537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf60c8-b6e3-442f-8270-9a869d71bc4f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:50.367814 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf60c8-b6e3-442f-8270-9a869d71bc4f None admin] PATH_INFO: `/v3/users/swift` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:50.382756 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf60c8-b6e3-442f-8270-9a869d71bc4f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:50.384258 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf60c8-b6e3-442f-8270-9a869d71bc4f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:50.417388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-eacf60c8-b6e3-442f-8270-9a869d71bc4f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 20:34:50.417388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:50.417388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:50.417388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:50.417388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:50.417388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:50.417388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:50.417388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:50.417388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:50.417388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:50.417388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:50.417388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:50.417388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:34:50.417388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:34:50.417388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:34:50.417388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:34:50.418649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:50.418649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:50.418649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:34:50.418649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:50.418649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:34:50.418649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:50.418649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:50.418649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:50.418649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:50.418649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:50.418649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:50.418649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:50.418649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:50.418649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:50.418649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:50.418649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:50.418649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:50.418649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:50.419880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:50.419880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:50.419880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:34:50.419880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:34:50.419880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:34:50.419880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:34:50.419880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:34:50.419880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:34:50.419880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 20:34:50.419880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:50.419880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 306/618] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:34:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:50.425967 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf60c8-b6e3-442f-8270-9a869d71bc4f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:50.500679 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59ac22-ab4e-497b-84a4-812ce93d1251 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:50.562856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9536d-599f-4129-9635-4b41826fd287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:50.564891 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9536d-599f-4129-9635-4b41826fd287 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:50.564891 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9536d-599f-4129-9635-4b41826fd287 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:50.564891 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9536d-599f-4129-9635-4b41826fd287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:50.578134 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9536d-599f-4129-9635-4b41826fd287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:50.580550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9536d-599f-4129-9635-4b41826fd287 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:50.603512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-cbf9536d-599f-4129-9635-4b41826fd287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:50.603512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:50.603512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:50.603512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:50.603512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:50.603512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:50.603512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:50.603512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:50.603512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:50.603512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:50.603512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:50.603512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:50.603512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:50.603512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:50.603512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:50.604722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:50.604722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:50.604722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:50.604722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:50.604722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:50.604722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:50.604722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:50.604722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:50.604722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:50.604722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:50.604722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:50.604722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:50.604722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:50.604722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:50.604722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:50.604722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:50.604722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:50.606013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:50.606013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:50.606013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:50.606013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:50.608597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 313/619] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:50.614431 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9536d-599f-4129-9635-4b41826fd287 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:50.617651 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf60c8-b6e3-442f-8270-9a869d71bc4f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:50.673194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:50.688626 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466773a-6156-4f07-a531-8bba49b59d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:50.689674 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466773a-6156-4f07-a531-8bba49b59d3c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:50.692230 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466773a-6156-4f07-a531-8bba49b59d3c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:50.692525 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466773a-6156-4f07-a531-8bba49b59d3c None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:50.693888 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466773a-6156-4f07-a531-8bba49b59d3c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:50.693888 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466773a-6156-4f07-a531-8bba49b59d3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:50.695232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466773a-6156-4f07-a531-8bba49b59d3c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:50.714333 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 307/620] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Jul 19 20:34:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:50.719887 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466773a-6156-4f07-a531-8bba49b59d3c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:50.759624 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:50.773901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9536d-599f-4129-9635-4b41826fd287 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:50.814208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd6a95-baf1-46d3-b656-9b8616e2a97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:50.815695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd6a95-baf1-46d3-b656-9b8616e2a97d None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:50.816208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd6a95-baf1-46d3-b656-9b8616e2a97d None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:50.817301 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd6a95-baf1-46d3-b656-9b8616e2a97d None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:50.818249 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd6a95-baf1-46d3-b656-9b8616e2a97d None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:50.818775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd6a95-baf1-46d3-b656-9b8616e2a97d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:50.820464 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd6a95-baf1-46d3-b656-9b8616e2a97d None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:50.837200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 314/621] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:50.845918 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd6a95-baf1-46d3-b656-9b8616e2a97d None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:50.892333 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466773a-6156-4f07-a531-8bba49b59d3c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:50.936771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83e2b5-f997-4573-aede-476f330400b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:50.937693 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83e2b5-f997-4573-aede-476f330400b6 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:50.937969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83e2b5-f997-4573-aede-476f330400b6 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:50.938243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83e2b5-f997-4573-aede-476f330400b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:50.949569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83e2b5-f997-4573-aede-476f330400b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:50.951216 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83e2b5-f997-4573-aede-476f330400b6 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:50.954306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:50.972537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-9e83e2b5-f997-4573-aede-476f330400b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:50.972537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:50.972537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:50.972537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:50.972537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:50.972537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:50.972537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:50.972537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:50.972537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:50.972537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:50.972537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:50.972537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:50.972537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:50.972537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:50.972537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:50.973667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:50.973667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:50.973667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:50.973667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:50.973667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:50.973667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:50.973667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:50.973667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:50.973667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:50.973667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:50.973667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:50.973667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:50.973667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:50.973667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:50.973667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:50.973667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:50.973667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:50.974679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:50.974679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:50.974679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:50.974679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:50.974909 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd6a95-baf1-46d3-b656-9b8616e2a97d None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:50.981079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 308/622] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:50.982676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ab819-cd3c-4ab7-b0d8-17d197478365 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:50.983172 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ab819-cd3c-4ab7-b0d8-17d197478365 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:50.983618 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ab819-cd3c-4ab7-b0d8-17d197478365 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:50.985389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 309/623] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:50.986206 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ab819-cd3c-4ab7-b0d8-17d197478365 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:51.019918 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df23be-81dd-4f98-83f5-854e46047e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:51.021132 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df23be-81dd-4f98-83f5-854e46047e90 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:51.021423 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df23be-81dd-4f98-83f5-854e46047e90 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:51.021705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df23be-81dd-4f98-83f5-854e46047e90 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:51.030753 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df23be-81dd-4f98-83f5-854e46047e90 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:51.032254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df23be-81dd-4f98-83f5-854e46047e90 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:51.052199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-21df23be-81dd-4f98-83f5-854e46047e90 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 20:34:51.052199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:51.052199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:51.052199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:51.052199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:51.052199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:51.052199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:51.052199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:51.052199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:51.052199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:51.052199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:51.052199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:51.052199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:34:51.052199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:34:51.052199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:34:51.052199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:34:51.053368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:51.053368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:51.053368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:34:51.053368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:51.053368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:34:51.053368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:51.053368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:51.053368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:51.053368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:51.053368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:51.053368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:51.053368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:51.053368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:51.053368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:51.053368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:51.053368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:51.053368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:51.053368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:51.054394 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:51.054394 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:51.054394 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:34:51.054394 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:34:51.054394 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:34:51.054394 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:34:51.054394 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:34:51.054394 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:34:51.054394 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 20:34:51.054394 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:51.060901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 315/624] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Jul 19 20:34:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:51.062391 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50944ac2-1dfe-4031-8c90-6a3a72abe066 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:51.062823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50944ac2-1dfe-4031-8c90-6a3a72abe066 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:51.063242 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50944ac2-1dfe-4031-8c90-6a3a72abe066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:51.080675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:51.083460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-50944ac2-1dfe-4031-8c90-6a3a72abe066 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:51.085167 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-50944ac2-1dfe-4031-8c90-6a3a72abe066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:51.110556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ab819-cd3c-4ab7-b0d8-17d197478365 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:51.153423 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6cf08-5f7d-42f8-9992-9053117b3d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:51.154331 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6cf08-5f7d-42f8-9992-9053117b3d2e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:51.154331 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6cf08-5f7d-42f8-9992-9053117b3d2e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:51.154554 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6cf08-5f7d-42f8-9992-9053117b3d2e None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:51.155335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6cf08-5f7d-42f8-9992-9053117b3d2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:51.155674 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6cf08-5f7d-42f8-9992-9053117b3d2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:51.157083 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6cf08-5f7d-42f8-9992-9053117b3d2e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:51.174886 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 310/625] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:51.174886 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6cf08-5f7d-42f8-9992-9053117b3d2e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:51.191416 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 316/626] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:51.192848 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50944ac2-1dfe-4031-8c90-6a3a72abe066 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:51.290562 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:51.307568 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6cf08-5f7d-42f8-9992-9053117b3d2e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:51.319684 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50944ac2-1dfe-4031-8c90-6a3a72abe066 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:51.355289 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65e71f-6a8d-479b-ac09-37a053177a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:51.355513 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edf78b-ded0-4b25-a8ff-cf079d593171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:51.356241 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edf78b-ded0-4b25-a8ff-cf079d593171 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:51.356528 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edf78b-ded0-4b25-a8ff-cf079d593171 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:51.356805 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edf78b-ded0-4b25-a8ff-cf079d593171 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:51.357087 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65e71f-6a8d-479b-ac09-37a053177a8e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:51.357720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65e71f-6a8d-479b-ac09-37a053177a8e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:51.358186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db65e71f-6a8d-479b-ac09-37a053177a8e None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:51.359875 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65e71f-6a8d-479b-ac09-37a053177a8e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:51.360404 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65e71f-6a8d-479b-ac09-37a053177a8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:51.362030 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db65e71f-6a8d-479b-ac09-37a053177a8e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:51.364244 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7edf78b-ded0-4b25-a8ff-cf079d593171 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:51.365662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7edf78b-ded0-4b25-a8ff-cf079d593171 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:51.366337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:51.380944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-a7edf78b-ded0-4b25-a8ff-cf079d593171 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:51.380944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:51.380944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:51.380944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:51.380944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:51.380944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:51.380944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:51.380944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:51.380944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:51.380944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:51.380944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:51.380944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:51.380944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:34:51.380944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:34:51.380944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:34:51.381898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:34:51.381898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:51.381898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:51.381898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:51.381898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:51.381898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:51.381898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:51.381898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:51.381898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:51.381898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:51.381898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:51.381898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:51.381898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:51.381898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:51.381898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:51.381898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:51.381898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:51.382803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:34:51.382803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:34:51.382803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:34:51.382803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:34:51.382803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:34:51.382803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:34:51.382803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:51.382803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:51.391066 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 317/628] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:51.391066 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edf78b-ded0-4b25-a8ff-cf079d593171 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:51.391570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 311/628] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Jul 19 20:34:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:51.392438 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65e71f-6a8d-479b-ac09-37a053177a8e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:51.500008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db65e71f-6a8d-479b-ac09-37a053177a8e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:51.531224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edf78b-ded0-4b25-a8ff-cf079d593171 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:51.541534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5c288-ab83-496b-8534-75dfed8fba38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:51.543013 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5c288-ab83-496b-8534-75dfed8fba38 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:51.543594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5c288-ab83-496b-8534-75dfed8fba38 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:51.544553 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5c288-ab83-496b-8534-75dfed8fba38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:51.574261 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd32a3-89f6-47c7-8743-074fab388462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:51.575442 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd32a3-89f6-47c7-8743-074fab388462 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:51.576098 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd32a3-89f6-47c7-8743-074fab388462 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:51.576561 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd32a3-89f6-47c7-8743-074fab388462 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:51.579442 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:51.592507 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd32a3-89f6-47c7-8743-074fab388462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:51.603671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-c4dd32a3-89f6-47c7-8743-074fab388462 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:51.603671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:51.603671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:51.603671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:51.603671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:51.603671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:51.603671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:51.603671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:51.603671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:51.603671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:51.603671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:51.603671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:51.603671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:51.603671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:51.603671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:51.603671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:51.604775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:51.604775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:51.604775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:51.604775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:51.604775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:51.604775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:51.604775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:51.604775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:51.604775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:51.604775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:51.604775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:51.604775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:51.604775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:51.604775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:51.604775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:51.604775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:51.605611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:51.605611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:51.605611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:51.605611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:51.605611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:51.605611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:51.605611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:51.605611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:51.605611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:51.605611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:51.605611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:51.605611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:51.608695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 318/629] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:34:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:51.609626 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd32a3-89f6-47c7-8743-074fab388462 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:51.620819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:51.631862 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5c288-ab83-496b-8534-75dfed8fba38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:51.634154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5c288-ab83-496b-8534-75dfed8fba38 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:51.724020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd32a3-89f6-47c7-8743-074fab388462 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:51.741308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 312/630] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:51.742152 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5c288-ab83-496b-8534-75dfed8fba38 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:51.768628 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345c809e-ab83-42be-ba74-d362011ab1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:51.769546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c809e-ab83-42be-ba74-d362011ab1ca None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:51.770267 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c809e-ab83-42be-ba74-d362011ab1ca None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:51.770554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345c809e-ab83-42be-ba74-d362011ab1ca None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:51.771566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c809e-ab83-42be-ba74-d362011ab1ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:51.772208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c809e-ab83-42be-ba74-d362011ab1ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:51.774092 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345c809e-ab83-42be-ba74-d362011ab1ca None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:51.788018 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 319/631] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:34:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:51.789732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7798944-2e73-4a4f-a482-a9ed2d74762a None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:51.790110 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7798944-2e73-4a4f-a482-a9ed2d74762a None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:51.790463 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7798944-2e73-4a4f-a482-a9ed2d74762a None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:51.791945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 320/632] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:51.796658 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7798944-2e73-4a4f-a482-a9ed2d74762a None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:51.852693 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:51.856204 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:51.861290 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5c288-ab83-496b-8534-75dfed8fba38 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:51.901763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61211a-9da3-471d-b025-1f267a6e1dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:51.902498 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61211a-9da3-471d-b025-1f267a6e1dc1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:51.902716 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61211a-9da3-471d-b025-1f267a6e1dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:51.902991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61211a-9da3-471d-b025-1f267a6e1dc1 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:51.903857 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61211a-9da3-471d-b025-1f267a6e1dc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:51.904108 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61211a-9da3-471d-b025-1f267a6e1dc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:51.905497 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db61211a-9da3-471d-b025-1f267a6e1dc1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:51.915076 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7798944-2e73-4a4f-a482-a9ed2d74762a None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:51.919394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 313/633] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jul 19 20:34:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:51.920402 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61211a-9da3-471d-b025-1f267a6e1dc1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:51.951370 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d11b5-b143-478b-bfa0-ba54b2bfcf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:51.952079 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d11b5-b143-478b-bfa0-ba54b2bfcf2d None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:51.952360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d11b5-b143-478b-bfa0-ba54b2bfcf2d None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:51.952630 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d11b5-b143-478b-bfa0-ba54b2bfcf2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:51.962784 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d11b5-b143-478b-bfa0-ba54b2bfcf2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:51.964250 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d11b5-b143-478b-bfa0-ba54b2bfcf2d None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:51.982202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-6d0d11b5-b143-478b-bfa0-ba54b2bfcf2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:51.982202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:51.982202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:51.982202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:51.982202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:51.982202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:51.982202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:51.982202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:51.982202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:51.982202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:51.982202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:51.982202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:51.982202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:51.982202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:51.982202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:51.983097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:51.983097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:51.983097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:51.983097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:51.983097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:51.983097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:51.983097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:51.983097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:51.983097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:51.983097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:51.983097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:51.983097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:51.983097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:51.983097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:51.983097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:51.983097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:51.983097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:51.984036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:51.984036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:51.984036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:51.984036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:51.987933 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 321/634] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:51.989135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef655d-5dc8-4d03-84be-a2b8cfd79e96 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:51.989420 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef655d-5dc8-4d03-84be-a2b8cfd79e96 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:51.989695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef655d-5dc8-4d03-84be-a2b8cfd79e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:52.006264 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-0cef655d-5dc8-4d03-84be-a2b8cfd79e96 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:52.007493 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-0cef655d-5dc8-4d03-84be-a2b8cfd79e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:52.030183 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61211a-9da3-471d-b025-1f267a6e1dc1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:52.068181 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237be1c-69be-4479-b2de-0a4afe55532a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:52.069079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237be1c-69be-4479-b2de-0a4afe55532a None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:52.069356 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237be1c-69be-4479-b2de-0a4afe55532a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:52.069688 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237be1c-69be-4479-b2de-0a4afe55532a None admin] PATH_INFO: `/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/7987846276ad4ccd90899128ceb1354e/roles/e5e7de76725748df9add27e3c837d8ef` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:52.078681 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 322/635] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:52.080169 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef655d-5dc8-4d03-84be-a2b8cfd79e96 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:52.089386 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237be1c-69be-4479-b2de-0a4afe55532a None admin] RBAC: Authorizing `identity:create_grant(project_id=327868f4f62e4e4a9c5bef4acd32fb29, user_id=7987846276ad4ccd90899128ceb1354e, role_id=e5e7de76725748df9add27e3c837d8ef)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:52.091151 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237be1c-69be-4479-b2de-0a4afe55532a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:52.104887 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 314/636] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:34:51 2022] PUT /identity/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/7987846276ad4ccd90899128ceb1354e/roles/e5e7de76725748df9add27e3c837d8ef => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:34:52.105694 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237be1c-69be-4479-b2de-0a4afe55532a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:52.118906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:52.121319 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:52.198866 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef655d-5dc8-4d03-84be-a2b8cfd79e96 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:52.234827 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237be1c-69be-4479-b2de-0a4afe55532a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:52.237680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22851199-5d9a-4d9c-b61a-b964f5c06b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:52.239025 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22851199-5d9a-4d9c-b61a-b964f5c06b10 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:52.239329 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22851199-5d9a-4d9c-b61a-b964f5c06b10 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:52.239602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22851199-5d9a-4d9c-b61a-b964f5c06b10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:52.250964 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22851199-5d9a-4d9c-b61a-b964f5c06b10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:52.252463 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22851199-5d9a-4d9c-b61a-b964f5c06b10 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:52.274535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-22851199-5d9a-4d9c-b61a-b964f5c06b10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:52.274535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:52.274535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:52.274535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:52.274535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:52.274535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:52.274535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:52.274535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:52.274535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:52.274535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:52.274535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:52.274535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:52.274535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:52.274535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:52.274535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:52.275544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:52.275544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:52.275544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:52.275544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:52.275544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:52.275544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:52.275544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:52.275544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:52.275544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:52.275544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:52.275544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:52.275544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:52.275544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:52.275544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:52.275544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:52.275544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:52.275544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:52.276641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:52.276641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:52.276641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:52.276641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:52.276641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 323/637] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:52.278098 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294262a-9459-451d-9fd3-999b91f64b82 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:52.278446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294262a-9459-451d-9fd3-999b91f64b82 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:52.278787 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294262a-9459-451d-9fd3-999b91f64b82 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:52.280251 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d4582-90a5-44af-9f46-bd64e758aec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:52.280504 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 324/638] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:52.281205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294262a-9459-451d-9fd3-999b91f64b82 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:52.281693 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d4582-90a5-44af-9f46-bd64e758aec5 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:52.282178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d4582-90a5-44af-9f46-bd64e758aec5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:52.282548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d4582-90a5-44af-9f46-bd64e758aec5 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:52.283460 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d4582-90a5-44af-9f46-bd64e758aec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:52.283893 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d4582-90a5-44af-9f46-bd64e758aec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:52.285633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d4582-90a5-44af-9f46-bd64e758aec5 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:52.298141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 315/639] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:52.299334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d4582-90a5-44af-9f46-bd64e758aec5 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:52.370964 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:52.391551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:52.406064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294262a-9459-451d-9fd3-999b91f64b82 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:52.407673 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d4582-90a5-44af-9f46-bd64e758aec5 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:52.443929 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d97281-0c27-4fdb-8b6b-acd0d1758783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:52.444514 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376e458-5621-423b-a85d-7fd7669e1a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:52.444641 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d97281-0c27-4fdb-8b6b-acd0d1758783 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:52.444860 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d97281-0c27-4fdb-8b6b-acd0d1758783 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:52.445129 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d97281-0c27-4fdb-8b6b-acd0d1758783 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:52.445660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376e458-5621-423b-a85d-7fd7669e1a70 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:52.445842 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d97281-0c27-4fdb-8b6b-acd0d1758783 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:52.446121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376e458-5621-423b-a85d-7fd7669e1a70 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:52.446219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d97281-0c27-4fdb-8b6b-acd0d1758783 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:52.446566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376e458-5621-423b-a85d-7fd7669e1a70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:52.447496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d97281-0c27-4fdb-8b6b-acd0d1758783 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:52.457506 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376e458-5621-423b-a85d-7fd7669e1a70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:52.464226 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 316/640] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:52.464226 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc85c89-6c85-4823-8055-65e3bae39fe0 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:52.464226 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc85c89-6c85-4823-8055-65e3bae39fe0 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:52.464226 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc85c89-6c85-4823-8055-65e3bae39fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:52.466213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-0376e458-5621-423b-a85d-7fd7669e1a70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:52.466213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:52.466213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:52.466213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:52.466213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:52.466213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:52.466213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:52.466213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:52.466213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:52.466213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:52.466213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:52.466213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:52.466213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:52.466213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:52.466213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:52.466213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:52.467338 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:52.467338 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:52.467338 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:52.467338 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:52.467338 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:52.467338 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:52.467338 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:52.467338 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:52.467338 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:52.467338 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:52.467338 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:52.467338 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:52.467338 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:52.467338 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:52.467338 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:52.467338 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:52.468408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:52.468408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:52.468408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:52.468408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:52.468408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:52.468408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:52.468408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:52.468408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:52.468408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:52.468408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:52.468408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:52.468408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:52.469662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 325/641] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:34:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:52.470563 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376e458-5621-423b-a85d-7fd7669e1a70 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:52.482275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-ccc85c89-6c85-4823-8055-65e3bae39fe0 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:52.483559 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ccc85c89-6c85-4823-8055-65e3bae39fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:52.556862 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 317/642] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:52.557919 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc85c89-6c85-4823-8055-65e3bae39fe0 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:52.593072 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376e458-5621-423b-a85d-7fd7669e1a70 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:52.629356 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1372c-9362-49e2-a6c1-3e1f550911fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:52.630157 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1372c-9362-49e2-a6c1-3e1f550911fe None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:52.630432 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1372c-9362-49e2-a6c1-3e1f550911fe None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:52.630814 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1372c-9362-49e2-a6c1-3e1f550911fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:52.631381 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:52.638892 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1372c-9362-49e2-a6c1-3e1f550911fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:52.640486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1372c-9362-49e2-a6c1-3e1f550911fe None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:52.655497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-29e1372c-9362-49e2-a6c1-3e1f550911fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:52.655497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:52.655497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:52.655497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:52.655497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:52.655497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:52.655497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:52.655497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:52.655497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:52.655497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:52.655497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:52.655497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:52.655497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:34:52.655497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:34:52.655497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:34:52.656516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:34:52.656516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:52.656516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:52.656516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:52.656516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:52.656516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:52.656516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:52.656516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:52.656516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:52.656516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:52.656516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:52.656516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:52.656516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:52.656516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:52.656516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:52.656516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:52.656516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:52.657422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:34:52.657422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:34:52.657422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:34:52.657422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:34:52.657422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:34:52.657422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:34:52.657422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:52.657422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:52.662137 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 326/643] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:52.662959 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1372c-9362-49e2-a6c1-3e1f550911fe None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:52.673410 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:52.684044 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc85c89-6c85-4823-8055-65e3bae39fe0 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:52.737329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5ffa9-55d4-4b5c-9c2e-76f45c56a0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:52.738143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5ffa9-55d4-4b5c-9c2e-76f45c56a0f5 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:52.738451 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5ffa9-55d4-4b5c-9c2e-76f45c56a0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:52.739279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5ffa9-55d4-4b5c-9c2e-76f45c56a0f5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:52.749922 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5ffa9-55d4-4b5c-9c2e-76f45c56a0f5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:52.752257 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5ffa9-55d4-4b5c-9c2e-76f45c56a0f5 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:52.768527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-e5c5ffa9-55d4-4b5c-9c2e-76f45c56a0f5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 20:34:52.768527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:52.768527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:52.768527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:52.768527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:52.768527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:52.768527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:52.768527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:52.768527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:52.768527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:52.768527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:52.768527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:52.768527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:34:52.768527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:34:52.768527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:34:52.768527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:34:52.769486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:52.769486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:52.769486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:34:52.769486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:52.769486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:34:52.769486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:52.769486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:52.769486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:52.769486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:52.769486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:52.769486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:52.769486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:52.769486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:52.769486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:52.769486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:52.769486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:52.769486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:52.769486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:52.771048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:52.771048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:52.771048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:34:52.771048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:34:52.771048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:34:52.771048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:34:52.771048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:34:52.771048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:34:52.771048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 20:34:52.771048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:52.771048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 318/644] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:52.772136 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5ffa9-55d4-4b5c-9c2e-76f45c56a0f5 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:52.783564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1372c-9362-49e2-a6c1-3e1f550911fe None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:52.818891 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e1eec-9f70-4ad0-bb52-4505f91a31e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:52.819522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e1eec-9f70-4ad0-bb52-4505f91a31e4 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:52.819805 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e1eec-9f70-4ad0-bb52-4505f91a31e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:52.820109 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e1eec-9f70-4ad0-bb52-4505f91a31e4 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:52.820829 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e1eec-9f70-4ad0-bb52-4505f91a31e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:52.821171 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e1eec-9f70-4ad0-bb52-4505f91a31e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:52.822504 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e1eec-9f70-4ad0-bb52-4505f91a31e4 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:52.835289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 327/645] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jul 19 20:34:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:52.835289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e1eec-9f70-4ad0-bb52-4505f91a31e4 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:52.888045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5ffa9-55d4-4b5c-9c2e-76f45c56a0f5 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:52.908297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:52.911590 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:52.931861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbfc26-87c7-4527-85cc-5faf447dd09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:52.932662 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbfc26-87c7-4527-85cc-5faf447dd09b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:52.932947 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbfc26-87c7-4527-85cc-5faf447dd09b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:52.933222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbfc26-87c7-4527-85cc-5faf447dd09b None admin] PATH_INFO: `/v3/roles/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:52.943124 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e1eec-9f70-4ad0-bb52-4505f91a31e4 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:52.943882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbfc26-87c7-4527-85cc-5faf447dd09b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:52.951795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-52dbfc26-87c7-4527-85cc-5faf447dd09b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:52.951795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:52.951795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:52.951795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:52.951795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:52.951795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:52.951795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:52.951795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:52.951795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:52.951795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:52.951795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:52.951795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:52.951795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:52.951795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:52.951795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:52.951795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:52.952910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:52.952910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:52.952910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:52.952910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:52.952910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:52.952910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:52.952910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:52.952910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:52.952910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:52.952910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:52.952910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:52.952910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:52.952910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:52.952910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:52.952910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:52.952910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:52.953764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:52.953764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:52.953764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:52.953764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:52.953764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:52.953764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:52.953764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:52.953764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:52.953764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:52.953764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:52.953764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:52.953764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:52.953764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 319/646] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:34:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:52.953764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbfc26-87c7-4527-85cc-5faf447dd09b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:52.982513 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be495243-b67c-492b-9e3c-74f107857ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:52.983724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be495243-b67c-492b-9e3c-74f107857ba2 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:52.984160 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be495243-b67c-492b-9e3c-74f107857ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:52.984434 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be495243-b67c-492b-9e3c-74f107857ba2 None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:52.985221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be495243-b67c-492b-9e3c-74f107857ba2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:52.985530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be495243-b67c-492b-9e3c-74f107857ba2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:52.986947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be495243-b67c-492b-9e3c-74f107857ba2 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:52.999335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 328/647] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:34:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:53.000114 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be495243-b67c-492b-9e3c-74f107857ba2 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:53.067194 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbfc26-87c7-4527-85cc-5faf447dd09b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:53.105906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1fd49-9280-4c0c-9174-f3dfa1f82714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:53.106492 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1fd49-9280-4c0c-9174-f3dfa1f82714 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:53.106770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1fd49-9280-4c0c-9174-f3dfa1f82714 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:53.107041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1fd49-9280-4c0c-9174-f3dfa1f82714 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:53.107912 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1fd49-9280-4c0c-9174-f3dfa1f82714 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:53.108107 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be495243-b67c-492b-9e3c-74f107857ba2 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:53.108217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1fd49-9280-4c0c-9174-f3dfa1f82714 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:53.109609 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1fd49-9280-4c0c-9174-f3dfa1f82714 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:53.136156 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 320/648] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Jul 19 20:34:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:53.136156 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1fd49-9280-4c0c-9174-f3dfa1f82714 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:53.147141 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:53.154292 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bfd8e-06d8-496d-ab18-ac71ab808d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:53.155305 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bfd8e-06d8-496d-ab18-ac71ab808d15 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:53.155745 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bfd8e-06d8-496d-ab18-ac71ab808d15 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:53.156024 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bfd8e-06d8-496d-ab18-ac71ab808d15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:53.166598 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4bfd8e-06d8-496d-ab18-ac71ab808d15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:53.168067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4bfd8e-06d8-496d-ab18-ac71ab808d15 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:53.171246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:53.186945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-1e4bfd8e-06d8-496d-ab18-ac71ab808d15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:53.186945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:53.186945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:53.186945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:53.186945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:53.186945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:53.186945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:53.186945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:53.186945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:53.186945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:53.186945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:53.186945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:53.186945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:53.186945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:53.186945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:53.187934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:53.187934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:53.187934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:53.187934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:53.187934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:53.187934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:53.187934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:53.187934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:53.187934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:53.187934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:53.187934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:53.187934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:53.187934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:53.187934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:53.187934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:53.187934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:53.187934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:53.188825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:53.188825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:53.188825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:53.188825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:53.188825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 329/649] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:53.189119 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bfd8e-06d8-496d-ab18-ac71ab808d15 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:53.243109 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1fd49-9280-4c0c-9174-f3dfa1f82714 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:53.281537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309ba72-d5ca-4d13-aa53-90935a95fa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:53.282202 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309ba72-d5ca-4d13-aa53-90935a95fa70 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:53.282528 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309ba72-d5ca-4d13-aa53-90935a95fa70 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:53.282803 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309ba72-d5ca-4d13-aa53-90935a95fa70 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:53.283583 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309ba72-d5ca-4d13-aa53-90935a95fa70 None admin] RBAC: Adding query filter params (name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:53.283883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309ba72-d5ca-4d13-aa53-90935a95fa70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:53.285565 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0309ba72-d5ca-4d13-aa53-90935a95fa70 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:53.298269 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 321/650] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jul 19 20:34:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:53.299111 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309ba72-d5ca-4d13-aa53-90935a95fa70 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:53.302227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bfd8e-06d8-496d-ab18-ac71ab808d15 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:53.339634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d894d81-7c2c-49a5-9584-413bbe5d9fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:53.340293 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d894d81-7c2c-49a5-9584-413bbe5d9fc3 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:53.340573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d894d81-7c2c-49a5-9584-413bbe5d9fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:53.340850 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d894d81-7c2c-49a5-9584-413bbe5d9fc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:53.341677 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d894d81-7c2c-49a5-9584-413bbe5d9fc3 None admin] RBAC: Adding query filter params (role.id=e5e7de76725748df9add27e3c837d8ef, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=6dbbb8f7b3f2449fb9c64ca3815b6c1b) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:53.341987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d894d81-7c2c-49a5-9584-413bbe5d9fc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:53.343566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d894d81-7c2c-49a5-9584-413bbe5d9fc3 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:53.349397 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 330/651] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:34:53 2022] GET /identity/v3/role_assignments?user.id=6dbbb8f7b3f2449fb9c64ca3815b6c1b&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=e5e7de76725748df9add27e3c837d8ef => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:53.359637 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d894d81-7c2c-49a5-9584-413bbe5d9fc3 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:53.421066 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:53.429361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:53.439610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0309ba72-d5ca-4d13-aa53-90935a95fa70 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:53.481998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4527f-b724-4378-bcc8-f9c2705f1828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:53.482963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4527f-b724-4378-bcc8-f9c2705f1828 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:53.483462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4527f-b724-4378-bcc8-f9c2705f1828 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:53.484552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4527f-b724-4378-bcc8-f9c2705f1828 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:53.499706 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d894d81-7c2c-49a5-9584-413bbe5d9fc3 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:53.545190 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47f12f-ac7a-4c59-8881-379ddad21ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:53.546218 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47f12f-ac7a-4c59-8881-379ddad21ffb None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:53.546592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47f12f-ac7a-4c59-8881-379ddad21ffb None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:53.547006 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47f12f-ac7a-4c59-8881-379ddad21ffb None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:53.548032 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47f12f-ac7a-4c59-8881-379ddad21ffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:53.548449 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47f12f-ac7a-4c59-8881-379ddad21ffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:53.549905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47f12f-ac7a-4c59-8881-379ddad21ffb None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:53.564550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 331/652] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:53.565978 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47f12f-ac7a-4c59-8881-379ddad21ffb None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:53.586136 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4527f-b724-4378-bcc8-f9c2705f1828 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:53.588463 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4527f-b724-4378-bcc8-f9c2705f1828 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:53.696608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:53.698962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47f12f-ac7a-4c59-8881-379ddad21ffb None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:53.709641 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 322/653] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:53.710072 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:53.710479 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4527f-b724-4378-bcc8-f9c2705f1828 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:53.748928 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60591c18-e938-4577-bd4e-4b87f8b7ef48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:53.751046 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60591c18-e938-4577-bd4e-4b87f8b7ef48 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:53.751574 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60591c18-e938-4577-bd4e-4b87f8b7ef48 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:53.752140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60591c18-e938-4577-bd4e-4b87f8b7ef48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:53.766154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60591c18-e938-4577-bd4e-4b87f8b7ef48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:53.769104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60591c18-e938-4577-bd4e-4b87f8b7ef48 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:53.795224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-60591c18-e938-4577-bd4e-4b87f8b7ef48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:53.795224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:53.795224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:53.795224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:53.795224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:53.795224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:53.795224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:53.795224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:53.795224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:53.795224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:53.795224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:53.795224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:53.795224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:53.795224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:53.795224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:53.796189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:53.796189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:53.796189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:53.796189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:53.796189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:53.796189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:53.796189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:53.796189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:53.796189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:53.796189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:53.796189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:53.796189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:53.796189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:53.796189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:53.796189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:53.796189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:53.796189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:53.797182 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:53.797182 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:53.797182 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:53.797182 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:53.800101 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 332/654] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:53.802333 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60591c18-e938-4577-bd4e-4b87f8b7ef48 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:53.830114 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4527f-b724-4378-bcc8-f9c2705f1828 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:53.873552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110974f0-ea9f-4e46-94ee-f86c4e8481a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:53.874964 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110974f0-ea9f-4e46-94ee-f86c4e8481a1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:53.875243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110974f0-ea9f-4e46-94ee-f86c4e8481a1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:53.875541 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110974f0-ea9f-4e46-94ee-f86c4e8481a1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:53.887946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110974f0-ea9f-4e46-94ee-f86c4e8481a1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:53.889479 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110974f0-ea9f-4e46-94ee-f86c4e8481a1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:53.912800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-110974f0-ea9f-4e46-94ee-f86c4e8481a1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 19 20:34:53.912800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:53.912800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:53.912800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:53.912800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:53.912800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:53.912800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:53.912800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:53.912800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:53.912800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:53.912800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:53.912800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:53.912800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:34:53.912800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:34:53.912800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:34:53.912800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:34:53.914247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:53.914247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:53.914247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:34:53.914247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:53.914247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:34:53.914247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:53.914247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:53.914247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:53.914247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:53.914247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:53.914247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:53.914247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:53.914247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:53.914247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:53.914247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:53.914247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:53.914247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:53.914247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:53.915794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:53.915794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:53.915794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:34:53.915794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:34:53.915794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:34:53.915794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:34:53.915794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:34:53.915794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:34:53.915794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 19 20:34:53.915794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:53.915794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 323/655] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:53.915794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110974f0-ea9f-4e46-94ee-f86c4e8481a1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:53.954522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60591c18-e938-4577-bd4e-4b87f8b7ef48 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:53.991487 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f796097-4365-44b9-9e82-6522435c7cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:53.992592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f796097-4365-44b9-9e82-6522435c7cf2 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:53.992803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f796097-4365-44b9-9e82-6522435c7cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:53.993180 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f796097-4365-44b9-9e82-6522435c7cf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:53.994270 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:54.003957 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f796097-4365-44b9-9e82-6522435c7cf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:54.006031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f796097-4365-44b9-9e82-6522435c7cf2 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:54.031602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-3f796097-4365-44b9-9e82-6522435c7cf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:54.031602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:54.031602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:54.031602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:54.031602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:54.031602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:54.031602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:54.031602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:54.031602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:54.031602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:54.031602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:54.031602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:54.031602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:54.031602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:54.031602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:54.032742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:54.032742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:54.032742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:54.032742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:54.032742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:54.032742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:54.032742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:54.032742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:54.032742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:54.032742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:54.032742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:54.032742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:54.032742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:54.032742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:54.032742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:54.032742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:54.032742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:54.034109 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:54.034109 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:54.034109 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:54.034109 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:54.037265 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 333/656] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:54.038984 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f796097-4365-44b9-9e82-6522435c7cf2 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:54.051509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110974f0-ea9f-4e46-94ee-f86c4e8481a1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:54.083676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:54.088197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c08a3f-9c55-41dc-b31a-96f097b37627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:54.088967 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c08a3f-9c55-41dc-b31a-96f097b37627 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:54.089352 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c08a3f-9c55-41dc-b31a-96f097b37627 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:54.089731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c08a3f-9c55-41dc-b31a-96f097b37627 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:54.090550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c08a3f-9c55-41dc-b31a-96f097b37627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:54.090974 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c08a3f-9c55-41dc-b31a-96f097b37627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:54.092470 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c08a3f-9c55-41dc-b31a-96f097b37627 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:54.106048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 324/657] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:54.107414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c08a3f-9c55-41dc-b31a-96f097b37627 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:54.173237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f796097-4365-44b9-9e82-6522435c7cf2 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:54.222221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23996342-f9e0-45ef-81a8-bccfa578e591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:54.224712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23996342-f9e0-45ef-81a8-bccfa578e591 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:54.225785 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23996342-f9e0-45ef-81a8-bccfa578e591 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:54.226528 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23996342-f9e0-45ef-81a8-bccfa578e591 None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:54.228650 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23996342-f9e0-45ef-81a8-bccfa578e591 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:54.229170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23996342-f9e0-45ef-81a8-bccfa578e591 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:54.232099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23996342-f9e0-45ef-81a8-bccfa578e591 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:54.261170 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c08a3f-9c55-41dc-b31a-96f097b37627 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:54.261395 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 334/658] 10.222.0.77 () {56 vars in 1137 bytes} [Tue Jul 19 20:34:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:54.266289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23996342-f9e0-45ef-81a8-bccfa578e591 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:54.283167 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:54.302123 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a00fc-f49e-4b05-9c4f-e5909b931886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:54.302780 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a00fc-f49e-4b05-9c4f-e5909b931886 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:54.303062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a00fc-f49e-4b05-9c4f-e5909b931886 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:54.303362 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a00fc-f49e-4b05-9c4f-e5909b931886 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:54.304078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a00fc-f49e-4b05-9c4f-e5909b931886 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:54.304387 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a00fc-f49e-4b05-9c4f-e5909b931886 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:54.305747 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a00fc-f49e-4b05-9c4f-e5909b931886 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:54.323800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 325/659] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:54.323800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007cc57-33d8-4c9f-aa02-1e4baee194e1 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:54.323800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007cc57-33d8-4c9f-aa02-1e4baee194e1 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:54.323800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007cc57-33d8-4c9f-aa02-1e4baee194e1 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:54.323800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 326/660] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:54.323800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007cc57-33d8-4c9f-aa02-1e4baee194e1 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:54.349707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:54.386376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23996342-f9e0-45ef-81a8-bccfa578e591 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:54.429095 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbe397-113b-4dd2-899e-a5e08c20feff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:54.430158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbe397-113b-4dd2-899e-a5e08c20feff None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:54.430439 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbe397-113b-4dd2-899e-a5e08c20feff None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:54.430711 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbe397-113b-4dd2-899e-a5e08c20feff None admin] PATH_INFO: `/v3/users/neutron` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:54.432592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007cc57-33d8-4c9f-aa02-1e4baee194e1 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:54.438410 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dbe397-113b-4dd2-899e-a5e08c20feff None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:54.439890 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dbe397-113b-4dd2-899e-a5e08c20feff None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:54.456651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-55dbe397-113b-4dd2-899e-a5e08c20feff None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 20:34:54.456651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:54.456651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:54.456651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:54.456651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:54.456651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:54.456651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:54.456651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:54.456651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:54.456651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:54.456651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:54.456651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:54.456651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:34:54.456651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:34:54.456651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:34:54.456651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:34:54.457947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:54.457947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:54.457947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:34:54.457947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:54.457947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:34:54.457947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:54.457947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:54.457947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:54.457947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:54.457947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:54.457947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:54.457947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:54.457947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:54.457947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:54.457947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:54.457947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:54.457947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:54.457947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:54.459111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:54.459111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:54.459111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:34:54.459111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:34:54.459111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:34:54.459111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:34:54.459111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:34:54.459111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:34:54.459111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 20:34:54.459111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:54.462740 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 335/661] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:34:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:54.463551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbe397-113b-4dd2-899e-a5e08c20feff None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:54.473654 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9d7b1-f218-479d-a429-973c9472164f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:54.474550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9d7b1-f218-479d-a429-973c9472164f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:54.474811 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9d7b1-f218-479d-a429-973c9472164f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:54.475150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9d7b1-f218-479d-a429-973c9472164f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:54.526802 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:54.553549 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9d7b1-f218-479d-a429-973c9472164f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:54.555135 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9d7b1-f218-479d-a429-973c9472164f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:54.568589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbe397-113b-4dd2-899e-a5e08c20feff None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:54.596162 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:54.605674 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de22c9-3e42-4af9-8cf2-80a6a863db4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:54.606488 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de22c9-3e42-4af9-8cf2-80a6a863db4b None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:54.606775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de22c9-3e42-4af9-8cf2-80a6a863db4b None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:54.607050 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de22c9-3e42-4af9-8cf2-80a6a863db4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:54.615306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de22c9-3e42-4af9-8cf2-80a6a863db4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:54.616861 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de22c9-3e42-4af9-8cf2-80a6a863db4b None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:54.632350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-d5de22c9-3e42-4af9-8cf2-80a6a863db4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:54.632350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:54.632350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:54.632350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:54.632350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:54.632350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:54.632350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:54.632350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:54.632350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:54.632350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:54.632350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:54.632350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:54.632350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:34:54.632350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:34:54.632350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:34:54.633505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:34:54.633505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:54.633505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:54.633505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:54.633505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:54.633505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:54.633505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:54.633505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:54.633505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:54.633505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:54.633505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:54.633505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:54.633505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:54.633505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:54.633505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:54.633505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:54.633505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:54.634764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:34:54.634764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:34:54.634764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:34:54.634764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:34:54.634764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:34:54.634764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:34:54.634764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:54.634764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:54.634764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 336/662] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:54.635306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92a6bc-fdce-409c-b995-aa0bcec36162 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:54.635533 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92a6bc-fdce-409c-b995-aa0bcec36162 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:54.635710 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92a6bc-fdce-409c-b995-aa0bcec36162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:54.654377 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-ee92a6bc-fdce-409c-b995-aa0bcec36162 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:54.655610 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-ee92a6bc-fdce-409c-b995-aa0bcec36162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:54.674640 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 327/663] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:54.679942 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9d7b1-f218-479d-a429-973c9472164f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:54.729377 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 337/664] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:54.736427 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92a6bc-fdce-409c-b995-aa0bcec36162 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:54.759779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:54.784300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9d7b1-f218-479d-a429-973c9472164f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:54.821935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dbdc2-46fc-47a8-a78a-245adf2a678b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:54.822722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dbdc2-46fc-47a8-a78a-245adf2a678b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:54.823003 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dbdc2-46fc-47a8-a78a-245adf2a678b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:54.823302 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dbdc2-46fc-47a8-a78a-245adf2a678b None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:54.824253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8dbdc2-46fc-47a8-a78a-245adf2a678b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:54.824565 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8dbdc2-46fc-47a8-a78a-245adf2a678b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:54.825975 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8dbdc2-46fc-47a8-a78a-245adf2a678b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:54.848781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 328/665] 10.222.0.77 () {56 vars in 1139 bytes} [Tue Jul 19 20:34:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:54.848781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dbdc2-46fc-47a8-a78a-245adf2a678b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:54.849064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92a6bc-fdce-409c-b995-aa0bcec36162 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:54.867089 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:54.887447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd7b4b-8bd6-4aee-9ff9-126c23c32106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:54.888192 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd7b4b-8bd6-4aee-9ff9-126c23c32106 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:54.888505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd7b4b-8bd6-4aee-9ff9-126c23c32106 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:54.888821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd7b4b-8bd6-4aee-9ff9-126c23c32106 None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:54.889690 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd7b4b-8bd6-4aee-9ff9-126c23c32106 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:54.890001 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd7b4b-8bd6-4aee-9ff9-126c23c32106 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:54.891458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd7b4b-8bd6-4aee-9ff9-126c23c32106 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:54.905326 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 338/666] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:34:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:54.906190 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd7b4b-8bd6-4aee-9ff9-126c23c32106 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:54.962873 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dbdc2-46fc-47a8-a78a-245adf2a678b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:54.999482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08690eb1-148f-43f8-8543-6fad653392bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:55.000206 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08690eb1-148f-43f8-8543-6fad653392bb None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:55.000488 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08690eb1-148f-43f8-8543-6fad653392bb None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:55.000773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08690eb1-148f-43f8-8543-6fad653392bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:55.002683 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:55.012593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08690eb1-148f-43f8-8543-6fad653392bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:55.014030 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08690eb1-148f-43f8-8543-6fad653392bb None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:55.016912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd7b4b-8bd6-4aee-9ff9-126c23c32106 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:55.032484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-08690eb1-148f-43f8-8543-6fad653392bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:55.032484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:55.032484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:55.032484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:55.032484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:55.032484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:55.032484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:55.032484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:55.032484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:55.032484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:55.032484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:55.032484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:55.032484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:55.032484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:55.032484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:55.033391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:55.033391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:55.033391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:55.033391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:55.033391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:55.033391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:55.033391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:55.033391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:55.033391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:55.033391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:55.033391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:55.033391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:55.033391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:55.033391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:55.033391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:55.033391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:55.033391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:55.034309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:55.034309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:55.034309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:55.034309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:55.034309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 329/667] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:55.035623 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08690eb1-148f-43f8-8543-6fad653392bb None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:55.059840 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160a413-4816-40f3-9930-9e86fe216ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:55.060644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160a413-4816-40f3-9930-9e86fe216ba7 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:55.060931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160a413-4816-40f3-9930-9e86fe216ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:55.061211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160a413-4816-40f3-9930-9e86fe216ba7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:55.073733 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5160a413-4816-40f3-9930-9e86fe216ba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:55.081823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-5160a413-4816-40f3-9930-9e86fe216ba7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:55.081823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:55.081823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:55.081823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:55.081823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:55.081823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:55.081823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:55.081823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:55.081823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:55.081823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:55.081823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:55.081823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:55.081823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:55.081823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:55.081823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:55.081823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:55.083368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:55.083368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:55.083368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:55.083368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:55.083368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:55.083368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:55.083368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:55.083368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:55.083368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:55.083368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:55.083368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:55.083368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:55.083368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:55.083368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:55.083368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:55.083368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:55.084248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:55.084248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:55.084248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:55.084248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:55.084248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:55.084248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:55.084248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:55.084248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:55.084248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:55.084248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:55.084248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:34:55.084248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:55.084248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 339/668] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:34:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:55.084945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160a413-4816-40f3-9930-9e86fe216ba7 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:55.130275 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:55.150177 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08690eb1-148f-43f8-8543-6fad653392bb None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:55.187026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a5411-f547-4ad6-a5f7-b922f8194ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:55.187834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a5411-f547-4ad6-a5f7-b922f8194ea8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:55.188117 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a5411-f547-4ad6-a5f7-b922f8194ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:55.188439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a5411-f547-4ad6-a5f7-b922f8194ea8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:55.199176 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160a413-4816-40f3-9930-9e86fe216ba7 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:55.238016 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f4db6-3261-4c3f-91f8-7d1e76677edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:55.239191 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f4db6-3261-4c3f-91f8-7d1e76677edf None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:55.239506 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f4db6-3261-4c3f-91f8-7d1e76677edf None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:55.239788 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f4db6-3261-4c3f-91f8-7d1e76677edf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:55.240627 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f4db6-3261-4c3f-91f8-7d1e76677edf None admin] RBAC: Adding query filter params (role.id=e5e7de76725748df9add27e3c837d8ef, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=1ab64f417fe74fc585f32691aa7fb515) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:55.240941 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f4db6-3261-4c3f-91f8-7d1e76677edf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:55.242378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f4db6-3261-4c3f-91f8-7d1e76677edf None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:55.248479 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 340/669] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:34:55 2022] GET /identity/v3/role_assignments?user.id=1ab64f417fe74fc585f32691aa7fb515&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=e5e7de76725748df9add27e3c837d8ef => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:55.248939 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:55.249271 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f4db6-3261-4c3f-91f8-7d1e76677edf None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:55.280219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a5411-f547-4ad6-a5f7-b922f8194ea8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:55.281627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a5411-f547-4ad6-a5f7-b922f8194ea8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:55.376903 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f4db6-3261-4c3f-91f8-7d1e76677edf None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:55.378550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:55.427069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005761cf-6a6e-4037-ae70-d64e7a7e6fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:55.427840 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 330/670] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:55.428390 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005761cf-6a6e-4037-ae70-d64e7a7e6fbe None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:55.428858 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005761cf-6a6e-4037-ae70-d64e7a7e6fbe None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:55.429026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a5411-f547-4ad6-a5f7-b922f8194ea8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:55.429522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005761cf-6a6e-4037-ae70-d64e7a7e6fbe None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:55.430524 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005761cf-6a6e-4037-ae70-d64e7a7e6fbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:55.431037 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005761cf-6a6e-4037-ae70-d64e7a7e6fbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:55.433356 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005761cf-6a6e-4037-ae70-d64e7a7e6fbe None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:55.459944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 341/671] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:55.461282 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005761cf-6a6e-4037-ae70-d64e7a7e6fbe None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:55.529327 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:55.549443 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a5411-f547-4ad6-a5f7-b922f8194ea8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:55.587515 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed070dd5-1873-42ca-817b-439dfbf07ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:55.587725 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005761cf-6a6e-4037-ae70-d64e7a7e6fbe None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:55.588573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed070dd5-1873-42ca-817b-439dfbf07ada None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:55.589043 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed070dd5-1873-42ca-817b-439dfbf07ada None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:55.589331 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed070dd5-1873-42ca-817b-439dfbf07ada None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:55.590649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed070dd5-1873-42ca-817b-439dfbf07ada None admin] RBAC: Adding query filter params (name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:55.590649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed070dd5-1873-42ca-817b-439dfbf07ada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:55.591770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed070dd5-1873-42ca-817b-439dfbf07ada None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:55.603553 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 331/672] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jul 19 20:34:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:55.603553 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed070dd5-1873-42ca-817b-439dfbf07ada None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:55.629706 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79953fce-cef0-4400-ba76-21eeb2aea536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:55.630645 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79953fce-cef0-4400-ba76-21eeb2aea536 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:55.630954 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79953fce-cef0-4400-ba76-21eeb2aea536 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:55.631208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79953fce-cef0-4400-ba76-21eeb2aea536 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:55.642537 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79953fce-cef0-4400-ba76-21eeb2aea536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:55.644013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79953fce-cef0-4400-ba76-21eeb2aea536 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:55.663205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-79953fce-cef0-4400-ba76-21eeb2aea536 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:55.663205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:55.663205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:55.663205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:55.663205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:55.663205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:55.663205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:55.663205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:55.663205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:55.663205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:55.663205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:55.663205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:55.663205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:55.663205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:55.663205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:55.664205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:55.664205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:55.664205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:55.664205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:55.664205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:55.664205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:55.664205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:55.664205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:55.664205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:55.664205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:55.664205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:55.664205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:55.664205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:55.664205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:55.664205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:55.664205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:55.664205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:55.665237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:55.665237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:55.665237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:55.665237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:55.668873 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 342/673] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:55.670107 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beb095-a93c-4624-a3c1-beed7ac880f5 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:55.670393 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beb095-a93c-4624-a3c1-beed7ac880f5 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:55.670674 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beb095-a93c-4624-a3c1-beed7ac880f5 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:55.672111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 343/674] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:55.676630 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89beb095-a93c-4624-a3c1-beed7ac880f5 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:55.692735 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:55.715627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed070dd5-1873-42ca-817b-439dfbf07ada None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:55.751199 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2e1dd-67e6-4b42-bac8-e5d9dcc602ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:55.752054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2e1dd-67e6-4b42-bac8-e5d9dcc602ae None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:55.752330 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2e1dd-67e6-4b42-bac8-e5d9dcc602ae None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:55.752612 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2e1dd-67e6-4b42-bac8-e5d9dcc602ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:55.759710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2e1dd-67e6-4b42-bac8-e5d9dcc602ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:55.761285 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2e1dd-67e6-4b42-bac8-e5d9dcc602ae None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:55.776185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-47e2e1dd-67e6-4b42-bac8-e5d9dcc602ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:55.776185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:55.776185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:55.776185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:55.776185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:55.776185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:55.776185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:55.776185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:55.776185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:55.776185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:55.776185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:55.776185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:55.776185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:34:55.776185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:34:55.776185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:34:55.777118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:34:55.777118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:55.777118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:55.777118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:55.777118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:55.777118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:55.777118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:55.777118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:55.777118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:55.777118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:55.777118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:55.777118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:55.777118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:55.777118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:55.777118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:55.777118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:55.777118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:55.778430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:34:55.778430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:34:55.778430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:34:55.778430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:34:55.778430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:34:55.778430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:34:55.778430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:55.778430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:55.778430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 332/675] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:55.778430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2e1dd-67e6-4b42-bac8-e5d9dcc602ae None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:55.792874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:55.803571 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89beb095-a93c-4624-a3c1-beed7ac880f5 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:55.845455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613c831-0361-48fe-994f-da638da2ccfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:55.846712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613c831-0361-48fe-994f-da638da2ccfb None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:55.847585 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613c831-0361-48fe-994f-da638da2ccfb None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:55.848767 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613c831-0361-48fe-994f-da638da2ccfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:55.863393 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613c831-0361-48fe-994f-da638da2ccfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:55.865667 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613c831-0361-48fe-994f-da638da2ccfb None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:55.889194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-c613c831-0361-48fe-994f-da638da2ccfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:55.889194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:55.889194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:55.889194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:55.889194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:55.889194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:55.889194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:55.889194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:55.889194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:55.889194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:55.889194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:55.889194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:55.889194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:55.889194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:55.889194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:55.890064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:55.890064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:55.890064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:55.890064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:55.890064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:55.890064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:55.890064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:55.890064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:55.890064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:55.890064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:55.890064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:55.890064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:55.890064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:55.890064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:55.890064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:55.890064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:55.890064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:55.890951 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:55.890951 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:55.890951 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:55.890951 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:55.891620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 344/676] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:55.892987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e79bf-3259-4464-8aca-85e976461b7c None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:55.893277 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e79bf-3259-4464-8aca-85e976461b7c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:55.893563 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e79bf-3259-4464-8aca-85e976461b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:55.899978 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2e1dd-67e6-4b42-bac8-e5d9dcc602ae None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:55.917560 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-cf5e79bf-3259-4464-8aca-85e976461b7c None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:55.919228 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-cf5e79bf-3259-4464-8aca-85e976461b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:55.935980 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d6ace-5fbb-412f-a7c1-05cafb5dc1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:55.936648 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d6ace-5fbb-412f-a7c1-05cafb5dc1bf None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:55.936929 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d6ace-5fbb-412f-a7c1-05cafb5dc1bf None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:55.937208 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d6ace-5fbb-412f-a7c1-05cafb5dc1bf None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:55.937928 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d6ace-5fbb-412f-a7c1-05cafb5dc1bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:55.938234 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d6ace-5fbb-412f-a7c1-05cafb5dc1bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:55.939623 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d6ace-5fbb-412f-a7c1-05cafb5dc1bf None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:55.951514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 333/677] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:55.952321 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d6ace-5fbb-412f-a7c1-05cafb5dc1bf None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:55.992246 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:56.000741 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 345/678] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:56.001556 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e79bf-3259-4464-8aca-85e976461b7c None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:56.046128 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:56.087284 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d6ace-5fbb-412f-a7c1-05cafb5dc1bf None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:56.117317 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e79bf-3259-4464-8aca-85e976461b7c None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:56.123153 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9820d6-53f4-4721-8246-09f9070d11a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:56.124079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9820d6-53f4-4721-8246-09f9070d11a6 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:56.124544 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9820d6-53f4-4721-8246-09f9070d11a6 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:56.124970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9820d6-53f4-4721-8246-09f9070d11a6 None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:56.126457 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9820d6-53f4-4721-8246-09f9070d11a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:56.126944 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9820d6-53f4-4721-8246-09f9070d11a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:56.129062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9820d6-53f4-4721-8246-09f9070d11a6 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:56.150906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 334/679] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:34:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:56.150906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9820d6-53f4-4721-8246-09f9070d11a6 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:56.159478 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e4a2e-5182-45f9-93fd-c789a3bd6866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:56.161010 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e4a2e-5182-45f9-93fd-c789a3bd6866 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:56.161373 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e4a2e-5182-45f9-93fd-c789a3bd6866 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:56.161649 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e4a2e-5182-45f9-93fd-c789a3bd6866 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:56.162374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e4a2e-5182-45f9-93fd-c789a3bd6866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:56.162682 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e4a2e-5182-45f9-93fd-c789a3bd6866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:56.164078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e4a2e-5182-45f9-93fd-c789a3bd6866 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:56.175794 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 346/680] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:56.176490 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e4a2e-5182-45f9-93fd-c789a3bd6866 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:56.234403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:56.258843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9820d6-53f4-4721-8246-09f9070d11a6 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:56.281119 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e4a2e-5182-45f9-93fd-c789a3bd6866 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:56.288439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:56.298401 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f187f-e1d7-4979-99e3-d5ff3320928a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:56.299212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f187f-e1d7-4979-99e3-d5ff3320928a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:56.299519 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f187f-e1d7-4979-99e3-d5ff3320928a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:56.299800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f187f-e1d7-4979-99e3-d5ff3320928a None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:56.307447 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f187f-e1d7-4979-99e3-d5ff3320928a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:56.308912 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f187f-e1d7-4979-99e3-d5ff3320928a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:56.317843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b67c8-04ca-4909-bda2-6d2191c448a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:56.318638 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b67c8-04ca-4909-bda2-6d2191c448a4 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:56.318921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b67c8-04ca-4909-bda2-6d2191c448a4 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:56.319192 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b67c8-04ca-4909-bda2-6d2191c448a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:56.323779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-4a2f187f-e1d7-4979-99e3-d5ff3320928a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:56.323779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:56.323779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:56.323779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:56.323779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:56.323779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:56.323779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:56.323779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:56.323779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:56.323779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:56.323779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:56.323779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:56.323779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:34:56.323779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:34:56.323779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:34:56.324689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:34:56.324689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:56.324689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:56.324689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:56.324689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:56.324689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:56.324689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:56.324689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:56.324689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:56.324689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:56.324689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:56.324689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:56.324689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:56.324689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:56.324689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:56.324689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:56.324689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:56.325619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:34:56.325619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:34:56.325619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:34:56.325619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:34:56.325619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:34:56.325619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:34:56.325619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:56.325619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:56.325619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 335/681] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:56.326110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f187f-e1d7-4979-99e3-d5ff3320928a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:56.336511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b67c8-04ca-4909-bda2-6d2191c448a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:34:56.344374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-592b67c8-04ca-4909-bda2-6d2191c448a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:34:56.344374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:56.344374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:56.344374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:56.344374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:56.344374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:56.344374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:56.344374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:56.344374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:56.344374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:56.344374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:56.344374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:56.344374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:34:56.344374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:34:56.344374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:34:56.344374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:34:56.345289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:34:56.345289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:34:56.345289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:34:56.345289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:34:56.345289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:56.345289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:56.345289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:56.345289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:56.345289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:56.345289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:56.345289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:56.345289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:56.345289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:56.345289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:56.345289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:56.345289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:56.346221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:56.346221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:56.346221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:56.346221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:56.346221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:34:56.346221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:34:56.346221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:34:56.346221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:34:56.346221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:34:56.346221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:34:56.346221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:34:56.346221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:56.346221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 347/682] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:34:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:56.346221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b67c8-04ca-4909-bda2-6d2191c448a4 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:56.438094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f187f-e1d7-4979-99e3-d5ff3320928a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:56.462556 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b67c8-04ca-4909-bda2-6d2191c448a4 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:56.475445 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd958c74-d748-4f9d-9a10-ceff522242dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:56.476213 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd958c74-d748-4f9d-9a10-ceff522242dc None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:56.476495 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd958c74-d748-4f9d-9a10-ceff522242dc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:56.476767 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd958c74-d748-4f9d-9a10-ceff522242dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:56.477706 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd958c74-d748-4f9d-9a10-ceff522242dc None admin] RBAC: Adding query filter params (role.id=e5e7de76725748df9add27e3c837d8ef, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=7d9a41e10cb64ee9972debaf856503d4) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:56.478014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd958c74-d748-4f9d-9a10-ceff522242dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:56.479455 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd958c74-d748-4f9d-9a10-ceff522242dc None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:56.479792 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:56.495587 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 336/683] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:34:56 2022] GET /identity/v3/role_assignments?user.id=7d9a41e10cb64ee9972debaf856503d4&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=e5e7de76725748df9add27e3c837d8ef => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:56.495587 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd958c74-d748-4f9d-9a10-ceff522242dc None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:56.510519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d79a6-f1ff-480b-b647-4019abb4c568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:56.511590 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d79a6-f1ff-480b-b647-4019abb4c568 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:56.512002 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d79a6-f1ff-480b-b647-4019abb4c568 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:56.512347 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d79a6-f1ff-480b-b647-4019abb4c568 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:56.522718 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d79a6-f1ff-480b-b647-4019abb4c568 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:56.524587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d79a6-f1ff-480b-b647-4019abb4c568 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:56.542446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-352d79a6-f1ff-480b-b647-4019abb4c568 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 20:34:56.542446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:56.542446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:56.542446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:56.542446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:56.542446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:56.542446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:56.542446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:56.542446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:56.542446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:56.542446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:56.542446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:56.542446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:34:56.542446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:34:56.542446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:34:56.542446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:34:56.543573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:56.543573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:56.543573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:34:56.543573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:56.543573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:34:56.543573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:56.543573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:56.543573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:56.543573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:56.543573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:56.543573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:56.543573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:56.543573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:56.543573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:56.543573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:56.543573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:56.543573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:56.543573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:56.544519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:56.544519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:56.544519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:34:56.544519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:34:56.544519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:34:56.544519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:34:56.544519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:34:56.544519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:34:56.544519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 20:34:56.544519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:56.544519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 348/684] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:34:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:56.545573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d79a6-f1ff-480b-b647-4019abb4c568 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:56.564285 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:56.635660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd958c74-d748-4f9d-9a10-ceff522242dc None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:56.672583 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d79a6-f1ff-480b-b647-4019abb4c568 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:56.674957 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a205cf-cdd1-4baf-af95-532c2e4c2e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:56.676787 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a205cf-cdd1-4baf-af95-532c2e4c2e45 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:56.676787 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a205cf-cdd1-4baf-af95-532c2e4c2e45 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:56.676990 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a205cf-cdd1-4baf-af95-532c2e4c2e45 None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:56.677658 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a205cf-cdd1-4baf-af95-532c2e4c2e45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:56.677995 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a205cf-cdd1-4baf-af95-532c2e4c2e45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:56.679533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a205cf-cdd1-4baf-af95-532c2e4c2e45 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:56.694021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 337/685] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:34:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:56.694922 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a205cf-cdd1-4baf-af95-532c2e4c2e45 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:56.714242 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dee9b-c6f4-4d4d-87d5-89b06a8d4c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:56.715469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dee9b-c6f4-4d4d-87d5-89b06a8d4c0f None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:56.715965 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dee9b-c6f4-4d4d-87d5-89b06a8d4c0f None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:56.716394 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dee9b-c6f4-4d4d-87d5-89b06a8d4c0f None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:56.717294 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dee9b-c6f4-4d4d-87d5-89b06a8d4c0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:56.717799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dee9b-c6f4-4d4d-87d5-89b06a8d4c0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:56.720175 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dee9b-c6f4-4d4d-87d5-89b06a8d4c0f None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:56.731012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 349/686] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:34:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:56.735301 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dee9b-c6f4-4d4d-87d5-89b06a8d4c0f None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:56.781341 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:56.819491 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a205cf-cdd1-4baf-af95-532c2e4c2e45 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:56.837445 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:56.855052 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dee9b-c6f4-4d4d-87d5-89b06a8d4c0f None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:56.865083 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea246808-ef76-4148-aa79-6f03b80462fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:56.866327 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea246808-ef76-4148-aa79-6f03b80462fe None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:56.866688 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea246808-ef76-4148-aa79-6f03b80462fe None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:56.867407 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea246808-ef76-4148-aa79-6f03b80462fe None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:56.868962 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea246808-ef76-4148-aa79-6f03b80462fe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:56.869276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea246808-ef76-4148-aa79-6f03b80462fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:56.870711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea246808-ef76-4148-aa79-6f03b80462fe None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:56.889134 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 338/687] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Jul 19 20:34:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:56.894402 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea246808-ef76-4148-aa79-6f03b80462fe None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:56.906189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686a6e7-07ac-49aa-8558-3b4fd4834811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:56.907409 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686a6e7-07ac-49aa-8558-3b4fd4834811 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:56.907901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686a6e7-07ac-49aa-8558-3b4fd4834811 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:56.908385 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686a6e7-07ac-49aa-8558-3b4fd4834811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:56.909554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686a6e7-07ac-49aa-8558-3b4fd4834811 None admin] RBAC: Adding query filter params (role.id=e5e7de76725748df9add27e3c837d8ef, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=5b2c0f24d666462aa14ea4eee0592062) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:56.910075 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686a6e7-07ac-49aa-8558-3b4fd4834811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:56.912773 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686a6e7-07ac-49aa-8558-3b4fd4834811 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:56.920142 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 350/688] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:34:56 2022] GET /identity/v3/role_assignments?user.id=5b2c0f24d666462aa14ea4eee0592062&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=e5e7de76725748df9add27e3c837d8ef => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:56.921202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686a6e7-07ac-49aa-8558-3b4fd4834811 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:57.059205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686a6e7-07ac-49aa-8558-3b4fd4834811 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:57.061518 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:57.101263 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cd1e2-b127-4304-b131-1acff834d974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:57.102365 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cd1e2-b127-4304-b131-1acff834d974 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:57.102855 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cd1e2-b127-4304-b131-1acff834d974 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:57.103385 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cd1e2-b127-4304-b131-1acff834d974 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:57.107991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea246808-ef76-4148-aa79-6f03b80462fe None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:57.146812 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f61637-94d3-4280-9bc8-8718da5377bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:57.147577 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f61637-94d3-4280-9bc8-8718da5377bf None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:57.147854 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f61637-94d3-4280-9bc8-8718da5377bf None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:57.148158 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f61637-94d3-4280-9bc8-8718da5377bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:57.164490 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f61637-94d3-4280-9bc8-8718da5377bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:57.165954 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f61637-94d3-4280-9bc8-8718da5377bf None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:57.182649 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cd1e2-b127-4304-b131-1acff834d974 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:57.185034 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693cd1e2-b127-4304-b131-1acff834d974 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:57.185245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-66f61637-94d3-4280-9bc8-8718da5377bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:57.185245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:57.185245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:57.185245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:57.185245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:57.185245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:57.185245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:57.185245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:57.185245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:57.185245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:57.185245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:57.185245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:57.185245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:57.185245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:57.185245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:57.186105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:57.186105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:57.186105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:57.186105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:57.186105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:57.186105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:57.186105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:57.186105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:57.186105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:57.186105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:57.186105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:57.186105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:57.186105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:57.186105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:57.186105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:57.186105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:57.186105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:57.187032 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:57.187032 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:57.187032 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:57.187032 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:57.191213 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 339/689] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:57.192827 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f61637-94d3-4280-9bc8-8718da5377bf None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:57.217965 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:57.305648 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 351/690] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:57.305866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f61637-94d3-4280-9bc8-8718da5377bf None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:57.312248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cd1e2-b127-4304-b131-1acff834d974 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:57.315563 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:57.374828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76942a-45c7-4963-8f1f-34b4ea7999d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:57.375528 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76942a-45c7-4963-8f1f-34b4ea7999d2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:57.375814 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76942a-45c7-4963-8f1f-34b4ea7999d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:57.376090 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76942a-45c7-4963-8f1f-34b4ea7999d2 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:57.376818 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76942a-45c7-4963-8f1f-34b4ea7999d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:57.377127 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76942a-45c7-4963-8f1f-34b4ea7999d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:57.378486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76942a-45c7-4963-8f1f-34b4ea7999d2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:57.391012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 340/691] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:57.396974 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76942a-45c7-4963-8f1f-34b4ea7999d2 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:57.457229 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cd1e2-b127-4304-b131-1acff834d974 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:57.496709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:57.502601 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef1f19-69c9-4ab6-bfc5-446a0348d467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:57.503437 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef1f19-69c9-4ab6-bfc5-446a0348d467 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:57.503723 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef1f19-69c9-4ab6-bfc5-446a0348d467 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:57.504000 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef1f19-69c9-4ab6-bfc5-446a0348d467 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:57.515183 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef1f19-69c9-4ab6-bfc5-446a0348d467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:57.516692 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef1f19-69c9-4ab6-bfc5-446a0348d467 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:57.524029 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76942a-45c7-4963-8f1f-34b4ea7999d2 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:57.537193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-e4ef1f19-69c9-4ab6-bfc5-446a0348d467 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:57.537193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:57.537193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:57.537193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:57.537193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:57.537193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:57.537193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:57.537193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:57.537193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:57.537193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:57.537193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:57.537193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:57.537193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:57.537193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:57.537193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:57.538147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:57.538147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:57.538147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:57.538147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:57.538147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:57.538147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:57.538147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:57.538147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:57.538147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:57.538147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:57.538147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:57.538147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:57.538147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:57.538147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:57.538147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:57.538147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:57.538147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:57.539147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:57.539147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:57.539147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:57.539147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:57.539147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 352/692] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:57.540125 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738a189-222f-4c35-8eb2-c6c7153e7e30 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:57.540424 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738a189-222f-4c35-8eb2-c6c7153e7e30 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:57.540731 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738a189-222f-4c35-8eb2-c6c7153e7e30 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:57.542286 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 353/693] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:57.544045 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738a189-222f-4c35-8eb2-c6c7153e7e30 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:57.570897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f40c71-008e-4718-b7fa-20b9c9bb2bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:57.572095 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f40c71-008e-4718-b7fa-20b9c9bb2bca None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:57.572600 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f40c71-008e-4718-b7fa-20b9c9bb2bca None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:57.573026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f40c71-008e-4718-b7fa-20b9c9bb2bca None admin] PATH_INFO: `/v3/users/nova` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:57.582050 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f40c71-008e-4718-b7fa-20b9c9bb2bca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:57.584378 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f40c71-008e-4718-b7fa-20b9c9bb2bca None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:57.600345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-83f40c71-008e-4718-b7fa-20b9c9bb2bca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 20:34:57.600345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:57.600345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:57.600345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:57.600345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:57.600345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:57.600345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:57.600345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:57.600345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:57.600345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:57.600345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:57.600345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:57.600345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:34:57.600345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:34:57.600345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:34:57.600345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:34:57.601562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:57.601562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:57.601562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:34:57.601562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:57.601562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:34:57.601562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:34:57.601562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:57.601562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:57.601562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:57.601562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:57.601562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:57.601562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:57.601562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:57.601562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:57.601562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:57.601562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:57.601562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:57.601562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:57.602576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:57.602576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:57.602576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:34:57.602576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:34:57.602576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:34:57.602576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:34:57.602576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:34:57.602576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:34:57.602576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 20:34:57.602576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:57.605097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 341/694] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Jul 19 20:34:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:34:57.606496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f28f0-edc3-42f3-8348-f63c44617ebe None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:57.611311 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f28f0-edc3-42f3-8348-f63c44617ebe None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:57.611939 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:57.612406 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f28f0-edc3-42f3-8348-f63c44617ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:57.632756 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-4c8f28f0-edc3-42f3-8348-f63c44617ebe None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:57.634373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-4c8f28f0-edc3-42f3-8348-f63c44617ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:57.658587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738a189-222f-4c35-8eb2-c6c7153e7e30 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:57.706118 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c347bba-5037-4b04-9d59-c919a55f48c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:57.706820 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c347bba-5037-4b04-9d59-c919a55f48c3 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:57.707166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c347bba-5037-4b04-9d59-c919a55f48c3 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:57.707798 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c347bba-5037-4b04-9d59-c919a55f48c3 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:57.708373 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c347bba-5037-4b04-9d59-c919a55f48c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:57.708726 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c347bba-5037-4b04-9d59-c919a55f48c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:57.710098 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c347bba-5037-4b04-9d59-c919a55f48c3 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:57.713270 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 342/695] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:57.714317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f28f0-edc3-42f3-8348-f63c44617ebe None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:57.727401 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 354/696] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:57.729119 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c347bba-5037-4b04-9d59-c919a55f48c3 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:57.789360 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:57.821199 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f28f0-edc3-42f3-8348-f63c44617ebe None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:57.841739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c347bba-5037-4b04-9d59-c919a55f48c3 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:57.857356 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:57.857545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac3605-9bb5-4e8c-84bf-e232a2db9abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:57.858290 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac3605-9bb5-4e8c-84bf-e232a2db9abc None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:57.859017 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac3605-9bb5-4e8c-84bf-e232a2db9abc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:57.859436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac3605-9bb5-4e8c-84bf-e232a2db9abc None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:57.860681 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac3605-9bb5-4e8c-84bf-e232a2db9abc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:57.861074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac3605-9bb5-4e8c-84bf-e232a2db9abc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:57.863173 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac3605-9bb5-4e8c-84bf-e232a2db9abc None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:57.882383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e23f5-c48e-408e-9cbd-8a83573f9b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:57.883527 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e23f5-c48e-408e-9cbd-8a83573f9b6c None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:57.883988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e23f5-c48e-408e-9cbd-8a83573f9b6c None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:57.884563 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e23f5-c48e-408e-9cbd-8a83573f9b6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:57.896337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e23f5-c48e-408e-9cbd-8a83573f9b6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:57.896337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e23f5-c48e-408e-9cbd-8a83573f9b6c None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:57.896717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 343/697] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Jul 19 20:34:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:57.897823 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac3605-9bb5-4e8c-84bf-e232a2db9abc None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:57.916950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-c23e23f5-c48e-408e-9cbd-8a83573f9b6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:57.916950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:57.916950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:57.916950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:57.916950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:57.916950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:57.916950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:57.916950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:57.916950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:57.916950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:57.916950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:57.916950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:57.916950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:34:57.916950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:34:57.916950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:34:57.917877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:34:57.917877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:57.917877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:57.917877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:57.917877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:57.917877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:57.917877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:57.917877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:57.917877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:57.917877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:57.917877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:57.917877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:57.917877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:57.917877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:57.917877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:57.917877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:57.917877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:57.918821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:34:57.918821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:34:57.918821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:34:57.918821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:34:57.918821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:34:57.918821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:34:57.918821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:57.918821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:57.922831 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 355/698] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:57.923732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e23f5-c48e-408e-9cbd-8a83573f9b6c None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:58.028042 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac3605-9bb5-4e8c-84bf-e232a2db9abc None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:58.033927 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e23f5-c48e-408e-9cbd-8a83573f9b6c None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:58.065108 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:58.072131 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e99815-cf14-4b28-b892-3096dce47880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:58.072954 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e99815-cf14-4b28-b892-3096dce47880 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:58.073240 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e99815-cf14-4b28-b892-3096dce47880 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:58.073461 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69effc9b-dddd-4536-aa09-dc0672e28ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:58.073584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e99815-cf14-4b28-b892-3096dce47880 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:58.074172 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e99815-cf14-4b28-b892-3096dce47880 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:58.074516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69effc9b-dddd-4536-aa09-dc0672e28ef3 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:58.074934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69effc9b-dddd-4536-aa09-dc0672e28ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:58.075397 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69effc9b-dddd-4536-aa09-dc0672e28ef3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:58.075692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e99815-cf14-4b28-b892-3096dce47880 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:58.094015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-32e99815-cf14-4b28-b892-3096dce47880 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 20:34:58.094015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:58.094015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:34:58.094015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:34:58.094015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:34:58.094015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:34:58.094015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:34:58.094015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:34:58.094015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 20:34:58.094015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:58.094015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:34:58.094015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:58.094015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:58.094015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:58.094015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:58.094015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:58.095058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:58.095058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:58.095058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:58.095058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:58.095058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:58.095058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:58.095058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:58.095058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:34:58.095058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:34:58.095058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:34:58.095058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:34:58.095058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:58.095058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:58.095058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:58.095058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:58.095058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:58.095931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:58.095931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:58.095931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:58.095931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:58.095931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:58.095931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:58.095931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:58.095931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:58.095931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:58.095931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:58.095931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:58.095931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:34:58.095931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:34:58.095931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 20:34:58.095931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:58.095931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 344/699] 10.222.0.77 () {56 vars in 1129 bytes} [Tue Jul 19 20:34:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:58.096779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e99815-cf14-4b28-b892-3096dce47880 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:58.133721 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:58.174284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69effc9b-dddd-4536-aa09-dc0672e28ef3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:58.175696 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69effc9b-dddd-4536-aa09-dc0672e28ef3 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:58.214852 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e99815-cf14-4b28-b892-3096dce47880 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:58.251287 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76771e9-e28a-485c-8521-cb275be8223c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:58.252312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76771e9-e28a-485c-8521-cb275be8223c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:58.252781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76771e9-e28a-485c-8521-cb275be8223c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:58.253211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76771e9-e28a-485c-8521-cb275be8223c None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:58.254133 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76771e9-e28a-485c-8521-cb275be8223c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:58.255238 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76771e9-e28a-485c-8521-cb275be8223c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:58.257144 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76771e9-e28a-485c-8521-cb275be8223c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:58.270655 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 345/700] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:34:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:58.271921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76771e9-e28a-485c-8521-cb275be8223c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:58.311505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 356/701] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:34:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:34:58.313190 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69effc9b-dddd-4536-aa09-dc0672e28ef3 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:58.344971 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:58.402362 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:58.411119 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76771e9-e28a-485c-8521-cb275be8223c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:58.436029 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69effc9b-dddd-4536-aa09-dc0672e28ef3 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:58.450559 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bfb7af-c81d-4530-939a-9542376b6614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:58.451575 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfb7af-c81d-4530-939a-9542376b6614 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:58.452214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfb7af-c81d-4530-939a-9542376b6614 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:58.452688 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfb7af-c81d-4530-939a-9542376b6614 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:58.453706 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bfb7af-c81d-4530-939a-9542376b6614 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:58.454257 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bfb7af-c81d-4530-939a-9542376b6614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:58.455840 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bfb7af-c81d-4530-939a-9542376b6614 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:58.461270 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 346/702] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Jul 19 20:34:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:58.462273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bfb7af-c81d-4530-939a-9542376b6614 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:58.478859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517849dc-cab3-4403-9fd5-1829c748c71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:58.479793 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517849dc-cab3-4403-9fd5-1829c748c71e None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:58.480081 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517849dc-cab3-4403-9fd5-1829c748c71e None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:58.480361 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517849dc-cab3-4403-9fd5-1829c748c71e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:58.481691 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517849dc-cab3-4403-9fd5-1829c748c71e None admin] RBAC: Adding query filter params (role.id=e5e7de76725748df9add27e3c837d8ef, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=7987846276ad4ccd90899128ceb1354e) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:58.482014 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517849dc-cab3-4403-9fd5-1829c748c71e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:58.483781 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517849dc-cab3-4403-9fd5-1829c748c71e None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:58.496851 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 357/703] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:34:58 2022] GET /identity/v3/role_assignments?user.id=7987846276ad4ccd90899128ceb1354e&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=e5e7de76725748df9add27e3c837d8ef => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:58.498284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517849dc-cab3-4403-9fd5-1829c748c71e None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:58.644813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bfb7af-c81d-4530-939a-9542376b6614 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:58.686122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:58.715723 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59f3af-359f-4b90-a61c-da77bda96dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:58.716527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59f3af-359f-4b90-a61c-da77bda96dab None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:58.716853 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59f3af-359f-4b90-a61c-da77bda96dab None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:58.717078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59f3af-359f-4b90-a61c-da77bda96dab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:58.722693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517849dc-cab3-4403-9fd5-1829c748c71e None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:58.735034 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59f3af-359f-4b90-a61c-da77bda96dab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:58.736616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59f3af-359f-4b90-a61c-da77bda96dab None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:58.760122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-1b59f3af-359f-4b90-a61c-da77bda96dab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:58.760122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:58.760122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:58.760122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:58.760122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:58.760122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:58.760122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:58.760122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:58.760122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:58.760122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:58.760122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:58.760122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:58.760122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:58.760122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:58.760122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:58.761088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:58.761088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:58.761088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:58.761088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:58.761088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:58.761088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:58.761088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:58.761088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:58.761088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:58.761088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:58.761088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:58.761088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:58.761088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:58.761088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:58.761088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:58.761088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:58.761088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:58.761977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:58.761977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:58.761977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:58.761977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:58.763869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 347/704] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:58.768297 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46355af-8c29-4bad-8869-a65f225e018a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:58.768297 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46355af-8c29-4bad-8869-a65f225e018a None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:58.768297 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46355af-8c29-4bad-8869-a65f225e018a None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:58.768297 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46355af-8c29-4bad-8869-a65f225e018a None admin] PATH_INFO: `/v3/services` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:58.768647 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46355af-8c29-4bad-8869-a65f225e018a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:58.768717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46355af-8c29-4bad-8869-a65f225e018a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:58.769754 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59f3af-359f-4b90-a61c-da77bda96dab None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:58.770767 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46355af-8c29-4bad-8869-a65f225e018a None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:58.778701 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 358/705] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Jul 19 20:34:58 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:58.893387 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59f3af-359f-4b90-a61c-da77bda96dab None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:58.939819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d549d-2b97-4965-acd3-ad6ea712ef93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:58.940432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d549d-2b97-4965-acd3-ad6ea712ef93 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:58.940715 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d549d-2b97-4965-acd3-ad6ea712ef93 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:58.940989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d549d-2b97-4965-acd3-ad6ea712ef93 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:58.941821 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d549d-2b97-4965-acd3-ad6ea712ef93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:58.942126 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d549d-2b97-4965-acd3-ad6ea712ef93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:58.943586 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d549d-2b97-4965-acd3-ad6ea712ef93 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:58.956722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 348/706] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:58.962360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46355af-8c29-4bad-8869-a65f225e018a None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:58.965337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:58.980242 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06b8d6-dfdf-40f8-ac7e-ed67034f15be None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:58.980966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06b8d6-dfdf-40f8-ac7e-ed67034f15be None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:58.981257 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06b8d6-dfdf-40f8-ac7e-ed67034f15be None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:58.983192 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 349/707] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:34:58.991149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea496f3-ddab-4877-b75a-1e8bee5f3c8b None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:58.991149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea496f3-ddab-4877-b75a-1e8bee5f3c8b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:58.991149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea496f3-ddab-4877-b75a-1e8bee5f3c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:59.012147 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-9ea496f3-ddab-4877-b75a-1e8bee5f3c8b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:59.013831 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-9ea496f3-ddab-4877-b75a-1e8bee5f3c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:59.047900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:59.088533 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46355af-8c29-4bad-8869-a65f225e018a None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:59.119295 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 350/708] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:34:59.144446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d92310-78a1-4afc-b1f4-5841b74c8647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:59.145628 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d92310-78a1-4afc-b1f4-5841b74c8647 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:59.146060 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d92310-78a1-4afc-b1f4-5841b74c8647 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:59.146474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d92310-78a1-4afc-b1f4-5841b74c8647 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:59.147771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea496f3-ddab-4877-b75a-1e8bee5f3c8b None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:59.154582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d92310-78a1-4afc-b1f4-5841b74c8647 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:59.156672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d92310-78a1-4afc-b1f4-5841b74c8647 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:59.184311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-c7d92310-78a1-4afc-b1f4-5841b74c8647 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:59.184311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:59.184311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:59.184311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:59.184311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:59.184311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:59.184311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:59.184311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:59.184311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:59.184311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:59.184311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:59.184311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:59.184311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:34:59.184311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:34:59.184311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:34:59.185481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:34:59.185481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:59.185481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:59.185481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:59.185481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:59.185481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:59.185481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:59.185481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:59.185481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:59.185481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:59.185481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:59.185481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:59.185481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:59.185481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:59.185481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:59.185481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:59.185481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:59.186760 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:34:59.186760 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:34:59.186760 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:34:59.186760 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:34:59.186760 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:34:59.186760 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:34:59.186760 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:34:59.186760 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:34:59.193015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 359/709] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:59.199686 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d92310-78a1-4afc-b1f4-5841b74c8647 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:59.302530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:59.320017 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea496f3-ddab-4877-b75a-1e8bee5f3c8b None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:59.349194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d92310-78a1-4afc-b1f4-5841b74c8647 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:59.364647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106c342-cd2a-4e86-80cb-ddc71f89acdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:59.365891 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106c342-cd2a-4e86-80cb-ddc71f89acdf None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:59.366371 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106c342-cd2a-4e86-80cb-ddc71f89acdf None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:59.367173 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106c342-cd2a-4e86-80cb-ddc71f89acdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:59.381109 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106c342-cd2a-4e86-80cb-ddc71f89acdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:59.383536 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106c342-cd2a-4e86-80cb-ddc71f89acdf None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:59.390532 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4d547-b8fe-4418-a832-80b3e8b4e05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:59.391206 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4d547-b8fe-4418-a832-80b3e8b4e05f None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:59.391527 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4d547-b8fe-4418-a832-80b3e8b4e05f None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:59.391802 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4d547-b8fe-4418-a832-80b3e8b4e05f None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:59.392597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4d547-b8fe-4418-a832-80b3e8b4e05f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:59.392905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4d547-b8fe-4418-a832-80b3e8b4e05f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:59.394816 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4d547-b8fe-4418-a832-80b3e8b4e05f None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:59.406608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-b106c342-cd2a-4e86-80cb-ddc71f89acdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:59.406608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:59.406608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:59.406608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:59.406608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:59.406608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:59.406608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:59.406608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:59.406608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:59.406608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:59.406608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:59.406608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:59.406608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:34:59.406608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:34:59.406608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:34:59.407632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:34:59.407632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:59.407632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:59.407632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:59.407632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:59.407632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:59.407632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:59.407632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:59.407632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:59.407632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:59.407632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:59.407632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:59.407632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:59.407632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:59.407632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:59.407632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:59.407632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:59.408562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:34:59.408562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:34:59.408562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:34:59.408562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:59.409433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 360/710] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:34:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:59.410864 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 351/711] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:34:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:34:59.411199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca88ab7-2050-463b-a8ad-b46086ae2bb7 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:59.411525 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca88ab7-2050-463b-a8ad-b46086ae2bb7 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:59.411803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca88ab7-2050-463b-a8ad-b46086ae2bb7 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:59.413257 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 361/712] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:34:59.418923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106c342-cd2a-4e86-80cb-ddc71f89acdf None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:59.419303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3553e-42e4-4a43-bec6-d6f18ad2b05b None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:59.419584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3553e-42e4-4a43-bec6-d6f18ad2b05b None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:59.419983 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3553e-42e4-4a43-bec6-d6f18ad2b05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:59.440344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-5ce3553e-42e4-4a43-bec6-d6f18ad2b05b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:34:59.441536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-5ce3553e-42e4-4a43-bec6-d6f18ad2b05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:34:59.464413 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:59.533421 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 362/713] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:34:59.534828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3553e-42e4-4a43-bec6-d6f18ad2b05b None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:59.544065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106c342-cd2a-4e86-80cb-ddc71f89acdf None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:59.595774 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7cc43-ee9d-4d09-9bb2-c9d18c5bcaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:59.596443 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7cc43-ee9d-4d09-9bb2-c9d18c5bcaf3 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:59.596724 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7cc43-ee9d-4d09-9bb2-c9d18c5bcaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:59.596999 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7cc43-ee9d-4d09-9bb2-c9d18c5bcaf3 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:59.598172 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7cc43-ee9d-4d09-9bb2-c9d18c5bcaf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:59.598481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7cc43-ee9d-4d09-9bb2-c9d18c5bcaf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:59.600174 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7cc43-ee9d-4d09-9bb2-c9d18c5bcaf3 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:59.608771 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:59.622704 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 352/714] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:59.622704 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7cc43-ee9d-4d09-9bb2-c9d18c5bcaf3 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:59.668981 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce3553e-42e4-4a43-bec6-d6f18ad2b05b None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:59.707154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d7008-fd33-4bf9-b958-4e26983d2a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:59.708687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d7008-fd33-4bf9-b958-4e26983d2a8b None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:59.709196 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d7008-fd33-4bf9-b958-4e26983d2a8b None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:59.709730 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d7008-fd33-4bf9-b958-4e26983d2a8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:59.710711 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d7008-fd33-4bf9-b958-4e26983d2a8b None admin] RBAC: Adding query filter params (role.id=b30f01ef95004a1b84fc029830bdf053, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=6dbbb8f7b3f2449fb9c64ca3815b6c1b) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:59.711171 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d7008-fd33-4bf9-b958-4e26983d2a8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:59.712539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:59.714080 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d7008-fd33-4bf9-b958-4e26983d2a8b None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:59.731687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 363/715] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:34:59 2022] GET /identity/v3/role_assignments?user.id=6dbbb8f7b3f2449fb9c64ca3815b6c1b&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=b30f01ef95004a1b84fc029830bdf053 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:34:59.733018 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d7008-fd33-4bf9-b958-4e26983d2a8b None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:59.747077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7cc43-ee9d-4d09-9bb2-c9d18c5bcaf3 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:59.782543 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613b4d8-04ff-46ab-a39f-5aeb90d3e37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:59.783398 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613b4d8-04ff-46ab-a39f-5aeb90d3e37d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:59.783678 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613b4d8-04ff-46ab-a39f-5aeb90d3e37d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:59.783950 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613b4d8-04ff-46ab-a39f-5aeb90d3e37d None admin] PATH_INFO: `/v3/services/network` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:59.784603 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613b4d8-04ff-46ab-a39f-5aeb90d3e37d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:59.786325 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613b4d8-04ff-46ab-a39f-5aeb90d3e37d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:59.798617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-0613b4d8-04ff-46ab-a39f-5aeb90d3e37d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 20:34:59.798617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:59.798617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:34:59.798617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:34:59.798617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:34:59.798617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:34:59.798617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:34:59.798617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:34:59.798617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 20:34:59.798617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:59.798617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:34:59.798617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:59.798617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:34:59.798617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:34:59.798617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:34:59.798617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:34:59.798617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:34:59.799988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:34:59.799988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:34:59.799988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:34:59.799988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:34:59.799988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:34:59.799988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:34:59.799988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:34:59.799988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:34:59.799988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:34:59.799988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:34:59.799988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:34:59.799988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:34:59.799988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:34:59.799988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:34:59.799988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:34:59.799988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:34:59.801100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:34:59.801100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:34:59.801100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:34:59.801100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:34:59.801100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:34:59.801100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:34:59.801100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:34:59.801100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:34:59.801100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:34:59.801100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:34:59.801100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:34:59.801100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:34:59.801100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 20:34:59.801100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:34:59.805256 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 353/716] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:34:59 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:34:59.806521 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613b4d8-04ff-46ab-a39f-5aeb90d3e37d None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:59.914724 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613b4d8-04ff-46ab-a39f-5aeb90d3e37d None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:34:59.950100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a50862-8ff7-48a6-b36f-42c7020c794a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:34:59.950777 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a50862-8ff7-48a6-b36f-42c7020c794a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:34:59.951068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a50862-8ff7-48a6-b36f-42c7020c794a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:34:59.951372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a50862-8ff7-48a6-b36f-42c7020c794a None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:34:59.955294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a50862-8ff7-48a6-b36f-42c7020c794a None admin] RBAC: Adding query filter params (name=network) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:34:59.955294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a50862-8ff7-48a6-b36f-42c7020c794a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:34:59.955294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a50862-8ff7-48a6-b36f-42c7020c794a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:34:59.956126 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:34:59.963378 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 354/717] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jul 19 20:34:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:34:59.964926 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a50862-8ff7-48a6-b36f-42c7020c794a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:34:59.982246 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d7008-fd33-4bf9-b958-4e26983d2a8b None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:00.023481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:00.054974 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd0104-c311-4e77-804b-3a3810bb80ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:00.056105 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd0104-c311-4e77-804b-3a3810bb80ed None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:00.056627 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd0104-c311-4e77-804b-3a3810bb80ed None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:00.057119 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd0104-c311-4e77-804b-3a3810bb80ed None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:00.058092 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd0104-c311-4e77-804b-3a3810bb80ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:00.059997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd0104-c311-4e77-804b-3a3810bb80ed None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:00.099951 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 364/718] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jul 19 20:34:59 2022] POST /identity/v3/users => generated 254 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:35:00.125238 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a50862-8ff7-48a6-b36f-42c7020c794a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:00.171234 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0be4e-3912-4c37-bf1c-5cee482b6f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:00.172425 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0be4e-3912-4c37-bf1c-5cee482b6f61 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:00.172946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0be4e-3912-4c37-bf1c-5cee482b6f61 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:00.173447 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0be4e-3912-4c37-bf1c-5cee482b6f61 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:00.174381 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0be4e-3912-4c37-bf1c-5cee482b6f61 None admin] RBAC: Adding query filter params (type=network) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:00.174918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0be4e-3912-4c37-bf1c-5cee482b6f61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:00.176764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a0be4e-3912-4c37-bf1c-5cee482b6f61 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:00.184286 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 355/719] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jul 19 20:34:59 2022] GET /identity/v3/services?type=network => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:01.201788 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81057cfc-659e-4379-81bd-842c4f75c28a None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:01.202307 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81057cfc-659e-4379-81bd-842c4f75c28a None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:01.202307 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81057cfc-659e-4379-81bd-842c4f75c28a None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:01.203878 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 365/720] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:01.209812 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55526d62-a46f-40b6-82d6-a93a288b5a6b None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:01.210243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55526d62-a46f-40b6-82d6-a93a288b5a6b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:01.210418 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55526d62-a46f-40b6-82d6-a93a288b5a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:01.227566 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-55526d62-a46f-40b6-82d6-a93a288b5a6b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:01.228737 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-55526d62-a46f-40b6-82d6-a93a288b5a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:01.275959 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e53780-9d20-4d89-9258-5b7afe67a8e4 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:01.276273 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e53780-9d20-4d89-9258-5b7afe67a8e4 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:01.276526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e53780-9d20-4d89-9258-5b7afe67a8e4 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:01.278199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 366/721] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:01.283199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6801831-ecc5-451a-aa3b-1eae3c0b36ff None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:01.283518 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6801831-ecc5-451a-aa3b-1eae3c0b36ff None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:01.283796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6801831-ecc5-451a-aa3b-1eae3c0b36ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:01.306112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:01.319362 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 356/722] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:35:01.320426 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-d6801831-ecc5-451a-aa3b-1eae3c0b36ff None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:01.321639 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-d6801831-ecc5-451a-aa3b-1eae3c0b36ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:01.340321 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55526d62-a46f-40b6-82d6-a93a288b5a6b None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:01.453941 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55526d62-a46f-40b6-82d6-a93a288b5a6b None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:01.496001 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 367/723] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:35:01.504036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf257b-fd3f-4f64-8f48-0f9cc98d0597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:01.505094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf257b-fd3f-4f64-8f48-0f9cc98d0597 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:01.505616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf257b-fd3f-4f64-8f48-0f9cc98d0597 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:01.506128 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf257b-fd3f-4f64-8f48-0f9cc98d0597 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:01.507108 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf257b-fd3f-4f64-8f48-0f9cc98d0597 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:01.508769 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf257b-fd3f-4f64-8f48-0f9cc98d0597 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:01.522380 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6801831-ecc5-451a-aa3b-1eae3c0b36ff None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:01.548571 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 357/724] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jul 19 20:35:01 2022] POST /identity/v3/services => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:35:01.643543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6801831-ecc5-451a-aa3b-1eae3c0b36ff None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:01.646287 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:01.717553 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7985a-6f05-42b2-b7f5-ae815b945e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:01.718801 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7985a-6f05-42b2-b7f5-ae815b945e7c None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:01.719455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7985a-6f05-42b2-b7f5-ae815b945e7c None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:01.719962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7985a-6f05-42b2-b7f5-ae815b945e7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:01.735043 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d7985a-6f05-42b2-b7f5-ae815b945e7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:35:01.743322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-16d7985a-6f05-42b2-b7f5-ae815b945e7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:35:01.743322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:01.743322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:01.743322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:01.743322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:01.743322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:01.743322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:01.743322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:01.743322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:01.743322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:01.743322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:01.743322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:01.743322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:35:01.743322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:35:01.743322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:35:01.743322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:35:01.744274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:35:01.744274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:35:01.744274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:35:01.744274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:35:01.744274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:01.744274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:01.744274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:01.744274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:01.744274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:01.744274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:01.744274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:01.744274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:01.744274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:01.744274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:01.744274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:01.744274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:01.745121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:01.745121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:01.745121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:01.745121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:01.745121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:35:01.745121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:35:01.745121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:35:01.745121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:35:01.745121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:35:01.745121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:35:01.745121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:35:01.745121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:01.747538 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 368/725] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:35:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:01.754475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf257b-fd3f-4f64-8f48-0f9cc98d0597 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:01.832452 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:01.892824 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf257b-fd3f-4f64-8f48-0f9cc98d0597 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:01.933487 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1baa0-7c8a-4f81-a767-29790dc60d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:01.934164 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1baa0-7c8a-4f81-a767-29790dc60d26 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:01.934445 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1baa0-7c8a-4f81-a767-29790dc60d26 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:01.934772 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1baa0-7c8a-4f81-a767-29790dc60d26 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:01.935545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1baa0-7c8a-4f81-a767-29790dc60d26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:01.935848 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1baa0-7c8a-4f81-a767-29790dc60d26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:01.937305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1baa0-7c8a-4f81-a767-29790dc60d26 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:01.946382 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 358/726] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:35:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:01.952332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7985a-6f05-42b2-b7f5-ae815b945e7c None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:02.070370 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7985a-6f05-42b2-b7f5-ae815b945e7c None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:02.081943 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d273d4-728e-45e7-86e7-141ce549959e None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:02.082232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d273d4-728e-45e7-86e7-141ce549959e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:02.083039 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d273d4-728e-45e7-86e7-141ce549959e None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:02.084681 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 359/727] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:02.089822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f95795-248b-4079-81d8-7134193159b0 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:02.090108 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f95795-248b-4079-81d8-7134193159b0 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:02.090394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f95795-248b-4079-81d8-7134193159b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:02.107252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-60f95795-248b-4079-81d8-7134193159b0 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:02.108463 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-60f95795-248b-4079-81d8-7134193159b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:02.120810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41639335-1b36-4f36-9156-8d4faf5ee0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:02.121666 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41639335-1b36-4f36-9156-8d4faf5ee0ec None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:02.121955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41639335-1b36-4f36-9156-8d4faf5ee0ec None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:02.122227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41639335-1b36-4f36-9156-8d4faf5ee0ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:02.137630 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41639335-1b36-4f36-9156-8d4faf5ee0ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:02.139082 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41639335-1b36-4f36-9156-8d4faf5ee0ec None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:02.174268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-41639335-1b36-4f36-9156-8d4faf5ee0ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:02.174268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:02.174268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:02.174268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:02.174268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:02.174268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:02.174268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:02.174268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:02.174268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:02.174268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:02.174268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:02.174268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:02.174268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:02.174268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:02.174268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:02.175245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:02.175245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:02.175245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:02.175245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:02.175245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:02.175245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:02.175245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:02.175245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:02.175245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:02.175245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:02.175245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:02.175245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:02.175245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:02.175245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:02.175245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:02.175245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:02.175245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:02.176210 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:02.176210 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:02.176210 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:02.176210 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:02.177112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 369/728] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:02.184689 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41639335-1b36-4f36-9156-8d4faf5ee0ec None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:02.204882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:02.230750 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 360/729] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:02 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 20:35:02.303691 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f95795-248b-4079-81d8-7134193159b0 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:02.334128 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41639335-1b36-4f36-9156-8d4faf5ee0ec None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:02.370187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e1647-bb7a-41db-b850-15ab588b5572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:02.370858 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e1647-bb7a-41db-b850-15ab588b5572 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:02.371141 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e1647-bb7a-41db-b850-15ab588b5572 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:02.371450 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e1647-bb7a-41db-b850-15ab588b5572 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:02.372177 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e1647-bb7a-41db-b850-15ab588b5572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:02.372485 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e1647-bb7a-41db-b850-15ab588b5572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:02.373858 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e1647-bb7a-41db-b850-15ab588b5572 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:02.387047 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 370/730] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:02.401446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e1647-bb7a-41db-b850-15ab588b5572 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:02.414891 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:02.508180 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f95795-248b-4079-81d8-7134193159b0 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:02.525027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:02.566480 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd415c-8f25-4063-bc84-52d0a135a861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:02.567969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd415c-8f25-4063-bc84-52d0a135a861 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:02.568362 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd415c-8f25-4063-bc84-52d0a135a861 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:02.568644 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd415c-8f25-4063-bc84-52d0a135a861 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:02.587737 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd415c-8f25-4063-bc84-52d0a135a861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:35:02.595998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-7dcd415c-8f25-4063-bc84-52d0a135a861 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:35:02.595998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:02.595998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:02.595998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:02.595998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:02.595998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:02.595998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:02.595998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:02.595998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:02.595998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:02.595998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:02.595998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:02.595998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:35:02.595998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:35:02.595998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:35:02.595998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:35:02.596958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:35:02.596958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:35:02.596958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:35:02.596958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:35:02.596958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:02.596958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:02.596958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:02.596958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:02.596958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:02.596958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:02.596958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:02.596958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:02.596958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:02.596958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:02.596958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:02.596958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:02.597804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:02.597804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:02.597804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:02.597804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:02.597804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:35:02.597804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:35:02.597804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:35:02.597804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:35:02.597804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:35:02.597804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:35:02.597804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:35:02.597804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:02.599042 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 361/731] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:35:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:02.601019 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e1647-bb7a-41db-b850-15ab588b5572 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:02.609362 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd415c-8f25-4063-bc84-52d0a135a861 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:02.660629 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91f28f-db98-48b1-a85f-e5ff8bcdec93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:02.661996 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91f28f-db98-48b1-a85f-e5ff8bcdec93 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:02.662282 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91f28f-db98-48b1-a85f-e5ff8bcdec93 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:02.662560 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91f28f-db98-48b1-a85f-e5ff8bcdec93 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:02.674735 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91f28f-db98-48b1-a85f-e5ff8bcdec93 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:02.676230 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91f28f-db98-48b1-a85f-e5ff8bcdec93 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:02.698746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-8e91f28f-db98-48b1-a85f-e5ff8bcdec93 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 20:35:02.698746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:02.698746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:02.698746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:02.698746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:02.698746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:02.698746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:02.698746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:02.698746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:02.698746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:02.698746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:02.698746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:02.698746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:35:02.698746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:35:02.698746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:35:02.698746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:35:02.701031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:02.701031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:02.701031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:35:02.701031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:02.701031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:35:02.701031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:02.701031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:02.701031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:02.701031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:02.701031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:02.701031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:02.701031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:02.701031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:02.701031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:02.701031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:02.701031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:02.701031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:02.701031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:02.703320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:02.703320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:02.703320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:35:02.703320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:35:02.703320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:35:02.703320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:35:02.703320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:35:02.703320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:35:02.703320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 20:35:02.703320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:02.713145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 371/732] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:35:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:02.715049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91f28f-db98-48b1-a85f-e5ff8bcdec93 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:02.789155 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd415c-8f25-4063-bc84-52d0a135a861 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:02.798811 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:02.839172 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eae236-8df2-4bb2-9fd4-eca954ad0a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:02.840064 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eae236-8df2-4bb2-9fd4-eca954ad0a81 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:02.840346 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eae236-8df2-4bb2-9fd4-eca954ad0a81 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:02.840624 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eae236-8df2-4bb2-9fd4-eca954ad0a81 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:02.841930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eae236-8df2-4bb2-9fd4-eca954ad0a81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:02.842345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eae236-8df2-4bb2-9fd4-eca954ad0a81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:02.843870 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eae236-8df2-4bb2-9fd4-eca954ad0a81 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:02.844265 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91f28f-db98-48b1-a85f-e5ff8bcdec93 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:02.858692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 362/733] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:35:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:02.860316 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4147f-aeb5-45fd-84c8-b19fa6a37dcc None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:02.860609 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4147f-aeb5-45fd-84c8-b19fa6a37dcc None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:02.860890 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4147f-aeb5-45fd-84c8-b19fa6a37dcc None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:02.862279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 363/734] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:02.865964 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4147f-aeb5-45fd-84c8-b19fa6a37dcc None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:02.890374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:02.904092 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509b55b-6d60-4a8e-9524-467a41357335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:02.905393 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b55b-6d60-4a8e-9524-467a41357335 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:02.905899 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b55b-6d60-4a8e-9524-467a41357335 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:02.906374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b55b-6d60-4a8e-9524-467a41357335 None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:02.907583 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509b55b-6d60-4a8e-9524-467a41357335 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:02.908380 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509b55b-6d60-4a8e-9524-467a41357335 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:02.910172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509b55b-6d60-4a8e-9524-467a41357335 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:02.938253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 372/735] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Jul 19 20:35:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:02.939686 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e420c3-c8da-4e07-aa48-6c5f8fc2bb32 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:02.939978 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e420c3-c8da-4e07-aa48-6c5f8fc2bb32 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:02.940428 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e420c3-c8da-4e07-aa48-6c5f8fc2bb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:02.965219 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-73e420c3-c8da-4e07-aa48-6c5f8fc2bb32 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:02.966437 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-73e420c3-c8da-4e07-aa48-6c5f8fc2bb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:03.003597 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4147f-aeb5-45fd-84c8-b19fa6a37dcc None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:03.052848 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d5f19-f55b-4937-9116-1619b82fb16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:03.054054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d5f19-f55b-4937-9116-1619b82fb16d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:03.054336 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d5f19-f55b-4937-9116-1619b82fb16d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:03.054567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 373/736] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:02 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 20:35:03.054672 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d5f19-f55b-4937-9116-1619b82fb16d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:03.055460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e420c3-c8da-4e07-aa48-6c5f8fc2bb32 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:03.069313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d5f19-f55b-4937-9116-1619b82fb16d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:03.070772 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d5f19-f55b-4937-9116-1619b82fb16d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:03.089329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-bc5d5f19-f55b-4937-9116-1619b82fb16d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:03.089329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:03.089329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:03.089329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:03.089329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:03.089329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:03.089329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:03.089329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:03.089329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:03.089329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:03.089329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:03.089329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:03.089329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:03.089329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:03.089329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:03.090235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:03.090235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:03.090235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:03.090235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:03.090235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:03.090235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:03.090235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:03.090235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:03.090235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:03.090235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:03.090235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:03.090235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:03.090235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:03.090235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:03.090235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:03.090235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:03.090235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:03.091804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:03.091804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:03.091804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:03.091804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:03.091804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 364/737] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:03.091804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e012a-fda6-4fb8-9d82-888d59f09fe2 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:03.092153 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e012a-fda6-4fb8-9d82-888d59f09fe2 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:03.092220 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449e012a-fda6-4fb8-9d82-888d59f09fe2 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:03.097556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 365/738] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:03.097556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e012a-fda6-4fb8-9d82-888d59f09fe2 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:03.119039 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:03.174676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e420c3-c8da-4e07-aa48-6c5f8fc2bb32 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:03.193620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:03.205208 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449e012a-fda6-4fb8-9d82-888d59f09fe2 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:03.211057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9240b74-f2c5-43f8-a0b9-3112f50cba13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:03.211738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9240b74-f2c5-43f8-a0b9-3112f50cba13 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:03.212017 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9240b74-f2c5-43f8-a0b9-3112f50cba13 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:03.212289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9240b74-f2c5-43f8-a0b9-3112f50cba13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:03.240834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee160ff8-75fb-43f4-bc93-86ebac0da507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:03.241441 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee160ff8-75fb-43f4-bc93-86ebac0da507 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:03.241698 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee160ff8-75fb-43f4-bc93-86ebac0da507 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:03.241967 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee160ff8-75fb-43f4-bc93-86ebac0da507 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:03.242685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee160ff8-75fb-43f4-bc93-86ebac0da507 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:03.244084 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee160ff8-75fb-43f4-bc93-86ebac0da507 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:03.257905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 366/739] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jul 19 20:35:03 2022] POST /identity/v3/services => generated 240 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:35:03.259015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee160ff8-75fb-43f4-bc93-86ebac0da507 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:03.288392 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9240b74-f2c5-43f8-a0b9-3112f50cba13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:03.290050 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9240b74-f2c5-43f8-a0b9-3112f50cba13 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:03.387722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:03.408268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 374/740] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:35:03 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 20:35:03.409673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fd8ae-8fed-4c38-894e-a81f6ff721c2 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:03.410087 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fd8ae-8fed-4c38-894e-a81f6ff721c2 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:03.410725 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fd8ae-8fed-4c38-894e-a81f6ff721c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:03.429365 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-056fd8ae-8fed-4c38-894e-a81f6ff721c2 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:03.430738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-056fd8ae-8fed-4c38-894e-a81f6ff721c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:03.431887 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee160ff8-75fb-43f4-bc93-86ebac0da507 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:03.446768 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:03.486949 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfde59-fff4-440d-8237-3eeece226a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:03.487684 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfde59-fff4-440d-8237-3eeece226a52 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:03.487951 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfde59-fff4-440d-8237-3eeece226a52 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:03.488225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfde59-fff4-440d-8237-3eeece226a52 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:03.489546 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfde59-fff4-440d-8237-3eeece226a52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:03.490229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfde59-fff4-440d-8237-3eeece226a52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:03.494116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bfde59-fff4-440d-8237-3eeece226a52 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:03.508202 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 367/741] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:03.509253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfde59-fff4-440d-8237-3eeece226a52 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:03.531303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 375/742] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:03.531303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fd8ae-8fed-4c38-894e-a81f6ff721c2 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:03.628662 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bfde59-fff4-440d-8237-3eeece226a52 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:03.642698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fd8ae-8fed-4c38-894e-a81f6ff721c2 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:03.673051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67faff-7308-439e-9a5b-465b5180e2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:03.674694 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67faff-7308-439e-9a5b-465b5180e2c4 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:03.675135 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67faff-7308-439e-9a5b-465b5180e2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:03.675573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67faff-7308-439e-9a5b-465b5180e2c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:03.678591 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:03.679908 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01929d2b-7915-4ed3-bdeb-4409e19f83ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:03.681093 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01929d2b-7915-4ed3-bdeb-4409e19f83ab None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:03.681677 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01929d2b-7915-4ed3-bdeb-4409e19f83ab None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:03.682106 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01929d2b-7915-4ed3-bdeb-4409e19f83ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:03.688183 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67faff-7308-439e-9a5b-465b5180e2c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:03.689644 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67faff-7308-439e-9a5b-465b5180e2c4 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:03.691504 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01929d2b-7915-4ed3-bdeb-4409e19f83ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:03.693908 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01929d2b-7915-4ed3-bdeb-4409e19f83ab None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:03.709695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-01929d2b-7915-4ed3-bdeb-4409e19f83ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 20:35:03.709695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:03.709695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:03.709695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:03.709695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:03.709695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:03.709695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:03.709695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:03.709695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:03.709695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:03.709695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:03.709695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:03.709695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:35:03.709695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:35:03.709695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:35:03.709695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:35:03.710705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:03.710705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:03.710705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:35:03.710705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:03.710705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:35:03.710705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:03.710705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:03.710705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:03.710705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:03.710705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:03.710705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:03.710705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:03.710705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:03.710705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:03.710705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:03.710705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:03.710705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:03.710705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:03.711723 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:03.711723 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:03.711723 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:35:03.711723 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:35:03.711723 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:35:03.711723 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:35:03.711723 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:35:03.711723 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:35:03.711723 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 20:35:03.711723 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:03.712266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-bb67faff-7308-439e-9a5b-465b5180e2c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:03.712266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:03.712266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:03.712266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:03.712266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:03.712266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:03.712266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:03.712266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:03.712266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:03.712266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:03.712266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:03.712266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:03.712266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:03.712266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:03.712266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:03.713079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:03.713079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:03.713079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:03.713079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:03.713079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:03.713079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:03.713079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:03.713079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:03.713079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:03.713079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:03.713079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:03.713079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:03.713079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:03.713079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:03.713079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:03.713079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:03.713079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:03.713997 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:03.713997 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:03.713997 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:03.713997 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:03.715118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 368/743] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:03.715764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67faff-7308-439e-9a5b-465b5180e2c4 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:03.717075 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 376/744] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Jul 19 20:35:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:03.720152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01929d2b-7915-4ed3-bdeb-4409e19f83ab None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:03.735638 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:03.850891 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01929d2b-7915-4ed3-bdeb-4409e19f83ab None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:03.854685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67faff-7308-439e-9a5b-465b5180e2c4 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:03.897644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6040f27-ca4e-41f9-a3d5-e1ac364213e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:03.897644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6040f27-ca4e-41f9-a3d5-e1ac364213e9 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:03.897644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6040f27-ca4e-41f9-a3d5-e1ac364213e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:03.899715 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6040f27-ca4e-41f9-a3d5-e1ac364213e9 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:03.900473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6040f27-ca4e-41f9-a3d5-e1ac364213e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:03.900787 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6040f27-ca4e-41f9-a3d5-e1ac364213e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:03.901314 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ee9cf-eac7-46a9-b8a2-24fc48a650e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:03.902162 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6040f27-ca4e-41f9-a3d5-e1ac364213e9 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:03.902599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ee9cf-eac7-46a9-b8a2-24fc48a650e5 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:03.903088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ee9cf-eac7-46a9-b8a2-24fc48a650e5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:03.903597 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ee9cf-eac7-46a9-b8a2-24fc48a650e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:03.915960 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ee9cf-eac7-46a9-b8a2-24fc48a650e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:35:03.917467 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 377/745] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:03.918301 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6040f27-ca4e-41f9-a3d5-e1ac364213e9 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:03.925337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-db7ee9cf-eac7-46a9-b8a2-24fc48a650e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:35:03.925337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:03.925337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:03.925337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:03.925337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:03.925337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:03.925337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:03.925337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:03.925337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:03.925337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:03.925337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:03.925337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:03.925337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:35:03.925337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:35:03.925337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:35:03.925337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:35:03.926329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:35:03.926329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:35:03.926329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:35:03.926329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:35:03.926329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:03.926329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:03.926329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:03.926329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:03.926329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:03.926329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:03.926329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:03.926329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:03.926329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:03.926329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:03.926329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:03.926329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:03.927211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:03.927211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:03.927211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:03.927211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:03.927211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:35:03.927211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:35:03.927211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:35:03.927211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:35:03.927211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:35:03.927211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:35:03.927211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:35:03.927211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:03.930014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 369/746] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:35:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:03.931094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ee9cf-eac7-46a9-b8a2-24fc48a650e5 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:03.995346 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:03.998365 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:04.036962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6040f27-ca4e-41f9-a3d5-e1ac364213e9 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:04.060612 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ee9cf-eac7-46a9-b8a2-24fc48a650e5 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:04.073234 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09871a3c-3c12-4445-a47d-89794134410c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:04.074214 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09871a3c-3c12-4445-a47d-89794134410c None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:04.074696 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09871a3c-3c12-4445-a47d-89794134410c None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:04.075171 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09871a3c-3c12-4445-a47d-89794134410c None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:04.076235 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09871a3c-3c12-4445-a47d-89794134410c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:04.076758 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09871a3c-3c12-4445-a47d-89794134410c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:04.078353 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09871a3c-3c12-4445-a47d-89794134410c None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:04.096191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6182a86-98d4-4e93-a6f4-02fe18a30e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:04.100880 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 378/747] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Jul 19 20:35:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:04.101025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6182a86-98d4-4e93-a6f4-02fe18a30e01 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:04.101025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6182a86-98d4-4e93-a6f4-02fe18a30e01 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:04.101025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6182a86-98d4-4e93-a6f4-02fe18a30e01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:04.101307 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09871a3c-3c12-4445-a47d-89794134410c None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:04.108231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6182a86-98d4-4e93-a6f4-02fe18a30e01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:04.109667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6182a86-98d4-4e93-a6f4-02fe18a30e01 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:04.125475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-f6182a86-98d4-4e93-a6f4-02fe18a30e01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:04.125475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:04.125475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:04.125475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:04.125475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:04.125475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:04.125475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:04.125475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:04.125475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:04.125475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:04.125475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:04.125475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:04.125475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:35:04.125475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:35:04.125475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:35:04.126411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:35:04.126411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:04.126411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:04.126411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:04.126411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:04.126411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:04.126411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:04.126411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:04.126411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:04.126411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:04.126411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:04.126411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:04.126411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:04.126411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:04.126411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:04.126411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:04.126411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:04.127342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:35:04.127342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:35:04.127342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:35:04.127342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:35:04.127342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:35:04.127342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:35:04.127342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:04.127342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:04.127342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 370/748] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:35:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:04.128422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54a433-2d3a-450b-8267-8216c4f38974 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:04.128422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54a433-2d3a-450b-8267-8216c4f38974 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:04.128422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54a433-2d3a-450b-8267-8216c4f38974 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:04.129991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 371/749] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:04.130567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54a433-2d3a-450b-8267-8216c4f38974 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:04.214629 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09871a3c-3c12-4445-a47d-89794134410c None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:04.234246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54a433-2d3a-450b-8267-8216c4f38974 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:04.240717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:04.244211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:04.252006 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87e2e4-fb0c-4fe2-8e92-97cfbc808e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:04.252673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87e2e4-fb0c-4fe2-8e92-97cfbc808e73 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:04.252952 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87e2e4-fb0c-4fe2-8e92-97cfbc808e73 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:04.253222 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87e2e4-fb0c-4fe2-8e92-97cfbc808e73 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:04.253962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87e2e4-fb0c-4fe2-8e92-97cfbc808e73 None admin] RBAC: Adding query filter params (name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:04.254284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87e2e4-fb0c-4fe2-8e92-97cfbc808e73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:04.255728 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87e2e4-fb0c-4fe2-8e92-97cfbc808e73 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:04.268735 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 379/750] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jul 19 20:35:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:04.269596 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87e2e4-fb0c-4fe2-8e92-97cfbc808e73 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:04.272371 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5870b8-07b9-4133-a5bd-2d697f17e7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:04.273167 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5870b8-07b9-4133-a5bd-2d697f17e7dd None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:04.273455 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5870b8-07b9-4133-a5bd-2d697f17e7dd None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:04.273733 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5870b8-07b9-4133-a5bd-2d697f17e7dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:04.283923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5870b8-07b9-4133-a5bd-2d697f17e7dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:04.285353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5870b8-07b9-4133-a5bd-2d697f17e7dd None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:04.304141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-dd5870b8-07b9-4133-a5bd-2d697f17e7dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:04.304141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:04.304141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:04.304141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:04.304141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:04.304141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:04.304141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:04.304141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:04.304141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:04.304141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:04.304141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:04.304141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:04.304141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:04.304141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:04.304141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:04.305041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:04.305041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:04.305041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:04.305041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:04.305041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:04.305041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:04.305041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:04.305041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:04.305041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:04.305041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:04.305041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:04.305041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:04.305041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:04.305041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:04.305041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:04.305041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:04.305041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:04.305927 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:04.305927 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:04.305927 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:04.305927 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:04.305927 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 372/751] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:04.306622 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7710a7-9f8a-4031-8303-5c6bafe176f9 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:04.306773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7710a7-9f8a-4031-8303-5c6bafe176f9 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:04.307055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7710a7-9f8a-4031-8303-5c6bafe176f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:04.326472 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-7a7710a7-9f8a-4031-8303-5c6bafe176f9 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:04.327721 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7a7710a7-9f8a-4031-8303-5c6bafe176f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:04.392372 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87e2e4-fb0c-4fe2-8e92-97cfbc808e73 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:04.403154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 373/752] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:04.403154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7710a7-9f8a-4031-8303-5c6bafe176f9 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:04.449174 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736c1b0-5d12-4d6d-bc15-59c40dd7f4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:04.449856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736c1b0-5d12-4d6d-bc15-59c40dd7f4ab None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:04.450146 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736c1b0-5d12-4d6d-bc15-59c40dd7f4ab None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:04.450425 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736c1b0-5d12-4d6d-bc15-59c40dd7f4ab None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:04.451229 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736c1b0-5d12-4d6d-bc15-59c40dd7f4ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:04.451572 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736c1b0-5d12-4d6d-bc15-59c40dd7f4ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:04.453454 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736c1b0-5d12-4d6d-bc15-59c40dd7f4ab None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:04.468158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 380/753] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:35:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:04.468798 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736c1b0-5d12-4d6d-bc15-59c40dd7f4ab None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:04.513544 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:04.522586 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:04.525314 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7710a7-9f8a-4031-8303-5c6bafe176f9 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:04.563215 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa01296-b275-41b4-8c8b-57033de0d0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:04.564040 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa01296-b275-41b4-8c8b-57033de0d0a5 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:04.564324 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa01296-b275-41b4-8c8b-57033de0d0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:04.564599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa01296-b275-41b4-8c8b-57033de0d0a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:04.575695 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa01296-b275-41b4-8c8b-57033de0d0a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:04.577132 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa01296-b275-41b4-8c8b-57033de0d0a5 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:04.580905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736c1b0-5d12-4d6d-bc15-59c40dd7f4ab None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:04.595668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-9aa01296-b275-41b4-8c8b-57033de0d0a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:04.595668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:04.595668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:04.595668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:04.595668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:04.595668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:04.595668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:04.595668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:04.595668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:04.595668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:04.595668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:04.595668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:04.595668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:04.595668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:04.595668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:04.596584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:04.596584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:04.596584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:04.596584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:04.596584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:04.596584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:04.596584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:04.596584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:04.596584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:04.596584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:04.596584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:04.596584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:04.596584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:04.596584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:04.596584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:04.596584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:04.596584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:04.597512 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:04.597512 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:04.597512 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:04.597512 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:04.597512 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 374/754] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:04.597796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa01296-b275-41b4-8c8b-57033de0d0a5 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:04.624239 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6f26a-6669-4fff-b632-079c0c005e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:04.625328 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6f26a-6669-4fff-b632-079c0c005e8b None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:04.625811 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6f26a-6669-4fff-b632-079c0c005e8b None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:04.626163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6f26a-6669-4fff-b632-079c0c005e8b None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:04.626895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6f26a-6669-4fff-b632-079c0c005e8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:04.627324 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6f26a-6669-4fff-b632-079c0c005e8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:04.628803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6f26a-6669-4fff-b632-079c0c005e8b None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:04.645859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 381/755] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:04.645859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6f26a-6669-4fff-b632-079c0c005e8b None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:04.709159 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa01296-b275-41b4-8c8b-57033de0d0a5 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:04.745404 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a499cc4-44e3-45ad-871c-f14f96da522a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:04.746167 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a499cc4-44e3-45ad-871c-f14f96da522a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:04.746445 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a499cc4-44e3-45ad-871c-f14f96da522a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:04.746720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a499cc4-44e3-45ad-871c-f14f96da522a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:04.747437 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a499cc4-44e3-45ad-871c-f14f96da522a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:04.748787 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a499cc4-44e3-45ad-871c-f14f96da522a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:04.758908 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6f26a-6669-4fff-b632-079c0c005e8b None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:04.761186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-4a499cc4-44e3-45ad-871c-f14f96da522a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 20:35:04.761186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:04.761186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:35:04.761186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:35:04.761186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:35:04.761186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:35:04.761186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:35:04.761186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:04.761186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 20:35:04.761186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:04.761186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:04.761186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:04.761186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:04.761186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:04.761186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:04.761186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:04.762112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:04.762112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:04.762112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:04.762112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:04.762112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:04.762112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:04.762112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:04.762112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:35:04.762112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:35:04.762112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:35:04.762112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:35:04.762112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:04.762112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:04.762112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:04.762112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:04.762112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:04.762984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:04.762984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:04.762984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:04.762984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:04.762984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:04.762984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:04.762984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:04.762984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:04.762984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:04.762984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:04.762984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:04.762984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:35:04.762984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:04.762984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 20:35:04.762984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:04.762984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 375/756] 10.222.0.77 () {56 vars in 1129 bytes} [Tue Jul 19 20:35:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:04.764349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a499cc4-44e3-45ad-871c-f14f96da522a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:04.771731 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:04.777450 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:04.801952 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab0b4a-08c5-4d2c-8aac-41ab6d9ab887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:04.802615 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab0b4a-08c5-4d2c-8aac-41ab6d9ab887 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:04.802903 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab0b4a-08c5-4d2c-8aac-41ab6d9ab887 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:04.803174 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab0b4a-08c5-4d2c-8aac-41ab6d9ab887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:04.804304 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab0b4a-08c5-4d2c-8aac-41ab6d9ab887 None admin] RBAC: Adding query filter params (role.id=b30f01ef95004a1b84fc029830bdf053, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=7987846276ad4ccd90899128ceb1354e) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:04.804429 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab0b4a-08c5-4d2c-8aac-41ab6d9ab887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:04.806172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab0b4a-08c5-4d2c-8aac-41ab6d9ab887 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:04.819425 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 382/757] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:35:04 2022] GET /identity/v3/role_assignments?user.id=7987846276ad4ccd90899128ceb1354e&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=b30f01ef95004a1b84fc029830bdf053 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:04.819425 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab0b4a-08c5-4d2c-8aac-41ab6d9ab887 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:04.884526 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a499cc4-44e3-45ad-871c-f14f96da522a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:04.925963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f7a75-f650-426e-9909-9041405a7975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:04.926753 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f7a75-f650-426e-9909-9041405a7975 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:04.927035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f7a75-f650-426e-9909-9041405a7975 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:04.927352 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f7a75-f650-426e-9909-9041405a7975 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:04.928089 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f7a75-f650-426e-9909-9041405a7975 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:04.928398 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f7a75-f650-426e-9909-9041405a7975 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:04.929779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f7a75-f650-426e-9909-9041405a7975 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:04.948102 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 376/758] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:04.949126 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f7a75-f650-426e-9909-9041405a7975 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:04.958196 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab0b4a-08c5-4d2c-8aac-41ab6d9ab887 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:05.007488 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faab484-b08c-4223-8cf9-56b779e5cef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:05.008224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faab484-b08c-4223-8cf9-56b779e5cef3 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:05.008509 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faab484-b08c-4223-8cf9-56b779e5cef3 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:05.008785 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faab484-b08c-4223-8cf9-56b779e5cef3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:05.016530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faab484-b08c-4223-8cf9-56b779e5cef3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:05.018006 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faab484-b08c-4223-8cf9-56b779e5cef3 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:05.023225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:05.035187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-0faab484-b08c-4223-8cf9-56b779e5cef3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:05.035187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:05.035187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:05.035187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:05.035187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:05.035187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:05.035187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:05.035187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:05.035187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:05.035187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:05.035187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:05.035187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:05.035187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:35:05.035187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:35:05.035187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:35:05.036697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:35:05.036697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:05.036697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:05.036697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:05.036697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:05.036697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:05.036697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:05.036697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:05.036697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:05.036697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:05.036697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:05.036697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:05.036697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:05.036697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:05.036697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:05.036697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:05.036697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:05.037835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:35:05.037835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:35:05.037835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:35:05.037835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:35:05.037835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:35:05.037835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:35:05.037835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:05.037835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:05.039965 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 383/759] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:35:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:05.040899 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faab484-b08c-4223-8cf9-56b779e5cef3 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:05.069178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f7a75-f650-426e-9909-9041405a7975 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:05.078338 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:05.108539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7157f7b-4d9a-4994-a23a-b0d32a0914e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:05.109584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7157f7b-4d9a-4994-a23a-b0d32a0914e7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:05.110139 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7157f7b-4d9a-4994-a23a-b0d32a0914e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:05.110654 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7157f7b-4d9a-4994-a23a-b0d32a0914e7 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:05.111607 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7157f7b-4d9a-4994-a23a-b0d32a0914e7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:05.112289 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7157f7b-4d9a-4994-a23a-b0d32a0914e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:05.114526 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7157f7b-4d9a-4994-a23a-b0d32a0914e7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:05.120147 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 377/760] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Jul 19 20:35:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:05.121200 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7157f7b-4d9a-4994-a23a-b0d32a0914e7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:05.155572 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faab484-b08c-4223-8cf9-56b779e5cef3 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:05.193925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c6a17-6a54-4dec-8071-62a3eb6bfe01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:05.194801 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c6a17-6a54-4dec-8071-62a3eb6bfe01 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:05.195134 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c6a17-6a54-4dec-8071-62a3eb6bfe01 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:05.195444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c6a17-6a54-4dec-8071-62a3eb6bfe01 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:05.203689 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c6a17-6a54-4dec-8071-62a3eb6bfe01 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:05.205221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c6a17-6a54-4dec-8071-62a3eb6bfe01 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:05.222737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-a33c6a17-6a54-4dec-8071-62a3eb6bfe01 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 20:35:05.222737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:05.222737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:05.222737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:05.222737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:05.222737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:05.222737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:05.222737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:05.222737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:05.222737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:05.222737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:05.222737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:05.222737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:35:05.222737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:35:05.222737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:35:05.222737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:35:05.224739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:05.224739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:05.224739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:35:05.224739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:05.224739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:35:05.224739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:05.224739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:05.224739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:05.224739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:05.224739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:05.224739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:05.224739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:05.224739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:05.224739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:05.224739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:05.224739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:05.224739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:05.224739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:05.225705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:05.225705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:05.225705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:35:05.225705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:35:05.225705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:35:05.225705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:35:05.225705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:35:05.225705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:35:05.225705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 20:35:05.225705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:05.225705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 384/761] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Jul 19 20:35:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:05.229893 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c6a17-6a54-4dec-8071-62a3eb6bfe01 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:05.234771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7157f7b-4d9a-4994-a23a-b0d32a0914e7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:05.266437 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:05.273714 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d67a1f-6483-435a-a99e-14bff28a6875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:05.274688 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d67a1f-6483-435a-a99e-14bff28a6875 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:05.275191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d67a1f-6483-435a-a99e-14bff28a6875 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:05.275795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d67a1f-6483-435a-a99e-14bff28a6875 None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:05.276828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d67a1f-6483-435a-a99e-14bff28a6875 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:05.277345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d67a1f-6483-435a-a99e-14bff28a6875 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:05.279130 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d67a1f-6483-435a-a99e-14bff28a6875 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:05.293083 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 378/762] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:35:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:05.294220 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d67a1f-6483-435a-a99e-14bff28a6875 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:05.337991 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:05.348712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c6a17-6a54-4dec-8071-62a3eb6bfe01 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:05.385704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97949167-dc01-4168-81c6-9c497f89465a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:05.386430 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97949167-dc01-4168-81c6-9c497f89465a None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:05.386718 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97949167-dc01-4168-81c6-9c497f89465a None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:05.386995 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97949167-dc01-4168-81c6-9c497f89465a None admin] PATH_INFO: `/v3/services` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:05.387859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97949167-dc01-4168-81c6-9c497f89465a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:05.388170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97949167-dc01-4168-81c6-9c497f89465a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:05.389649 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97949167-dc01-4168-81c6-9c497f89465a None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:05.395493 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 385/763] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Jul 19 20:35:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:05.396555 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97949167-dc01-4168-81c6-9c497f89465a None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:05.409297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d67a1f-6483-435a-a99e-14bff28a6875 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:05.447355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2858cca-b177-4df4-94ab-45150c8118dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:05.448274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2858cca-b177-4df4-94ab-45150c8118dc None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:05.448718 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2858cca-b177-4df4-94ab-45150c8118dc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:05.449214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2858cca-b177-4df4-94ab-45150c8118dc None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:05.450342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2858cca-b177-4df4-94ab-45150c8118dc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:05.450804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2858cca-b177-4df4-94ab-45150c8118dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:05.452549 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2858cca-b177-4df4-94ab-45150c8118dc None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:05.472551 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 379/764] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Jul 19 20:35:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:05.474079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2858cca-b177-4df4-94ab-45150c8118dc None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:05.508891 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97949167-dc01-4168-81c6-9c497f89465a None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:05.525367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:05.545079 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cca97e-c538-4362-86a8-cd2b77657da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:05.545994 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cca97e-c538-4362-86a8-cd2b77657da6 None admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:05.546414 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cca97e-c538-4362-86a8-cd2b77657da6 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:05.546694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cca97e-c538-4362-86a8-cd2b77657da6 None admin] PATH_INFO: `/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/6dbbb8f7b3f2449fb9c64ca3815b6c1b/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:05.549094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cca97e-c538-4362-86a8-cd2b77657da6 None admin] RBAC: Authorizing `identity:create_grant(project_id=327868f4f62e4e4a9c5bef4acd32fb29, user_id=6dbbb8f7b3f2449fb9c64ca3815b6c1b, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:05.550427 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cca97e-c538-4362-86a8-cd2b77657da6 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:05.564107 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 386/765] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:35:05 2022] PUT /identity/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/6dbbb8f7b3f2449fb9c64ca3815b6c1b/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:35:05.565479 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690278c3-b9dd-4fd8-85e1-168984fb506b None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:05.565770 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690278c3-b9dd-4fd8-85e1-168984fb506b None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:05.566049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690278c3-b9dd-4fd8-85e1-168984fb506b None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:05.571482 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 387/766] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:05.571482 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690278c3-b9dd-4fd8-85e1-168984fb506b None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:05.592254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:05.596325 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2858cca-b177-4df4-94ab-45150c8118dc None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:05.639810 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bf2e4-d837-4de3-9661-7b20e91f9273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:05.640592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bf2e4-d837-4de3-9661-7b20e91f9273 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:05.640879 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bf2e4-d837-4de3-9661-7b20e91f9273 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:05.641198 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bf2e4-d837-4de3-9661-7b20e91f9273 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:05.642008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1bf2e4-d837-4de3-9661-7b20e91f9273 None admin] RBAC: Adding query filter params (interface=public, service_id=6a1012f412b940e399646c691f7119d0, region_id=RegionOne) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:05.642372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1bf2e4-d837-4de3-9661-7b20e91f9273 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:05.644118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1bf2e4-d837-4de3-9661-7b20e91f9273 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:05.653837 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 380/767] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Jul 19 20:35:05 2022] GET /identity/v3/endpoints?service_id=6a1012f412b940e399646c691f7119d0&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:05.655651 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e02b32-d9a0-48c0-8bf9-08fff7802fef None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:05.655942 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e02b32-d9a0-48c0-8bf9-08fff7802fef None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:05.656223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e02b32-d9a0-48c0-8bf9-08fff7802fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:05.678669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-73e02b32-d9a0-48c0-8bf9-08fff7802fef None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:05.680860 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-73e02b32-d9a0-48c0-8bf9-08fff7802fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:05.701252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690278c3-b9dd-4fd8-85e1-168984fb506b None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:05.747451 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3eb39-b6e1-4d12-822d-ccd3b5ff2b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:05.748829 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3eb39-b6e1-4d12-822d-ccd3b5ff2b26 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:05.749644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3eb39-b6e1-4d12-822d-ccd3b5ff2b26 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:05.749930 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3eb39-b6e1-4d12-822d-ccd3b5ff2b26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:05.768412 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 381/768] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:05.769551 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e02b32-d9a0-48c0-8bf9-08fff7802fef None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:05.823831 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:05.843345 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3eb39-b6e1-4d12-822d-ccd3b5ff2b26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:05.844806 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3eb39-b6e1-4d12-822d-ccd3b5ff2b26 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:05.862767 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:05.897158 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e02b32-d9a0-48c0-8bf9-08fff7802fef None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:05.943569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d934e-5548-44c1-a892-abfdfc55c127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:05.944386 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d934e-5548-44c1-a892-abfdfc55c127 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:05.944810 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d934e-5548-44c1-a892-abfdfc55c127 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:05.945088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d934e-5548-44c1-a892-abfdfc55c127 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:05.945777 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d934e-5548-44c1-a892-abfdfc55c127 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:05.947567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d934e-5548-44c1-a892-abfdfc55c127 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:05.953361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 382/769] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Jul 19 20:35:05 2022] GET /identity/v3/services => generated 772 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:05.954275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d934e-5548-44c1-a892-abfdfc55c127 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:05.961104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 388/770] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:35:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 20:35:05.970246 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3eb39-b6e1-4d12-822d-ccd3b5ff2b26 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:06.156630 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d934e-5548-44c1-a892-abfdfc55c127 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:06.167488 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3eb39-b6e1-4d12-822d-ccd3b5ff2b26 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:06.168613 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:06.191491 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:06.206680 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358e244-76f2-45f9-b7d6-de5f98f881a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:06.207647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e244-76f2-45f9-b7d6-de5f98f881a8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:06.208477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e244-76f2-45f9-b7d6-de5f98f881a8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:06.208758 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358e244-76f2-45f9-b7d6-de5f98f881a8 None admin] PATH_INFO: `/v3/services/network` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:06.209432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358e244-76f2-45f9-b7d6-de5f98f881a8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:06.210806 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358e244-76f2-45f9-b7d6-de5f98f881a8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:06.222451 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8044545-f2b6-4b75-a869-4d001acd50f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:06.223662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8044545-f2b6-4b75-a869-4d001acd50f1 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:06.224622 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8044545-f2b6-4b75-a869-4d001acd50f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:06.225126 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8044545-f2b6-4b75-a869-4d001acd50f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:06.227055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-b358e244-76f2-45f9-b7d6-de5f98f881a8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 20:35:06.227055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:06.227055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:35:06.227055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:35:06.227055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:35:06.227055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:35:06.227055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:35:06.227055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:06.227055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 20:35:06.227055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:06.227055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:06.227055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:06.227055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:06.227055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:06.227055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:06.227055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:06.227055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:06.228065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:06.228065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:06.228065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:06.228065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:06.228065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:06.228065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:06.228065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:35:06.228065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:35:06.228065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:35:06.228065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:35:06.228065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:06.228065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:06.228065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:06.228065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:06.228065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:06.228065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:06.228977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:06.228977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:06.228977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:06.228977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:06.228977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:06.228977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:06.228977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:06.228977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:06.228977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:06.228977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:06.228977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:35:06.228977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:06.228977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 20:35:06.228977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:06.228977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 383/771] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:35:05 2022] GET /identity/v3/services/network => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:06.236692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358e244-76f2-45f9-b7d6-de5f98f881a8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:06.241907 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8044545-f2b6-4b75-a869-4d001acd50f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:06.243589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8044545-f2b6-4b75-a869-4d001acd50f1 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:06.265376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-e8044545-f2b6-4b75-a869-4d001acd50f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:06.265376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:06.265376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:06.265376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:06.265376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:06.265376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:06.265376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:06.265376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:06.265376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:06.265376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:06.265376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:06.265376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:06.265376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:06.265376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:06.265376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:06.266492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:06.266492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:06.266492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:06.266492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:06.266492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:06.266492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:06.266492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:06.266492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:06.266492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:06.266492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:06.266492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:06.266492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:06.266492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:06.266492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:06.266492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:06.266492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:06.266492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:06.267659 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:06.267659 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:06.267659 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:06.267659 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:06.270021 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 389/772] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:06.276173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8044545-f2b6-4b75-a869-4d001acd50f1 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:06.432299 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358e244-76f2-45f9-b7d6-de5f98f881a8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:06.464340 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8044545-f2b6-4b75-a869-4d001acd50f1 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:06.484146 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb768f63-6e2f-4e5c-bac5-26c9a5840a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:06.484817 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb768f63-6e2f-4e5c-bac5-26c9a5840a07 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:06.485098 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb768f63-6e2f-4e5c-bac5-26c9a5840a07 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:06.485371 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb768f63-6e2f-4e5c-bac5-26c9a5840a07 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:06.486188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb768f63-6e2f-4e5c-bac5-26c9a5840a07 None admin] RBAC: Adding query filter params (name=network) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:06.486502 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb768f63-6e2f-4e5c-bac5-26c9a5840a07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:06.487909 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb768f63-6e2f-4e5c-bac5-26c9a5840a07 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:06.493041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 384/773] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jul 19 20:35:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:06.498400 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb768f63-6e2f-4e5c-bac5-26c9a5840a07 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:06.545313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:06.556047 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ff13e-6636-42ac-8d37-d8feb5d414bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:06.556830 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ff13e-6636-42ac-8d37-d8feb5d414bb None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:06.557182 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ff13e-6636-42ac-8d37-d8feb5d414bb None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:06.557536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ff13e-6636-42ac-8d37-d8feb5d414bb None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:06.558438 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ff13e-6636-42ac-8d37-d8feb5d414bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:06.558817 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ff13e-6636-42ac-8d37-d8feb5d414bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:06.561525 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ff13e-6636-42ac-8d37-d8feb5d414bb None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:06.586766 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 390/774] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:06.596220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ff13e-6636-42ac-8d37-d8feb5d414bb None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:06.617875 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb768f63-6e2f-4e5c-bac5-26c9a5840a07 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:06.643925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:06.658086 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca174069-5719-4291-a32c-944bbebb81cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:06.659132 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca174069-5719-4291-a32c-944bbebb81cc None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:06.659883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca174069-5719-4291-a32c-944bbebb81cc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:06.660380 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca174069-5719-4291-a32c-944bbebb81cc None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:06.662094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca174069-5719-4291-a32c-944bbebb81cc None admin] RBAC: Adding query filter params (type=network) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:06.662623 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca174069-5719-4291-a32c-944bbebb81cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:06.665128 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca174069-5719-4291-a32c-944bbebb81cc None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:06.671631 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 385/775] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jul 19 20:35:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:06.678040 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca174069-5719-4291-a32c-944bbebb81cc None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:06.822365 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ff13e-6636-42ac-8d37-d8feb5d414bb None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:06.849045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca174069-5719-4291-a32c-944bbebb81cc None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:06.851558 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:06.889712 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902eac28-c380-4d9b-a431-5b96fd96b178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:06.890391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902eac28-c380-4d9b-a431-5b96fd96b178 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:06.890680 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902eac28-c380-4d9b-a431-5b96fd96b178 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:06.890961 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902eac28-c380-4d9b-a431-5b96fd96b178 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:06.891797 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902eac28-c380-4d9b-a431-5b96fd96b178 None admin] RBAC: Adding query filter params (interface=public, service_id=40d1fb5f82f94dd7bf41fcee1d13a5a3, region_id=RegionOne) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:06.892115 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902eac28-c380-4d9b-a431-5b96fd96b178 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:06.893482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902eac28-c380-4d9b-a431-5b96fd96b178 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:06.900265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 386/776] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Jul 19 20:35:06 2022] GET /identity/v3/endpoints?service_id=40d1fb5f82f94dd7bf41fcee1d13a5a3&interface=public®ion_id=RegionOne => generated 194 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:06.905589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902eac28-c380-4d9b-a431-5b96fd96b178 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:06.925870 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b56ee-9a89-46dd-9b1e-e25d56531abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:06.927245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b56ee-9a89-46dd-9b1e-e25d56531abc None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:06.927550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b56ee-9a89-46dd-9b1e-e25d56531abc None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:06.927823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b56ee-9a89-46dd-9b1e-e25d56531abc None admin] PATH_INFO: `/v3/projects/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:06.938478 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b56ee-9a89-46dd-9b1e-e25d56531abc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:06.939956 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b56ee-9a89-46dd-9b1e-e25d56531abc None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:06.968543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-a10b56ee-9a89-46dd-9b1e-e25d56531abc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:06.968543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:06.968543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:06.968543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:06.968543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:06.968543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:06.968543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:06.968543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:06.968543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:06.968543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:06.968543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:06.968543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:06.968543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:35:06.968543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:35:06.968543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:35:06.969470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:35:06.969470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:06.969470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:06.969470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:06.969470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:06.969470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:06.969470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:06.969470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:06.969470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:06.969470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:06.969470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:06.969470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:06.969470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:06.969470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:06.969470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:06.969470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:06.969470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:06.970388 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:35:06.970388 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:35:06.970388 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:35:06.970388 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:35:06.970388 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:35:06.970388 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:35:06.970388 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:06.970388 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:06.970388 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 391/777] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:35:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:06.976218 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b56ee-9a89-46dd-9b1e-e25d56531abc None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:07.100919 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902eac28-c380-4d9b-a431-5b96fd96b178 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:07.123806 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:07.128983 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b56ee-9a89-46dd-9b1e-e25d56531abc None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:07.173380 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901da6dd-cbc7-423f-a4b3-4037c963a222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:07.174046 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901da6dd-cbc7-423f-a4b3-4037c963a222 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:07.174329 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901da6dd-cbc7-423f-a4b3-4037c963a222 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:07.174604 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901da6dd-cbc7-423f-a4b3-4037c963a222 None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:07.175412 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901da6dd-cbc7-423f-a4b3-4037c963a222 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:07.175726 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901da6dd-cbc7-423f-a4b3-4037c963a222 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:07.177711 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901da6dd-cbc7-423f-a4b3-4037c963a222 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:07.181122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0401316-0c0f-42a9-bde7-62ad95acf715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:07.182041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0401316-0c0f-42a9-bde7-62ad95acf715 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:07.182549 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0401316-0c0f-42a9-bde7-62ad95acf715 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:07.183035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0401316-0c0f-42a9-bde7-62ad95acf715 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:07.183956 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0401316-0c0f-42a9-bde7-62ad95acf715 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:07.186088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0401316-0c0f-42a9-bde7-62ad95acf715 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:07.190223 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 392/778] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:35:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:07.191587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0fe82-79af-453a-8fba-605ac0332775 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:07.191878 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0fe82-79af-453a-8fba-605ac0332775 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:07.192735 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0fe82-79af-453a-8fba-605ac0332775 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:07.198245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 393/779] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:07.198245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0fe82-79af-453a-8fba-605ac0332775 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:07.198879 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 387/780] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Jul 19 20:35:06 2022] GET /identity/v3/services => generated 772 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:07.200416 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a41b02-4d22-4d71-af22-dce888ed293f None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:07.200924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a41b02-4d22-4d71-af22-dce888ed293f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:07.201412 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a41b02-4d22-4d71-af22-dce888ed293f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:07.221843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-22a41b02-4d22-4d71-af22-dce888ed293f None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:07.223525 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-22a41b02-4d22-4d71-af22-dce888ed293f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:07.250893 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:07.319597 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 388/781] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:07.344283 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a41b02-4d22-4d71-af22-dce888ed293f None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:07.457212 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e0fe82-79af-453a-8fba-605ac0332775 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:07.471812 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a41b02-4d22-4d71-af22-dce888ed293f None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:07.497129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ae8f0-cdcf-441e-8db8-134661449853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:07.497790 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ae8f0-cdcf-441e-8db8-134661449853 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:07.498075 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ae8f0-cdcf-441e-8db8-134661449853 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:07.498352 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ae8f0-cdcf-441e-8db8-134661449853 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:07.499186 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ae8f0-cdcf-441e-8db8-134661449853 None admin] RBAC: Adding query filter params (role.id=e5e7de76725748df9add27e3c837d8ef, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=c8f314167aa94d81955ac761a5a28504) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:07.499540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ae8f0-cdcf-441e-8db8-134661449853 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:07.500959 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ae8f0-cdcf-441e-8db8-134661449853 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:07.507064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 394/782] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:35:07 2022] GET /identity/v3/role_assignments?user.id=c8f314167aa94d81955ac761a5a28504&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=e5e7de76725748df9add27e3c837d8ef => generated 259 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:07.516199 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730dd6b-8a67-4a51-abe8-e498df7d2b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:07.517400 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730dd6b-8a67-4a51-abe8-e498df7d2b6b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:07.517883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730dd6b-8a67-4a51-abe8-e498df7d2b6b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:07.518355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730dd6b-8a67-4a51-abe8-e498df7d2b6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:07.531222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730dd6b-8a67-4a51-abe8-e498df7d2b6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:35:07.540700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-3730dd6b-8a67-4a51-abe8-e498df7d2b6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:35:07.540700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:07.540700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:07.540700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:07.540700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:07.540700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:07.540700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:07.540700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:07.540700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:07.540700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:07.540700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:07.540700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:07.540700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:35:07.540700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:35:07.540700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:35:07.540700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:35:07.541710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:35:07.541710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:35:07.541710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:35:07.541710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:35:07.541710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:07.541710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:07.541710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:07.541710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:07.541710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:07.541710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:07.541710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:07.541710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:07.541710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:07.541710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:07.541710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:07.541710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:07.542561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:07.542561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:07.542561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:07.542561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:07.542561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:35:07.542561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:35:07.542561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:35:07.542561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:35:07.542561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:35:07.542561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:35:07.542561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:35:07.542561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:07.545116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 389/783] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:35:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:07.552035 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ae8f0-cdcf-441e-8db8-134661449853 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:07.588667 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:07.668717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ae8f0-cdcf-441e-8db8-134661449853 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:07.705613 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a791e-3927-4c0f-8c6c-0a23f29b0a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:07.706653 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a791e-3927-4c0f-8c6c-0a23f29b0a94 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:07.707134 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a791e-3927-4c0f-8c6c-0a23f29b0a94 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:07.707815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a791e-3927-4c0f-8c6c-0a23f29b0a94 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:07.708766 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a791e-3927-4c0f-8c6c-0a23f29b0a94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:07.709265 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a791e-3927-4c0f-8c6c-0a23f29b0a94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:07.711151 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a791e-3927-4c0f-8c6c-0a23f29b0a94 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:07.720740 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 395/784] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:35:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:07.727116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730dd6b-8a67-4a51-abe8-e498df7d2b6b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:07.747231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:07.832154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730dd6b-8a67-4a51-abe8-e498df7d2b6b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:07.867470 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51278ff1-aa65-49ac-9abc-77e5f65a4766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:07.868662 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51278ff1-aa65-49ac-9abc-77e5f65a4766 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:07.869143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51278ff1-aa65-49ac-9abc-77e5f65a4766 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:07.869609 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51278ff1-aa65-49ac-9abc-77e5f65a4766 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:07.881717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51278ff1-aa65-49ac-9abc-77e5f65a4766 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:07.883558 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51278ff1-aa65-49ac-9abc-77e5f65a4766 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:07.903293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-51278ff1-aa65-49ac-9abc-77e5f65a4766 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:07.903293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:07.903293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:07.903293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:07.903293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:07.903293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:07.903293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:07.903293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:07.903293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:07.903293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:07.903293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:07.903293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:07.903293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:07.903293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:07.903293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:07.904231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:07.904231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:07.904231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:07.904231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:07.904231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:07.904231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:07.904231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:07.904231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:07.904231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:07.904231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:07.904231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:07.904231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:07.904231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:07.904231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:07.904231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:07.904231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:07.904231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:07.905139 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:07.905139 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:07.905139 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:07.905139 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:07.905139 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 390/785] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:07.909865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a791e-3927-4c0f-8c6c-0a23f29b0a94 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:07.987684 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:08.015324 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a791e-3927-4c0f-8c6c-0a23f29b0a94 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:08.028651 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47040407-00d0-4d6d-83e0-778d46a4ee24 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:08.028946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47040407-00d0-4d6d-83e0-778d46a4ee24 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:08.029203 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47040407-00d0-4d6d-83e0-778d46a4ee24 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:08.030550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 391/786] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:35:08.035823 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e2e0a-9683-4fa0-afd9-3f4cfb3cb9be None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:08.036149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e2e0a-9683-4fa0-afd9-3f4cfb3cb9be None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:08.036421 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e2e0a-9683-4fa0-afd9-3f4cfb3cb9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:08.056385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-ba2e2e0a-9683-4fa0-afd9-3f4cfb3cb9be None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:08.057901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ba2e2e0a-9683-4fa0-afd9-3f4cfb3cb9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:08.077419 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335a47d-72cb-4613-b199-b0826a5a46cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:08.078492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335a47d-72cb-4613-b199-b0826a5a46cc None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:08.079007 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335a47d-72cb-4613-b199-b0826a5a46cc None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:08.079588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335a47d-72cb-4613-b199-b0826a5a46cc None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:08.080540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335a47d-72cb-4613-b199-b0826a5a46cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:08.081054 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335a47d-72cb-4613-b199-b0826a5a46cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:08.083192 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335a47d-72cb-4613-b199-b0826a5a46cc None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:08.103563 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 396/787] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:08.108707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335a47d-72cb-4613-b199-b0826a5a46cc None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:08.138407 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:08.140947 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 392/788] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 20:35:08.173951 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e2e0a-9683-4fa0-afd9-3f4cfb3cb9be None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:08.334264 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335a47d-72cb-4613-b199-b0826a5a46cc None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:08.334809 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e2e0a-9683-4fa0-afd9-3f4cfb3cb9be None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:08.376015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23af3a0-f537-470f-b876-d337261e6362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:08.376830 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23af3a0-f537-470f-b876-d337261e6362 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:08.377386 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23af3a0-f537-470f-b876-d337261e6362 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:08.377666 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23af3a0-f537-470f-b876-d337261e6362 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:08.390809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d592a-fb28-47d9-859e-773179263fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:08.391738 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23af3a0-f537-470f-b876-d337261e6362 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:35:08.392142 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d592a-fb28-47d9-859e-773179263fe9 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:08.392596 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d592a-fb28-47d9-859e-773179263fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:08.393041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d592a-fb28-47d9-859e-773179263fe9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:08.395399 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:08.402094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-e23af3a0-f537-470f-b876-d337261e6362 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:35:08.402094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:08.402094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:08.402094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:08.402094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:08.402094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:08.402094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:08.402094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:08.402094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:08.402094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:08.402094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:08.402094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:08.402094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:35:08.402094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:35:08.402094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:35:08.402094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:35:08.403027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:35:08.403027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:35:08.403027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:35:08.403027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:35:08.403027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:08.403027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:08.403027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:08.403027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:08.403027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:08.403027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:08.403027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:08.403027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:08.403027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:08.403027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:08.403027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:08.403027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:08.403946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:08.403946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:08.403946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:08.403946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:08.403946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:35:08.403946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:35:08.403946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:35:08.403946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:35:08.403946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:35:08.403946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:35:08.403946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:35:08.403946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:08.403946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 393/789] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:35:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:08.404820 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f908eda-e9ea-4db8-b421-c405a1aab865 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:08.405355 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d592a-fb28-47d9-859e-773179263fe9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:08.406941 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d592a-fb28-47d9-859e-773179263fe9 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:08.410258 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f908eda-e9ea-4db8-b421-c405a1aab865 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:08.410570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f908eda-e9ea-4db8-b421-c405a1aab865 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:08.413544 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 394/790] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:08.414267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f908eda-e9ea-4db8-b421-c405a1aab865 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:08.426707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-e61d592a-fb28-47d9-859e-773179263fe9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 20:35:08.426707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:08.426707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:08.426707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:08.426707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:08.426707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:08.426707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:08.426707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:08.426707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:08.426707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:08.426707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:08.426707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:08.426707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:35:08.426707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:35:08.426707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:35:08.426707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:35:08.427843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:08.427843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:08.427843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:35:08.427843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:08.427843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:35:08.427843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:08.427843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:08.427843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:08.427843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:08.427843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:08.427843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:08.427843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:08.427843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:08.427843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:08.427843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:08.427843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:08.427843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:08.427843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:08.428810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:08.428810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:08.428810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:35:08.428810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:35:08.428810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:35:08.428810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:35:08.428810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:35:08.428810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:35:08.428810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 20:35:08.428810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:08.432877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 397/791] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:35:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:08.439135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ff707-11f6-4b74-84a3-fe40668b5cb9 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:08.439728 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ff707-11f6-4b74-84a3-fe40668b5cb9 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:08.440271 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ff707-11f6-4b74-84a3-fe40668b5cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:08.461381 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-059ff707-11f6-4b74-84a3-fe40668b5cb9 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:08.463560 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-059ff707-11f6-4b74-84a3-fe40668b5cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:08.498486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:08.549459 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 398/792] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:08.550874 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ff707-11f6-4b74-84a3-fe40668b5cb9 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:08.564839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f908eda-e9ea-4db8-b421-c405a1aab865 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:08.606527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a3407-ae4b-4952-8b3a-f31976ad0c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:08.606947 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a3407-ae4b-4952-8b3a-f31976ad0c0f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:08.607233 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a3407-ae4b-4952-8b3a-f31976ad0c0f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:08.607551 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a3407-ae4b-4952-8b3a-f31976ad0c0f None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:08.608303 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a3407-ae4b-4952-8b3a-f31976ad0c0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:08.608684 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a3407-ae4b-4952-8b3a-f31976ad0c0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:08.610045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a3407-ae4b-4952-8b3a-f31976ad0c0f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:08.619747 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 395/793] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:35:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:08.620703 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a3407-ae4b-4952-8b3a-f31976ad0c0f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:08.688855 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ff707-11f6-4b74-84a3-fe40668b5cb9 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:08.716451 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:08.728959 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14e5c3-6f19-4b99-90da-f96f281a5516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:08.729708 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14e5c3-6f19-4b99-90da-f96f281a5516 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:08.729991 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14e5c3-6f19-4b99-90da-f96f281a5516 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:08.730247 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14e5c3-6f19-4b99-90da-f96f281a5516 None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:08.731127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14e5c3-6f19-4b99-90da-f96f281a5516 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:08.731517 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14e5c3-6f19-4b99-90da-f96f281a5516 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:08.733050 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14e5c3-6f19-4b99-90da-f96f281a5516 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:08.737870 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a3407-ae4b-4952-8b3a-f31976ad0c0f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:08.758356 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 399/794] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Jul 19 20:35:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:08.759275 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14e5c3-6f19-4b99-90da-f96f281a5516 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:08.765441 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:08.781476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460da03-ab4f-462f-b86b-8517425ea9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:08.782296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460da03-ab4f-462f-b86b-8517425ea9f9 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:08.782580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460da03-ab4f-462f-b86b-8517425ea9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:08.782855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460da03-ab4f-462f-b86b-8517425ea9f9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:08.783569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460da03-ab4f-462f-b86b-8517425ea9f9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:08.784989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460da03-ab4f-462f-b86b-8517425ea9f9 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:08.799458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-0460da03-ab4f-462f-b86b-8517425ea9f9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 20:35:08.799458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:08.799458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:35:08.799458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:35:08.799458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:35:08.799458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:35:08.799458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:35:08.799458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:08.799458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 20:35:08.799458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:08.799458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:08.799458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:08.799458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:08.799458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:08.799458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:08.799458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:08.800439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:08.800439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:08.800439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:08.800439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:08.800439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:08.800439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:08.800439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:08.800439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:35:08.800439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:35:08.800439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:35:08.800439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:35:08.800439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:08.800439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:08.800439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:08.800439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:08.800439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:08.801276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:08.801276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:08.801276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:08.801276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:08.801276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:08.801276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:08.801276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:08.801276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:08.801276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:08.801276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:08.801276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:08.801276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:35:08.801276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:08.801276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 20:35:08.801276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:08.801276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 396/795] 10.222.0.77 () {56 vars in 1129 bytes} [Tue Jul 19 20:35:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:08.802649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460da03-ab4f-462f-b86b-8517425ea9f9 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:08.896058 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14e5c3-6f19-4b99-90da-f96f281a5516 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:08.928646 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460da03-ab4f-462f-b86b-8517425ea9f9 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:08.943670 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43a2a6-f60f-4111-8e2d-db2e5005e50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:08.944852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43a2a6-f60f-4111-8e2d-db2e5005e50e None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:08.945229 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43a2a6-f60f-4111-8e2d-db2e5005e50e None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:08.945843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43a2a6-f60f-4111-8e2d-db2e5005e50e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:08.958918 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43a2a6-f60f-4111-8e2d-db2e5005e50e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:08.960462 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43a2a6-f60f-4111-8e2d-db2e5005e50e None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:08.966462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef81848-3df6-4064-9898-49a183651b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:08.967391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef81848-3df6-4064-9898-49a183651b11 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:08.968138 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef81848-3df6-4064-9898-49a183651b11 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:08.968415 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef81848-3df6-4064-9898-49a183651b11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:08.979641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-fd43a2a6-f60f-4111-8e2d-db2e5005e50e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:08.979641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:08.979641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:08.979641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:08.979641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:08.979641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:08.979641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:08.979641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:08.979641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:08.979641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:08.979641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:08.979641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:08.979641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:08.979641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:08.979641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:08.980540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:08.980540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:08.980540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:08.980540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:08.980540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:08.980540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:08.980540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:08.980540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:08.980540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:08.980540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:08.980540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:08.980540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:08.980540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:08.980540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:08.980540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:08.980540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:08.980540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:08.981432 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:08.981432 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:08.981432 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:08.981432 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:08.981669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef81848-3df6-4064-9898-49a183651b11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:08.987280 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef81848-3df6-4064-9898-49a183651b11 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:08.987482 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 400/796] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:08.987482 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43a2a6-f60f-4111-8e2d-db2e5005e50e None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:09.004377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-1ef81848-3df6-4064-9898-49a183651b11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:09.004377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:09.004377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:09.004377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:09.004377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:09.004377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:09.004377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:09.004377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:09.004377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:09.004377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:09.004377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:09.004377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:09.004377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:09.004377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:09.004377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:09.006246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:09.006246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:09.006246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:09.006246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:09.006246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:09.006246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:09.006246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:09.006246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:09.006246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:09.006246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:09.006246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:09.006246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:09.006246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:09.006246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:09.006246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:09.006246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:09.006246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:09.007647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:09.007647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:09.007647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:09.007647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:09.007647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 397/797] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:09.007647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef81848-3df6-4064-9898-49a183651b11 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:09.024229 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:09.052503 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:09.103364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43a2a6-f60f-4111-8e2d-db2e5005e50e None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:09.134162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef81848-3df6-4064-9898-49a183651b11 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:09.139873 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27834cf7-8364-491c-93c4-3fb758afc7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:09.140646 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27834cf7-8364-491c-93c4-3fb758afc7dd None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:09.141037 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27834cf7-8364-491c-93c4-3fb758afc7dd None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:09.141415 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27834cf7-8364-491c-93c4-3fb758afc7dd None admin] PATH_INFO: `/v3/services` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:09.142230 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27834cf7-8364-491c-93c4-3fb758afc7dd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:09.142640 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27834cf7-8364-491c-93c4-3fb758afc7dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:09.144130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27834cf7-8364-491c-93c4-3fb758afc7dd None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:09.149303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 401/798] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Jul 19 20:35:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:09.150285 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27834cf7-8364-491c-93c4-3fb758afc7dd None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:09.177494 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c3844-b3ae-4eb8-9bc0-0d6d13f22885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:09.178400 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c3844-b3ae-4eb8-9bc0-0d6d13f22885 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:09.178982 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c3844-b3ae-4eb8-9bc0-0d6d13f22885 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:09.179463 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c3844-b3ae-4eb8-9bc0-0d6d13f22885 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:09.180801 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c3844-b3ae-4eb8-9bc0-0d6d13f22885 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:09.181355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c3844-b3ae-4eb8-9bc0-0d6d13f22885 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:09.183296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c3844-b3ae-4eb8-9bc0-0d6d13f22885 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:09.199059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 398/799] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:09.200087 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c3844-b3ae-4eb8-9bc0-0d6d13f22885 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:09.257919 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:09.263534 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27834cf7-8364-491c-93c4-3fb758afc7dd None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:09.300782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b770b7d-b903-4dbb-96d5-52e9096f149e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:09.302146 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b770b7d-b903-4dbb-96d5-52e9096f149e None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:09.302534 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b770b7d-b903-4dbb-96d5-52e9096f149e None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:09.302964 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b770b7d-b903-4dbb-96d5-52e9096f149e None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:09.303780 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b770b7d-b903-4dbb-96d5-52e9096f149e None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:09.304258 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b770b7d-b903-4dbb-96d5-52e9096f149e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:09.305728 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b770b7d-b903-4dbb-96d5-52e9096f149e None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:09.307481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:09.314131 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c3844-b3ae-4eb8-9bc0-0d6d13f22885 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:09.319539 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 402/800] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:09.320565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b770b7d-b903-4dbb-96d5-52e9096f149e None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:09.351473 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf213a0-c4a0-406b-8acb-6d0f84904cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:09.352391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf213a0-c4a0-406b-8acb-6d0f84904cf7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:09.352841 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf213a0-c4a0-406b-8acb-6d0f84904cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:09.353256 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf213a0-c4a0-406b-8acb-6d0f84904cf7 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:09.354099 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf213a0-c4a0-406b-8acb-6d0f84904cf7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:09.354546 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf213a0-c4a0-406b-8acb-6d0f84904cf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:09.356066 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf213a0-c4a0-406b-8acb-6d0f84904cf7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:09.361721 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 399/801] 10.222.0.77 () {56 vars in 1124 bytes} [Tue Jul 19 20:35:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:09.362753 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf213a0-c4a0-406b-8acb-6d0f84904cf7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:09.430763 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b770b7d-b903-4dbb-96d5-52e9096f149e None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:09.467491 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9fb7d-a12f-4e4f-8f94-35846df2d3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:09.468404 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9fb7d-a12f-4e4f-8f94-35846df2d3aa None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:09.468794 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9fb7d-a12f-4e4f-8f94-35846df2d3aa None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:09.469104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9fb7d-a12f-4e4f-8f94-35846df2d3aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:09.471163 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf213a0-c4a0-406b-8acb-6d0f84904cf7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:09.477492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9fb7d-a12f-4e4f-8f94-35846df2d3aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:09.479138 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9fb7d-a12f-4e4f-8f94-35846df2d3aa None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:09.494336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-9af9fb7d-a12f-4e4f-8f94-35846df2d3aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 20:35:09.494336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:09.494336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:09.494336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:09.494336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:09.494336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:09.494336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:09.494336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:09.494336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:09.494336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:09.494336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:09.494336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:09.494336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:35:09.494336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:35:09.494336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:35:09.494336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:35:09.495337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:09.495337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:09.495337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:35:09.495337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:09.495337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:35:09.495337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:09.495337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:09.495337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:09.495337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:09.495337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:09.495337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:09.495337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:09.495337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:09.495337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:09.495337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:09.495337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:09.495337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:09.495337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:09.496288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:09.496288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:09.496288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:35:09.496288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:35:09.496288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:35:09.496288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:35:09.496288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:35:09.496288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:35:09.496288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 20:35:09.496288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:09.500282 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 403/802] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Jul 19 20:35:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:09.501113 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9fb7d-a12f-4e4f-8f94-35846df2d3aa None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:09.511196 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c23a4d-4bd9-424b-a23f-40a0cab403bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:09.512673 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c23a4d-4bd9-424b-a23f-40a0cab403bd None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:09.513150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c23a4d-4bd9-424b-a23f-40a0cab403bd None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:09.513619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c23a4d-4bd9-424b-a23f-40a0cab403bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:09.521500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c23a4d-4bd9-424b-a23f-40a0cab403bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:09.522120 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:09.523425 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c23a4d-4bd9-424b-a23f-40a0cab403bd None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:09.539464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-41c23a4d-4bd9-424b-a23f-40a0cab403bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:09.539464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:09.539464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:09.539464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:09.539464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:09.539464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:09.539464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:09.539464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:09.539464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:09.539464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:09.539464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:09.539464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:09.539464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:35:09.539464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:35:09.539464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:35:09.540414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:35:09.540414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:09.540414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:09.540414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:09.540414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:09.540414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:09.540414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:09.540414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:09.540414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:09.540414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:09.540414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:09.540414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:09.540414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:09.540414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:09.540414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:09.540414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:09.540414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:09.541316 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:35:09.541316 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:35:09.541316 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:35:09.541316 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:35:09.541316 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:35:09.541316 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:35:09.541316 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:09.541316 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:09.543856 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 400/803] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:35:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:09.545144 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c23a4d-4bd9-424b-a23f-40a0cab403bd None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:09.569413 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:09.616461 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9fb7d-a12f-4e4f-8f94-35846df2d3aa None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:09.652334 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e9f9b-956b-481a-9028-ea9b9947ece3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:09.653416 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e9f9b-956b-481a-9028-ea9b9947ece3 None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:09.653899 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e9f9b-956b-481a-9028-ea9b9947ece3 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:09.654380 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e9f9b-956b-481a-9028-ea9b9947ece3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:09.655372 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e9f9b-956b-481a-9028-ea9b9947ece3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:09.656947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e9f9b-956b-481a-9028-ea9b9947ece3 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:09.675686 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c23a4d-4bd9-424b-a23f-40a0cab403bd None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:09.684303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 404/804] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Jul 19 20:35:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:35:09.685953 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e9f9b-956b-481a-9028-ea9b9947ece3 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:09.726987 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acebef-08c4-4a55-9e36-9d7f7c9053d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:09.727738 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acebef-08c4-4a55-9e36-9d7f7c9053d1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:09.728073 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acebef-08c4-4a55-9e36-9d7f7c9053d1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:09.728406 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acebef-08c4-4a55-9e36-9d7f7c9053d1 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:09.729377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acebef-08c4-4a55-9e36-9d7f7c9053d1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:09.729727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acebef-08c4-4a55-9e36-9d7f7c9053d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:09.731443 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acebef-08c4-4a55-9e36-9d7f7c9053d1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:09.759212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 401/805] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Jul 19 20:35:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:09.760615 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35631f9a-47cc-49e7-9ddc-421645cd0c98 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:09.760908 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35631f9a-47cc-49e7-9ddc-421645cd0c98 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:09.761188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35631f9a-47cc-49e7-9ddc-421645cd0c98 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:09.762714 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 402/806] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:09.763287 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35631f9a-47cc-49e7-9ddc-421645cd0c98 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:09.800521 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:09.837090 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e9f9b-956b-481a-9028-ea9b9947ece3 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:09.870801 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:09.886190 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb05bbd-bf68-4830-b85a-4c1c1ed34338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:09.886870 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb05bbd-bf68-4830-b85a-4c1c1ed34338 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:09.887170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb05bbd-bf68-4830-b85a-4c1c1ed34338 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:09.887466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb05bbd-bf68-4830-b85a-4c1c1ed34338 None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:09.888273 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb05bbd-bf68-4830-b85a-4c1c1ed34338 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:09.888586 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb05bbd-bf68-4830-b85a-4c1c1ed34338 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:09.890022 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb05bbd-bf68-4830-b85a-4c1c1ed34338 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:09.903990 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35631f9a-47cc-49e7-9ddc-421645cd0c98 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:09.904415 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 405/807] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:35:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:09.905721 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda91df-c056-4c0f-8a50-e23023114210 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:09.906014 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda91df-c056-4c0f-8a50-e23023114210 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:09.906296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda91df-c056-4c0f-8a50-e23023114210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:09.924370 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-ffda91df-c056-4c0f-8a50-e23023114210 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:09.925577 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-ffda91df-c056-4c0f-8a50-e23023114210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:09.946306 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106645b-5c63-4d0f-b1be-73a8205170a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:09.946891 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106645b-5c63-4d0f-b1be-73a8205170a9 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:09.947177 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106645b-5c63-4d0f-b1be-73a8205170a9 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:09.947487 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106645b-5c63-4d0f-b1be-73a8205170a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:10.007284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 406/808] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:10.007284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda975a0-153c-4804-8fe9-9e62ec07d486 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:10.007284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda975a0-153c-4804-8fe9-9e62ec07d486 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:10.007284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda975a0-153c-4804-8fe9-9e62ec07d486 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:10.007284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 407/809] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:10.007284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda975a0-153c-4804-8fe9-9e62ec07d486 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:10.032140 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106645b-5c63-4d0f-b1be-73a8205170a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:10.033820 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106645b-5c63-4d0f-b1be-73a8205170a9 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:10.073540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:10.113098 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:10.117393 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda975a0-153c-4804-8fe9-9e62ec07d486 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:10.141275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 403/810] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:35:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 20:35:10.142895 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a25a76-69ad-4d16-a505-916595a69ece None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:10.143414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a25a76-69ad-4d16-a505-916595a69ece None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:10.143982 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a25a76-69ad-4d16-a505-916595a69ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:10.163724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a26a8-9749-45b4-a599-6bf5abc49cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:10.164724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a26a8-9749-45b4-a599-6bf5abc49cba None admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:10.165108 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a26a8-9749-45b4-a599-6bf5abc49cba None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:10.165457 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a26a8-9749-45b4-a599-6bf5abc49cba None admin] PATH_INFO: `/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/7987846276ad4ccd90899128ceb1354e/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:10.165850 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-21a25a76-69ad-4d16-a505-916595a69ece None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:10.167054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-21a25a76-69ad-4d16-a505-916595a69ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:10.167694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a26a8-9749-45b4-a599-6bf5abc49cba None admin] RBAC: Authorizing `identity:create_grant(project_id=327868f4f62e4e4a9c5bef4acd32fb29, user_id=7987846276ad4ccd90899128ceb1354e, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:10.169213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a26a8-9749-45b4-a599-6bf5abc49cba None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:10.184876 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 408/811] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:35:10 2022] PUT /identity/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/7987846276ad4ccd90899128ceb1354e/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:35:10.188921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a26a8-9749-45b4-a599-6bf5abc49cba None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:10.254125 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 404/812] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:10.255093 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a25a76-69ad-4d16-a505-916595a69ece None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:10.331566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a26a8-9749-45b4-a599-6bf5abc49cba None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:10.366267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a25a76-69ad-4d16-a505-916595a69ece None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:10.367046 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:10.371095 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:10.387190 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbf02d-3da7-4d7d-b944-df3dca369a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:10.388780 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbf02d-3da7-4d7d-b944-df3dca369a33 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:10.389090 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbf02d-3da7-4d7d-b944-df3dca369a33 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:10.389402 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbf02d-3da7-4d7d-b944-df3dca369a33 None admin] PATH_INFO: `/v3/services/network` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:10.390136 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbf02d-3da7-4d7d-b944-df3dca369a33 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:10.391582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbf02d-3da7-4d7d-b944-df3dca369a33 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:10.407694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-affbf02d-3da7-4d7d-b944-df3dca369a33 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 20:35:10.407694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:10.407694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:35:10.407694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:35:10.407694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:35:10.407694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:35:10.407694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:35:10.407694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:10.407694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 20:35:10.407694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:10.407694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:10.407694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:10.407694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:10.407694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:10.407694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:10.407694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:10.407694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:10.408921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:10.408921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:10.408921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:10.408921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:10.408921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:10.408921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:10.408921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:35:10.408921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:35:10.408921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:35:10.408921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:35:10.408921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:10.408921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:10.408921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:10.408921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:10.408921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:10.408921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:10.409779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:10.409779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:10.409779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:10.409779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:10.409779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:10.409779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:10.409779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:10.409779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:10.409779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:10.409779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:10.409779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:35:10.409779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:10.409779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 20:35:10.409779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:10.409779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 409/813] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:35:10 2022] GET /identity/v3/services/network => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:10.410602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbf02d-3da7-4d7d-b944-df3dca369a33 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:10.418843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce87ef-313b-4e58-9ed5-a620663ed590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:10.419925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce87ef-313b-4e58-9ed5-a620663ed590 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:10.420212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce87ef-313b-4e58-9ed5-a620663ed590 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:10.420491 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce87ef-313b-4e58-9ed5-a620663ed590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:10.431649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce87ef-313b-4e58-9ed5-a620663ed590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:10.433233 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce87ef-313b-4e58-9ed5-a620663ed590 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:10.457800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-b1ce87ef-313b-4e58-9ed5-a620663ed590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:10.457800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:10.457800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:10.457800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:10.457800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:10.457800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:10.457800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:10.457800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:10.457800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:10.457800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:10.457800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:10.457800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:10.457800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:10.457800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:10.457800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:10.458796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:10.458796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:10.458796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:10.458796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:10.458796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:10.458796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:10.458796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:10.458796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:10.458796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:10.458796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:10.458796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:10.458796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:10.458796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:10.458796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:10.458796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:10.458796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:10.458796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:10.459759 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:10.459759 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:10.459759 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:10.459759 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:10.459759 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 405/814] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:10.460478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce87ef-313b-4e58-9ed5-a620663ed590 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:10.555852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbf02d-3da7-4d7d-b944-df3dca369a33 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:10.592969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecae17-f3de-4e40-be21-6049dcb366ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:10.594190 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecae17-f3de-4e40-be21-6049dcb366ad None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:10.594674 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecae17-f3de-4e40-be21-6049dcb366ad None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:10.595148 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecae17-f3de-4e40-be21-6049dcb366ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:10.595487 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce87ef-313b-4e58-9ed5-a620663ed590 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:10.608651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecae17-f3de-4e40-be21-6049dcb366ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:35:10.617582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-c5ecae17-f3de-4e40-be21-6049dcb366ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:35:10.617582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:10.617582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:10.617582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:10.617582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:10.617582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:10.617582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:10.617582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:10.617582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:10.617582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:10.617582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:10.617582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:10.617582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:35:10.617582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:35:10.617582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:35:10.617582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:35:10.618548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:35:10.618548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:35:10.618548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:35:10.618548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:35:10.618548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:10.618548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:10.618548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:10.618548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:10.618548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:10.618548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:10.618548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:10.618548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:10.618548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:10.618548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:10.618548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:10.618548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:10.619466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:10.619466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:10.619466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:10.619466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:10.619466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:35:10.619466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:35:10.619466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:35:10.619466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:35:10.619466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:35:10.619466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:35:10.619466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:35:10.619466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:10.622304 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 410/815] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:35:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:10.623471 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecae17-f3de-4e40-be21-6049dcb366ad None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:10.642169 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc916a-2743-4e5c-8cbe-68ac6a474db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:10.643111 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc916a-2743-4e5c-8cbe-68ac6a474db8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:10.643453 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc916a-2743-4e5c-8cbe-68ac6a474db8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:10.643738 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc916a-2743-4e5c-8cbe-68ac6a474db8 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:10.644457 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc916a-2743-4e5c-8cbe-68ac6a474db8 None admin] RBAC: Adding query filter params (name=network) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:10.644769 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc916a-2743-4e5c-8cbe-68ac6a474db8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:10.646922 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc916a-2743-4e5c-8cbe-68ac6a474db8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:10.656890 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 406/816] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jul 19 20:35:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:10.656890 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc916a-2743-4e5c-8cbe-68ac6a474db8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:10.681939 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:10.690270 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:10.764983 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecae17-f3de-4e40-be21-6049dcb366ad None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:10.776545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc916a-2743-4e5c-8cbe-68ac6a474db8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:10.805341 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e89ac-1664-4289-9172-4f02e581f380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:10.806072 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e89ac-1664-4289-9172-4f02e581f380 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:10.806295 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e89ac-1664-4289-9172-4f02e581f380 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:10.806629 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e89ac-1664-4289-9172-4f02e581f380 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:10.807376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e89ac-1664-4289-9172-4f02e581f380 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:10.807792 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e89ac-1664-4289-9172-4f02e581f380 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:10.809194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e89ac-1664-4289-9172-4f02e581f380 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:10.821640 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 411/817] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:10.822649 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e89ac-1664-4289-9172-4f02e581f380 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:10.823972 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876eb420-f142-4264-b227-6a275f4d593e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:10.825619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876eb420-f142-4264-b227-6a275f4d593e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:10.826122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876eb420-f142-4264-b227-6a275f4d593e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:10.826866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876eb420-f142-4264-b227-6a275f4d593e None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:10.830042 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876eb420-f142-4264-b227-6a275f4d593e None admin] RBAC: Adding query filter params (name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:10.830942 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876eb420-f142-4264-b227-6a275f4d593e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:10.837142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876eb420-f142-4264-b227-6a275f4d593e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:10.851902 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 407/818] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jul 19 20:35:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:10.853304 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876eb420-f142-4264-b227-6a275f4d593e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:10.941483 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e89ac-1664-4289-9172-4f02e581f380 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:10.953152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:10.983133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9cd7e-7945-4f9e-8715-82dac2b09f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:10.983870 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9cd7e-7945-4f9e-8715-82dac2b09f0e None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:10.984153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9cd7e-7945-4f9e-8715-82dac2b09f0e None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:10.984435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9cd7e-7945-4f9e-8715-82dac2b09f0e None admin] PATH_INFO: `/v3/services` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:10.985153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9cd7e-7945-4f9e-8715-82dac2b09f0e None admin] RBAC: Adding query filter params (type=network) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:10.985460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9cd7e-7945-4f9e-8715-82dac2b09f0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:10.986834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9cd7e-7945-4f9e-8715-82dac2b09f0e None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:10.993479 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 412/819] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jul 19 20:35:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:10.994428 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9cd7e-7945-4f9e-8715-82dac2b09f0e None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:11.098584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:11.099543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9cd7e-7945-4f9e-8715-82dac2b09f0e None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:11.128350 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876eb420-f142-4264-b227-6a275f4d593e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:11.135622 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5f109-5232-4f94-80cd-cd23c02d4d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:11.136433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5f109-5232-4f94-80cd-cd23c02d4d64 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:11.136708 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5f109-5232-4f94-80cd-cd23c02d4d64 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:11.136983 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5f109-5232-4f94-80cd-cd23c02d4d64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:11.147524 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5f109-5232-4f94-80cd-cd23c02d4d64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:11.148969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5f109-5232-4f94-80cd-cd23c02d4d64 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:11.168452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-a4a5f109-5232-4f94-80cd-cd23c02d4d64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:11.168452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:11.168452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:11.168452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:11.168452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:11.168452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:11.168452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:11.168452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:11.168452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:11.168452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:11.168452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:11.168452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:11.168452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:11.168452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:11.168452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:11.169403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:11.169403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:11.169403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:11.169403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:11.169403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:11.169403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:11.169403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:11.169403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:11.169403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:11.169403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:11.169403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:11.169403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:11.169403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:11.169403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:11.169403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:11.169403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:11.169403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:11.170309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:11.170309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:11.170309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:11.170309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:11.174309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 413/820] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:11.175133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5f109-5232-4f94-80cd-cd23c02d4d64 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:11.178462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63545c-1cf0-4a7c-a8e9-3fb6fe31e5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:11.180213 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63545c-1cf0-4a7c-a8e9-3fb6fe31e5d5 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:11.180981 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63545c-1cf0-4a7c-a8e9-3fb6fe31e5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:11.181486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63545c-1cf0-4a7c-a8e9-3fb6fe31e5d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:11.193365 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63545c-1cf0-4a7c-a8e9-3fb6fe31e5d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:11.196028 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63545c-1cf0-4a7c-a8e9-3fb6fe31e5d5 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:11.201592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:11.216509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-dc63545c-1cf0-4a7c-a8e9-3fb6fe31e5d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:11.216509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:11.216509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:11.216509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:11.216509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:11.216509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:11.216509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:11.216509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:11.216509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:11.216509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:11.216509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:11.216509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:11.216509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:35:11.216509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:35:11.216509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:35:11.217538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:35:11.217538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:11.217538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:11.217538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:11.217538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:11.217538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:11.217538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:11.217538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:11.217538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:11.217538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:11.217538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:11.217538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:11.217538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:11.217538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:11.217538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:11.217538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:11.217538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:11.218432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:35:11.218432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:35:11.218432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:35:11.218432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:35:11.218432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:35:11.218432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:35:11.218432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:11.218432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:11.222790 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 408/821] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:35:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:11.224632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63545c-1cf0-4a7c-a8e9-3fb6fe31e5d5 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:11.281420 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5f109-5232-4f94-80cd-cd23c02d4d64 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:11.318927 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcef8c-acb2-43d6-ac13-7f25f70c72c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:11.318927 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcef8c-acb2-43d6-ac13-7f25f70c72c2 None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:11.319204 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcef8c-acb2-43d6-ac13-7f25f70c72c2 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:11.319502 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcef8c-acb2-43d6-ac13-7f25f70c72c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:11.320176 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bcef8c-acb2-43d6-ac13-7f25f70c72c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:11.321539 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bcef8c-acb2-43d6-ac13-7f25f70c72c2 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:11.342232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 414/822] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Jul 19 20:35:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:35:11.343309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcef8c-acb2-43d6-ac13-7f25f70c72c2 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:11.366555 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63545c-1cf0-4a7c-a8e9-3fb6fe31e5d5 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:11.416776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8388b6-f6b4-42f1-8fb1-ff40da5ceb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:11.417451 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8388b6-f6b4-42f1-8fb1-ff40da5ceb34 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:11.417733 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8388b6-f6b4-42f1-8fb1-ff40da5ceb34 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:11.417994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8388b6-f6b4-42f1-8fb1-ff40da5ceb34 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:11.418710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8388b6-f6b4-42f1-8fb1-ff40da5ceb34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:11.419005 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8388b6-f6b4-42f1-8fb1-ff40da5ceb34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:11.420396 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8388b6-f6b4-42f1-8fb1-ff40da5ceb34 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:11.429796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:11.439393 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 409/823] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:11.452363 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8388b6-f6b4-42f1-8fb1-ff40da5ceb34 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:11.470801 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:11.502056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcef8c-acb2-43d6-ac13-7f25f70c72c2 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:11.562234 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f88e1-a3a7-4742-8bfc-3c72ac2ee90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:11.563670 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f88e1-a3a7-4742-8bfc-3c72ac2ee90e None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:11.564361 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f88e1-a3a7-4742-8bfc-3c72ac2ee90e None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:11.565739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f88e1-a3a7-4742-8bfc-3c72ac2ee90e None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:11.567610 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f88e1-a3a7-4742-8bfc-3c72ac2ee90e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:11.568741 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f88e1-a3a7-4742-8bfc-3c72ac2ee90e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:11.572560 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f88e1-a3a7-4742-8bfc-3c72ac2ee90e None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:11.592433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 415/824] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:35:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:11.601509 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f88e1-a3a7-4742-8bfc-3c72ac2ee90e None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:11.650969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8388b6-f6b4-42f1-8fb1-ff40da5ceb34 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:11.689539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf9b95-bf23-4dca-9551-1272ddd7a158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:11.690517 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf9b95-bf23-4dca-9551-1272ddd7a158 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:11.690886 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf9b95-bf23-4dca-9551-1272ddd7a158 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:11.691249 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf9b95-bf23-4dca-9551-1272ddd7a158 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:11.700309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf9b95-bf23-4dca-9551-1272ddd7a158 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:11.701974 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf9b95-bf23-4dca-9551-1272ddd7a158 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:11.718869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-1faf9b95-bf23-4dca-9551-1272ddd7a158 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 20:35:11.718869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:11.718869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:11.718869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:11.718869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:11.718869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:11.718869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:11.718869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:11.718869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:11.718869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:11.718869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:11.718869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:11.718869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:35:11.718869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:35:11.718869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:35:11.718869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:35:11.720145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:11.720145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:11.720145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:35:11.720145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:11.720145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:35:11.720145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:11.720145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:11.720145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:11.720145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:11.720145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:11.720145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:11.720145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:11.720145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:11.720145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:11.720145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:11.720145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:11.720145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:11.720145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:11.721339 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:11.721339 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:11.721339 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:35:11.721339 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:35:11.721339 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:35:11.721339 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:35:11.721339 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:35:11.721339 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:35:11.721339 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 20:35:11.721339 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:11.723179 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f88e1-a3a7-4742-8bfc-3c72ac2ee90e None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:11.723424 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 410/825] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Jul 19 20:35:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:11.733158 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf9b95-bf23-4dca-9551-1272ddd7a158 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:11.784419 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e2910-0e16-4d2e-bcd8-f317a021d752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:11.785121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e2910-0e16-4d2e-bcd8-f317a021d752 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:11.785400 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e2910-0e16-4d2e-bcd8-f317a021d752 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:11.785670 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e2910-0e16-4d2e-bcd8-f317a021d752 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:11.787750 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e2910-0e16-4d2e-bcd8-f317a021d752 None admin] RBAC: Adding query filter params (role.id=b30f01ef95004a1b84fc029830bdf053, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=6dbbb8f7b3f2449fb9c64ca3815b6c1b) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:11.788063 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e2910-0e16-4d2e-bcd8-f317a021d752 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:11.790504 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e2910-0e16-4d2e-bcd8-f317a021d752 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:11.803708 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 416/826] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:35:11 2022] GET /identity/v3/role_assignments?user.id=6dbbb8f7b3f2449fb9c64ca3815b6c1b&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=b30f01ef95004a1b84fc029830bdf053 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:11.819924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:11.869649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf9b95-bf23-4dca-9551-1272ddd7a158 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:11.909399 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fadc0-6441-4243-815b-2e70e0dc2786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:11.910323 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fadc0-6441-4243-815b-2e70e0dc2786 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:11.911004 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fadc0-6441-4243-815b-2e70e0dc2786 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:11.911515 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fadc0-6441-4243-815b-2e70e0dc2786 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:11.912535 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fadc0-6441-4243-815b-2e70e0dc2786 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:11.912999 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fadc0-6441-4243-815b-2e70e0dc2786 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:11.914623 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fadc0-6441-4243-815b-2e70e0dc2786 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:11.940746 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 411/827] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Jul 19 20:35:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:11.943022 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e2910-0e16-4d2e-bcd8-f317a021d752 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:11.947287 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:12.009547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0d0bd-3bd4-44e4-b20f-e53ca214ab7c None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:12.009881 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0d0bd-3bd4-44e4-b20f-e53ca214ab7c None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:12.010109 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0d0bd-3bd4-44e4-b20f-e53ca214ab7c None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:12.011692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 412/828] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:35:12.016589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99836c54-2577-445c-9838-0f31b1f2733a None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:12.016991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99836c54-2577-445c-9838-0f31b1f2733a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:12.017263 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99836c54-2577-445c-9838-0f31b1f2733a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:12.038688 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-99836c54-2577-445c-9838-0f31b1f2733a None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:12.039911 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-99836c54-2577-445c-9838-0f31b1f2733a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:12.062769 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e2910-0e16-4d2e-bcd8-f317a021d752 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:12.116770 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b1bf8-1da9-4938-8ca6-e99f0e828448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:12.117560 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b1bf8-1da9-4938-8ca6-e99f0e828448 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:12.117840 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b1bf8-1da9-4938-8ca6-e99f0e828448 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:12.118110 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b1bf8-1da9-4938-8ca6-e99f0e828448 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:12.124157 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 413/829] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:12.132157 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b1bf8-1da9-4938-8ca6-e99f0e828448 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:12.133788 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b1bf8-1da9-4938-8ca6-e99f0e828448 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:12.147417 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99836c54-2577-445c-9838-0f31b1f2733a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:12.152446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-cc5b1bf8-1da9-4938-8ca6-e99f0e828448 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:12.152446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:12.152446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:12.152446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:12.152446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:12.152446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:12.152446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:12.152446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:12.152446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:12.152446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:12.152446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:12.152446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:12.152446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:12.152446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:12.152446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:12.153335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:12.153335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:12.153335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:12.153335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:12.153335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:12.153335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:12.153335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:12.153335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:12.153335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:12.153335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:12.153335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:12.153335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:12.153335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:12.153335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:12.153335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:12.153335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:12.153335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:12.154390 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:12.154390 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:12.154390 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:12.154390 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:12.154390 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 417/830] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:12.162634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b1bf8-1da9-4938-8ca6-e99f0e828448 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:12.196522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:12.248753 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:12.257567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99836c54-2577-445c-9838-0f31b1f2733a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:12.293459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b43a3-5ea6-4bdf-a79e-e8dee69bb538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:12.294262 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b43a3-5ea6-4bdf-a79e-e8dee69bb538 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:12.294540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b43a3-5ea6-4bdf-a79e-e8dee69bb538 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:12.294812 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b43a3-5ea6-4bdf-a79e-e8dee69bb538 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:12.295535 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b43a3-5ea6-4bdf-a79e-e8dee69bb538 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:12.296897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b43a3-5ea6-4bdf-a79e-e8dee69bb538 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:12.309736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-f86b43a3-5ea6-4bdf-a79e-e8dee69bb538 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 20:35:12.309736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:12.309736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:35:12.309736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:35:12.309736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:35:12.309736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:35:12.309736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:35:12.309736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:12.309736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 20:35:12.309736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:12.309736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:12.309736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:12.309736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:12.309736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:12.309736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:12.309736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:12.309736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:12.310763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:12.310763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:12.310763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:12.310763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:12.310763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:12.310763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:12.310763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:35:12.310763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:35:12.310763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:35:12.310763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:35:12.310763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:12.310763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:12.310763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:12.310763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:12.310763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:12.310763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:12.312094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:12.312094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:12.312094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:12.312094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:12.312094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:12.312094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:12.312094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:12.312094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:12.312094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:12.312094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:12.312094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:35:12.312094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:12.312094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 20:35:12.312094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:12.312094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 414/831] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jul 19 20:35:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:12.314593 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b1bf8-1da9-4938-8ca6-e99f0e828448 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:12.316950 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b43a3-5ea6-4bdf-a79e-e8dee69bb538 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:12.361340 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e58dad-59ca-4bdb-889b-2fc2de1f20de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:12.362403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e58dad-59ca-4bdb-889b-2fc2de1f20de None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:12.363378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e58dad-59ca-4bdb-889b-2fc2de1f20de None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:12.363868 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e58dad-59ca-4bdb-889b-2fc2de1f20de None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:12.365516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e58dad-59ca-4bdb-889b-2fc2de1f20de None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:12.366489 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e58dad-59ca-4bdb-889b-2fc2de1f20de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:12.368411 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e58dad-59ca-4bdb-889b-2fc2de1f20de None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:12.391325 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 418/832] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:12.392937 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e58dad-59ca-4bdb-889b-2fc2de1f20de None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:12.427430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b43a3-5ea6-4bdf-a79e-e8dee69bb538 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:12.438957 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:12.466707 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddd9e0-02fb-4ac1-a394-3ec1eaa71ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:12.467403 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddd9e0-02fb-4ac1-a394-3ec1eaa71ca1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:12.467690 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddd9e0-02fb-4ac1-a394-3ec1eaa71ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:12.467972 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddd9e0-02fb-4ac1-a394-3ec1eaa71ca1 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:12.468670 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ddd9e0-02fb-4ac1-a394-3ec1eaa71ca1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:12.468977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ddd9e0-02fb-4ac1-a394-3ec1eaa71ca1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:12.470329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ddd9e0-02fb-4ac1-a394-3ec1eaa71ca1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:12.475101 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 415/833] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jul 19 20:35:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:12.476383 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248eb07-1cb6-4dd5-b4e4-4105be541ccc None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:12.476671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248eb07-1cb6-4dd5-b4e4-4105be541ccc None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:12.476949 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248eb07-1cb6-4dd5-b4e4-4105be541ccc None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:12.482021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 416/834] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:12.482021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248eb07-1cb6-4dd5-b4e4-4105be541ccc None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:12.506067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e58dad-59ca-4bdb-889b-2fc2de1f20de None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:12.523254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:12.543382 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ab514-1030-4e77-b070-d38a8c23189e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:12.544174 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ab514-1030-4e77-b070-d38a8c23189e None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:12.544457 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ab514-1030-4e77-b070-d38a8c23189e None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:12.544771 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ab514-1030-4e77-b070-d38a8c23189e None admin] PATH_INFO: `/v3/projects/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:12.552028 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ab514-1030-4e77-b070-d38a8c23189e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:12.553457 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ab514-1030-4e77-b070-d38a8c23189e None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:12.567592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-034ab514-1030-4e77-b070-d38a8c23189e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:12.567592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:12.567592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:12.567592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:12.567592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:12.567592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:12.567592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:12.567592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:12.567592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:12.567592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:12.567592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:12.567592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:12.567592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:35:12.567592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:35:12.567592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:35:12.568962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:35:12.568962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:12.568962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:12.568962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:12.568962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:12.568962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:12.568962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:12.568962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:12.568962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:12.568962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:12.568962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:12.568962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:12.568962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:12.568962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:12.568962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:12.568962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:12.568962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:12.569898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:35:12.569898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:35:12.569898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:35:12.569898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:35:12.569898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:35:12.569898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:35:12.569898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:12.569898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:12.569898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 419/835] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:35:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:12.570396 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18303646-b60d-47f6-b008-3288e03be30b None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:12.570396 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18303646-b60d-47f6-b008-3288e03be30b None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:12.570530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18303646-b60d-47f6-b008-3288e03be30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:12.588742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-18303646-b60d-47f6-b008-3288e03be30b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:12.590017 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-18303646-b60d-47f6-b008-3288e03be30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:12.603149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248eb07-1cb6-4dd5-b4e4-4105be541ccc None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:12.638766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6f17a-e9b3-4aab-815c-32949fd24365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:12.639778 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6f17a-e9b3-4aab-815c-32949fd24365 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:12.640305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6f17a-e9b3-4aab-815c-32949fd24365 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:12.640824 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6f17a-e9b3-4aab-815c-32949fd24365 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:12.641587 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6f17a-e9b3-4aab-815c-32949fd24365 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:12.641901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6f17a-e9b3-4aab-815c-32949fd24365 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:12.643344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6f17a-e9b3-4aab-815c-32949fd24365 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:12.655306 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 417/836] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jul 19 20:35:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:12.655306 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6f17a-e9b3-4aab-815c-32949fd24365 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:12.673185 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 420/837] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:12.697573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18303646-b60d-47f6-b008-3288e03be30b None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:12.713882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:12.806437 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6f17a-e9b3-4aab-815c-32949fd24365 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:12.817762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18303646-b60d-47f6-b008-3288e03be30b None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:12.829993 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:12.859717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766eae11-b88b-4d78-b860-1698b23ec649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:12.860685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766eae11-b88b-4d78-b860-1698b23ec649 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:12.861176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766eae11-b88b-4d78-b860-1698b23ec649 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:12.861658 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766eae11-b88b-4d78-b860-1698b23ec649 None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:12.862630 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766eae11-b88b-4d78-b860-1698b23ec649 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:12.863126 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766eae11-b88b-4d78-b860-1698b23ec649 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:12.864894 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766eae11-b88b-4d78-b860-1698b23ec649 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:12.870156 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5946812-c13b-49c8-9fe7-c32cc1b42edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:12.871024 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5946812-c13b-49c8-9fe7-c32cc1b42edd None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:12.871334 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5946812-c13b-49c8-9fe7-c32cc1b42edd None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:12.871612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5946812-c13b-49c8-9fe7-c32cc1b42edd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:12.879308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 418/838] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:35:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:12.885237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5946812-c13b-49c8-9fe7-c32cc1b42edd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:35:12.887580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766eae11-b88b-4d78-b860-1698b23ec649 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:12.894738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-d5946812-c13b-49c8-9fe7-c32cc1b42edd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:35:12.894738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:12.894738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:12.894738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:12.894738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:12.894738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:12.894738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:12.894738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:12.894738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:12.894738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:12.894738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:12.894738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:12.894738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:35:12.894738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:35:12.894738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:35:12.894738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:35:12.896135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:35:12.896135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:35:12.896135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:35:12.896135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:35:12.896135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:12.896135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:12.896135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:12.896135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:12.896135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:12.896135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:12.896135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:12.896135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:12.896135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:12.896135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:12.896135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:12.896135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:12.896997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:12.896997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:12.896997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:12.896997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:12.896997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:35:12.896997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:35:12.896997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:35:12.896997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:35:12.896997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:35:12.896997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:35:12.896997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:35:12.896997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:12.901082 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 421/839] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:35:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:12.902302 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5946812-c13b-49c8-9fe7-c32cc1b42edd None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:13.001166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:13.005934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766eae11-b88b-4d78-b860-1698b23ec649 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:13.021696 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5946812-c13b-49c8-9fe7-c32cc1b42edd None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:13.043373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c217625-4167-4ca6-9ec2-03fc2a8a0d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:13.044562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c217625-4167-4ca6-9ec2-03fc2a8a0d02 None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:13.045055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c217625-4167-4ca6-9ec2-03fc2a8a0d02 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:13.045512 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c217625-4167-4ca6-9ec2-03fc2a8a0d02 None admin] PATH_INFO: `/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/c8f314167aa94d81955ac761a5a28504/roles/e5e7de76725748df9add27e3c837d8ef` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:13.060039 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6310a1-9f27-4475-8fe1-24929d054018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:13.060670 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6310a1-9f27-4475-8fe1-24929d054018 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:13.060958 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6310a1-9f27-4475-8fe1-24929d054018 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:13.061239 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6310a1-9f27-4475-8fe1-24929d054018 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:13.061988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6310a1-9f27-4475-8fe1-24929d054018 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:13.062297 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6310a1-9f27-4475-8fe1-24929d054018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:13.062547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c217625-4167-4ca6-9ec2-03fc2a8a0d02 None admin] RBAC: Authorizing `identity:create_grant(project_id=327868f4f62e4e4a9c5bef4acd32fb29, user_id=c8f314167aa94d81955ac761a5a28504, role_id=e5e7de76725748df9add27e3c837d8ef)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:13.063701 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6310a1-9f27-4475-8fe1-24929d054018 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:13.064434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c217625-4167-4ca6-9ec2-03fc2a8a0d02 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:13.078088 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 422/840] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:35:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:13.079558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6310a1-9f27-4475-8fe1-24929d054018 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:13.081605 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 419/841] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:35:12 2022] PUT /identity/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/c8f314167aa94d81955ac761a5a28504/roles/e5e7de76725748df9add27e3c837d8ef => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:35:13.133869 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:13.321571 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6310a1-9f27-4475-8fe1-24929d054018 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:13.357699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450aad3f-3ddf-4e95-ac41-34311750479f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:13.358506 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450aad3f-3ddf-4e95-ac41-34311750479f None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:13.358790 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450aad3f-3ddf-4e95-ac41-34311750479f None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:13.359066 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450aad3f-3ddf-4e95-ac41-34311750479f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:13.370211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450aad3f-3ddf-4e95-ac41-34311750479f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:13.371682 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450aad3f-3ddf-4e95-ac41-34311750479f None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:13.389406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-450aad3f-3ddf-4e95-ac41-34311750479f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:13.389406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:13.389406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:13.389406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:13.389406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:13.389406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:13.389406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:13.389406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:13.389406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:13.389406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:13.389406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:13.389406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:13.389406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:13.389406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:13.389406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:13.390422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:13.390422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:13.390422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:13.390422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:13.390422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:13.390422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:13.390422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:13.390422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:13.390422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:13.390422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:13.390422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:13.390422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:13.390422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:13.390422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:13.390422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:13.390422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:13.390422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:13.391366 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:13.391366 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:13.391366 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:13.391366 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:13.395314 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 423/842] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:13.396671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c217625-4167-4ca6-9ec2-03fc2a8a0d02 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:13.507192 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c217625-4167-4ca6-9ec2-03fc2a8a0d02 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:13.546030 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae214042-87d3-4edb-9635-e7927a360077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:13.547053 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae214042-87d3-4edb-9635-e7927a360077 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:13.547640 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae214042-87d3-4edb-9635-e7927a360077 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:13.548174 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae214042-87d3-4edb-9635-e7927a360077 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:13.549252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae214042-87d3-4edb-9635-e7927a360077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:13.549784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae214042-87d3-4edb-9635-e7927a360077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:13.551389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae214042-87d3-4edb-9635-e7927a360077 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:13.564310 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 420/843] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:13.570804 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450aad3f-3ddf-4e95-ac41-34311750479f None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:13.658847 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:13.679964 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450aad3f-3ddf-4e95-ac41-34311750479f None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:13.715445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8ceb5-5571-4610-8fc5-3dce0e1a4599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:13.716524 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8ceb5-5571-4610-8fc5-3dce0e1a4599 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:13.716960 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8ceb5-5571-4610-8fc5-3dce0e1a4599 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:13.717384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8ceb5-5571-4610-8fc5-3dce0e1a4599 None admin] PATH_INFO: `/v3/users/swift` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:13.725450 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8ceb5-5571-4610-8fc5-3dce0e1a4599 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:13.727065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8ceb5-5571-4610-8fc5-3dce0e1a4599 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:13.742835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-aaa8ceb5-5571-4610-8fc5-3dce0e1a4599 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 20:35:13.742835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:13.742835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:13.742835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:13.742835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:13.742835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:13.742835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:13.742835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:13.742835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:13.742835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:13.742835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:13.742835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:13.742835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:35:13.742835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:35:13.742835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:35:13.742835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:35:13.744078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:13.744078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:13.744078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:35:13.744078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:13.744078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:35:13.744078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:13.744078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:13.744078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:13.744078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:13.744078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:13.744078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:13.744078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:13.744078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:13.744078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:13.744078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:13.744078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:13.744078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:13.744078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:13.745281 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:13.745281 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:13.745281 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:35:13.745281 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:35:13.745281 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:35:13.745281 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:35:13.745281 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:35:13.745281 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:35:13.745281 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 20:35:13.745281 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:13.747594 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 424/844] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:35:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:13.753587 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae214042-87d3-4edb-9635-e7927a360077 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:13.766475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:13.868826 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae214042-87d3-4edb-9635-e7927a360077 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:13.922337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891450e-ddad-46e4-a161-5f372ac7d1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:13.923349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891450e-ddad-46e4-a161-5f372ac7d1e9 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:13.923786 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891450e-ddad-46e4-a161-5f372ac7d1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:13.924389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891450e-ddad-46e4-a161-5f372ac7d1e9 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:13.925403 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891450e-ddad-46e4-a161-5f372ac7d1e9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:13.925862 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891450e-ddad-46e4-a161-5f372ac7d1e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:13.927808 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891450e-ddad-46e4-a161-5f372ac7d1e9 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:13.946662 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 421/845] 10.222.0.77 () {56 vars in 1135 bytes} [Tue Jul 19 20:35:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:13.952648 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8ceb5-5571-4610-8fc5-3dce0e1a4599 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:14.060068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8ceb5-5571-4610-8fc5-3dce0e1a4599 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:14.088651 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1252bd8-0f01-4613-9f6d-75ff55eedd50 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:14.088937 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1252bd8-0f01-4613-9f6d-75ff55eedd50 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:14.089213 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1252bd8-0f01-4613-9f6d-75ff55eedd50 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:14.090965 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 422/846] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:35:14.095614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8dd99-bfcd-4769-bd59-5597858ab598 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:14.095904 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8dd99-bfcd-4769-bd59-5597858ab598 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:14.096191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee8dd99-bfcd-4769-bd59-5597858ab598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:14.096361 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2f0e7-0b83-42dc-a2db-ee8e699f18cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:14.097168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2f0e7-0b83-42dc-a2db-ee8e699f18cd None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:14.097715 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2f0e7-0b83-42dc-a2db-ee8e699f18cd None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:14.098221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2f0e7-0b83-42dc-a2db-ee8e699f18cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:14.111130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:14.115126 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-6ee8dd99-bfcd-4769-bd59-5597858ab598 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:14.117318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-6ee8dd99-bfcd-4769-bd59-5597858ab598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:14.180612 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:14.187548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2f0e7-0b83-42dc-a2db-ee8e699f18cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:14.189219 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2f0e7-0b83-42dc-a2db-ee8e699f18cd None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:14.190423 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 423/847] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 20:35:14.213246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8dd99-bfcd-4769-bd59-5597858ab598 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:14.323395 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 425/848] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:35:13 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 20:35:14.337462 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2f0e7-0b83-42dc-a2db-ee8e699f18cd None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:14.400343 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:14.416090 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee8dd99-bfcd-4769-bd59-5597858ab598 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:14.452360 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc4f92-4038-4a76-8a57-388522408829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:14.453583 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc4f92-4038-4a76-8a57-388522408829 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:14.454117 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc4f92-4038-4a76-8a57-388522408829 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:14.454593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc4f92-4038-4a76-8a57-388522408829 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:14.455473 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc4f92-4038-4a76-8a57-388522408829 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:14.457069 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc4f92-4038-4a76-8a57-388522408829 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:14.470048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-cacc4f92-4038-4a76-8a57-388522408829 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 20:35:14.470048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:14.470048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:35:14.470048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:35:14.470048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:35:14.470048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:35:14.470048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:35:14.470048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:14.470048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 20:35:14.470048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:14.470048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:14.470048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:14.470048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:14.470048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:14.470048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:14.470048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:14.471110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:14.471110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:14.471110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:14.471110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:14.471110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:14.471110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:14.471110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:14.471110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:35:14.471110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:35:14.471110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:35:14.471110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:35:14.471110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:14.471110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:14.471110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:14.471110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:14.471110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:14.472372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:14.472372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:14.472372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:14.472372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:14.472372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:14.472372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:14.472372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:14.472372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:14.472372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:14.472372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:14.472372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:14.472372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:35:14.472372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:14.472372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 20:35:14.472372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:14.479368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 424/849] 10.222.0.77 () {56 vars in 1132 bytes} [Tue Jul 19 20:35:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:14.481824 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc4f92-4038-4a76-8a57-388522408829 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:14.505999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2f0e7-0b83-42dc-a2db-ee8e699f18cd None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:14.562028 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54059aa2-aa38-4313-8dc4-471f764c1f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:14.562848 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54059aa2-aa38-4313-8dc4-471f764c1f99 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:14.563129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54059aa2-aa38-4313-8dc4-471f764c1f99 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:14.563958 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54059aa2-aa38-4313-8dc4-471f764c1f99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:14.582601 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54059aa2-aa38-4313-8dc4-471f764c1f99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:14.584919 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54059aa2-aa38-4313-8dc4-471f764c1f99 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:14.606209 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:14.617253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-54059aa2-aa38-4313-8dc4-471f764c1f99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:14.617253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:14.617253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:14.617253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:14.617253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:14.617253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:14.617253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:14.617253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:14.617253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:14.617253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:14.617253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:14.617253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:14.617253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:14.617253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:14.617253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:14.618166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:14.618166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:14.618166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:14.618166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:14.618166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:14.618166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:14.618166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:14.618166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:14.618166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:14.618166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:14.618166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:14.618166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:14.618166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:14.618166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:14.618166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:14.618166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:14.618166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:14.619065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:14.619065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:14.619065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:14.619065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:14.624568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 426/850] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:14.625927 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54059aa2-aa38-4313-8dc4-471f764c1f99 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:14.688861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc4f92-4038-4a76-8a57-388522408829 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:14.760440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270fb4e-d6a0-419a-8926-d46aebb63dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:14.762690 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270fb4e-d6a0-419a-8926-d46aebb63dd1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:14.764032 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270fb4e-d6a0-419a-8926-d46aebb63dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:14.764860 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270fb4e-d6a0-419a-8926-d46aebb63dd1 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:14.767221 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270fb4e-d6a0-419a-8926-d46aebb63dd1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:14.768077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270fb4e-d6a0-419a-8926-d46aebb63dd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:14.771467 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270fb4e-d6a0-419a-8926-d46aebb63dd1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:14.789088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 425/851] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Jul 19 20:35:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:14.790246 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:14.795418 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270fb4e-d6a0-419a-8926-d46aebb63dd1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:14.806941 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54059aa2-aa38-4313-8dc4-471f764c1f99 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:14.869673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06c96e-ec9d-4be2-a8d3-65d774d389ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:14.870352 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06c96e-ec9d-4be2-a8d3-65d774d389ab None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:14.870635 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06c96e-ec9d-4be2-a8d3-65d774d389ab None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:14.870910 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06c96e-ec9d-4be2-a8d3-65d774d389ab None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:14.871675 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06c96e-ec9d-4be2-a8d3-65d774d389ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:14.871997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06c96e-ec9d-4be2-a8d3-65d774d389ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:14.873703 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06c96e-ec9d-4be2-a8d3-65d774d389ab None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:14.891312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 427/852] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:14.891312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee19320-0fcf-431e-893a-e759f4a08e7d None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:14.891312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee19320-0fcf-431e-893a-e759f4a08e7d None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:14.891312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee19320-0fcf-431e-893a-e759f4a08e7d None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:14.891312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 428/853] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:14.892580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee19320-0fcf-431e-893a-e759f4a08e7d None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:14.945940 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270fb4e-d6a0-419a-8926-d46aebb63dd1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:14.970625 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:14.982737 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27c216-7292-4e83-81a2-af1803ad7681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:14.983555 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27c216-7292-4e83-81a2-af1803ad7681 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:14.983840 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27c216-7292-4e83-81a2-af1803ad7681 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:14.984115 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27c216-7292-4e83-81a2-af1803ad7681 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:14.984820 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27c216-7292-4e83-81a2-af1803ad7681 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:14.985129 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27c216-7292-4e83-81a2-af1803ad7681 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:14.986725 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27c216-7292-4e83-81a2-af1803ad7681 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:14.998482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 426/854] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Jul 19 20:35:14 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:14.998482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10d411-f1d3-41db-871a-99fff7293db0 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:14.998482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10d411-f1d3-41db-871a-99fff7293db0 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:14.998482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10d411-f1d3-41db-871a-99fff7293db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:15.003627 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee19320-0fcf-431e-893a-e759f4a08e7d None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:15.019127 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-da10d411-f1d3-41db-871a-99fff7293db0 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:15.022292 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-da10d411-f1d3-41db-871a-99fff7293db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:15.050671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50785e57-cfc5-4fb2-af78-94af7d9067e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:15.052328 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50785e57-cfc5-4fb2-af78-94af7d9067e1 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:15.052609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50785e57-cfc5-4fb2-af78-94af7d9067e1 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:15.052885 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50785e57-cfc5-4fb2-af78-94af7d9067e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:15.066155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50785e57-cfc5-4fb2-af78-94af7d9067e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:15.069563 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50785e57-cfc5-4fb2-af78-94af7d9067e1 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:15.089575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-50785e57-cfc5-4fb2-af78-94af7d9067e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:15.089575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:15.089575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:15.089575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:15.089575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:15.089575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:15.089575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:15.089575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:15.089575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:15.089575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:15.089575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:15.089575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:15.089575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:35:15.089575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:35:15.089575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:35:15.090568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:35:15.090568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:15.090568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:15.090568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:15.090568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:15.090568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:15.090568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:15.090568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:15.090568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:15.090568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:15.090568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:15.090568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:15.090568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:15.090568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:15.090568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:15.090568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:15.090568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:15.091494 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:35:15.091494 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:35:15.091494 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:35:15.091494 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:35:15.091494 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:35:15.091494 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:35:15.091494 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:15.091494 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:15.095333 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 429/855] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:35:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:15.096678 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50785e57-cfc5-4fb2-af78-94af7d9067e1 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:15.112999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:15.134794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 427/856] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:15.156937 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10d411-f1d3-41db-871a-99fff7293db0 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:15.224750 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50785e57-cfc5-4fb2-af78-94af7d9067e1 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:15.262228 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05184f-fe38-4216-ac9a-c64325d8bbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:15.262896 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05184f-fe38-4216-ac9a-c64325d8bbdb None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:15.263141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10d411-f1d3-41db-871a-99fff7293db0 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:15.263248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05184f-fe38-4216-ac9a-c64325d8bbdb None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:15.263471 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05184f-fe38-4216-ac9a-c64325d8bbdb None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:15.264263 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05184f-fe38-4216-ac9a-c64325d8bbdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:15.264682 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05184f-fe38-4216-ac9a-c64325d8bbdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:15.266225 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05184f-fe38-4216-ac9a-c64325d8bbdb None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:15.284022 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 430/857] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:35:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:15.284022 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3425e27-8cf8-417c-a302-9b4dbd35728f None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:15.284022 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3425e27-8cf8-417c-a302-9b4dbd35728f None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:15.284022 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3425e27-8cf8-417c-a302-9b4dbd35728f None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:15.284022 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 431/858] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:15.288073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3425e27-8cf8-417c-a302-9b4dbd35728f None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:15.289005 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:15.305657 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fe83f-4dce-459d-9ea0-1b4d8e325f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:15.306349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fe83f-4dce-459d-9ea0-1b4d8e325f86 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:15.306632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fe83f-4dce-459d-9ea0-1b4d8e325f86 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:15.306907 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fe83f-4dce-459d-9ea0-1b4d8e325f86 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:15.307672 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fe83f-4dce-459d-9ea0-1b4d8e325f86 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:15.309028 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fe83f-4dce-459d-9ea0-1b4d8e325f86 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:15.324669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 428/859] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jul 19 20:35:15 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:35:15.326251 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491a110-dda4-46de-8b54-c0700f73a435 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:15.326691 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491a110-dda4-46de-8b54-c0700f73a435 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:15.327118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491a110-dda4-46de-8b54-c0700f73a435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:15.345554 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-2491a110-dda4-46de-8b54-c0700f73a435 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:15.347059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-2491a110-dda4-46de-8b54-c0700f73a435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:15.392026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:15.439917 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3425e27-8cf8-417c-a302-9b4dbd35728f None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:15.455743 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 429/860] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:15 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:15.472894 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491a110-dda4-46de-8b54-c0700f73a435 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:15.484104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b08e2b-b2de-410a-8b06-b7533808a534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:15.484782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b08e2b-b2de-410a-8b06-b7533808a534 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:15.485417 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b08e2b-b2de-410a-8b06-b7533808a534 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:15.485596 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b08e2b-b2de-410a-8b06-b7533808a534 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:15.486468 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b08e2b-b2de-410a-8b06-b7533808a534 None admin] RBAC: Adding query filter params (role.id=b30f01ef95004a1b84fc029830bdf053, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=7987846276ad4ccd90899128ceb1354e) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:15.486785 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b08e2b-b2de-410a-8b06-b7533808a534 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:15.488617 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b08e2b-b2de-410a-8b06-b7533808a534 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:15.497991 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 432/861] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:35:15 2022] GET /identity/v3/role_assignments?user.id=7987846276ad4ccd90899128ceb1354e&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=b30f01ef95004a1b84fc029830bdf053 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:15.601672 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491a110-dda4-46de-8b54-c0700f73a435 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:15.612654 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:15.642359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da641a56-f43e-40ec-8784-2e3b2ef3c122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:15.643183 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da641a56-f43e-40ec-8784-2e3b2ef3c122 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:15.643505 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da641a56-f43e-40ec-8784-2e3b2ef3c122 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:15.643782 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da641a56-f43e-40ec-8784-2e3b2ef3c122 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:15.656043 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da641a56-f43e-40ec-8784-2e3b2ef3c122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:35:15.665154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-da641a56-f43e-40ec-8784-2e3b2ef3c122 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:35:15.665154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:15.665154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:15.665154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:15.665154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:15.665154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:15.665154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:15.665154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:15.665154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:15.665154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:15.665154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:15.665154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:15.665154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:35:15.665154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:35:15.665154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:35:15.665154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:35:15.666219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:35:15.666219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:35:15.666219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:35:15.666219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:35:15.666219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:15.666219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:15.666219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:15.666219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:15.666219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:15.666219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:15.666219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:15.666219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:15.666219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:15.666219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:15.666219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:15.666219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:15.667545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:15.667545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:15.667545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:15.667545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:15.667545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:35:15.667545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:35:15.667545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:35:15.667545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:35:15.667545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:35:15.667545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:35:15.667545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:35:15.667545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:15.667545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 430/862] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:35:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:15.672952 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b08e2b-b2de-410a-8b06-b7533808a534 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:15.780800 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b08e2b-b2de-410a-8b06-b7533808a534 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:15.811586 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:15.818185 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274ad03-3ec6-44ef-aae4-50f9bbfe26d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:15.818863 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274ad03-3ec6-44ef-aae4-50f9bbfe26d5 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:15.819149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274ad03-3ec6-44ef-aae4-50f9bbfe26d5 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:15.819472 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274ad03-3ec6-44ef-aae4-50f9bbfe26d5 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:15.820276 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274ad03-3ec6-44ef-aae4-50f9bbfe26d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:15.820609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274ad03-3ec6-44ef-aae4-50f9bbfe26d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:15.822058 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274ad03-3ec6-44ef-aae4-50f9bbfe26d5 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:15.831546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 433/863] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jul 19 20:35:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:15.840463 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da641a56-f43e-40ec-8784-2e3b2ef3c122 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:15.954109 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da641a56-f43e-40ec-8784-2e3b2ef3c122 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:15.990299 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4f2de-6d4d-4803-a85e-59df7d3c50af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:15.991099 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4f2de-6d4d-4803-a85e-59df7d3c50af None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:15.991413 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4f2de-6d4d-4803-a85e-59df7d3c50af None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:15.991688 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4f2de-6d4d-4803-a85e-59df7d3c50af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:16.002737 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4f2de-6d4d-4803-a85e-59df7d3c50af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:16.004265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4f2de-6d4d-4803-a85e-59df7d3c50af None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:16.022279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-4ce4f2de-6d4d-4803-a85e-59df7d3c50af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:16.022279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:16.022279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:16.022279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:16.022279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:16.022279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:16.022279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:16.022279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:16.022279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:16.022279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:16.022279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:16.022279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:16.022279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:16.022279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:16.022279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:16.024506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:16.024506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:16.024506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:16.024506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:16.024506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:16.024506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:16.024506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:16.024506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:16.024506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:16.024506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:16.024506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:16.024506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:16.024506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:16.024506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:16.024506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:16.024506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:16.024506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:16.026176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:16.026176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:16.026176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:16.026176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:16.026176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 431/864] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:16.029355 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274ad03-3ec6-44ef-aae4-50f9bbfe26d5 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:16.137167 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274ad03-3ec6-44ef-aae4-50f9bbfe26d5 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:16.174539 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce93e5-fc58-408d-9849-66cee0098cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:16.175127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce93e5-fc58-408d-9849-66cee0098cfb None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:16.175440 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce93e5-fc58-408d-9849-66cee0098cfb None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:16.175720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce93e5-fc58-408d-9849-66cee0098cfb None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:16.176448 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce93e5-fc58-408d-9849-66cee0098cfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:16.176784 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce93e5-fc58-408d-9849-66cee0098cfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:16.178153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce93e5-fc58-408d-9849-66cee0098cfb None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:16.191093 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 434/865] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:16.196925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4f2de-6d4d-4803-a85e-59df7d3c50af None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:16.221104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:16.304628 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4f2de-6d4d-4803-a85e-59df7d3c50af None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:16.339492 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919b74d-3c47-4658-98c2-b79b9c91d29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:16.340431 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919b74d-3c47-4658-98c2-b79b9c91d29c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:16.340717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919b74d-3c47-4658-98c2-b79b9c91d29c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:16.340996 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919b74d-3c47-4658-98c2-b79b9c91d29c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:16.349334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919b74d-3c47-4658-98c2-b79b9c91d29c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:16.350908 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919b74d-3c47-4658-98c2-b79b9c91d29c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:16.366731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-7919b74d-3c47-4658-98c2-b79b9c91d29c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 20:35:16.366731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:16.366731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:16.366731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:16.366731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:16.366731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:16.366731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:16.366731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:16.366731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:16.366731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:16.366731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:16.366731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:16.366731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:35:16.366731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:35:16.366731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:35:16.366731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:35:16.368969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:16.368969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:16.368969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:35:16.368969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:16.368969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:35:16.368969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:16.368969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:16.368969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:16.368969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:16.368969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:16.368969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:16.368969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:16.368969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:16.368969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:16.368969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:16.368969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:16.368969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:16.368969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:16.371297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:16.371297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:16.371297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:35:16.371297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:35:16.371297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:35:16.371297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:35:16.371297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:35:16.371297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:35:16.371297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 20:35:16.371297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:16.371297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 432/866] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Jul 19 20:35:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:16.374871 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce93e5-fc58-408d-9849-66cee0098cfb None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:16.435935 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:16.482240 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce93e5-fc58-408d-9849-66cee0098cfb None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:16.522998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a068f-7273-49f6-b896-7752cca2a733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:16.524067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a068f-7273-49f6-b896-7752cca2a733 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:16.524552 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a068f-7273-49f6-b896-7752cca2a733 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:16.525027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a068f-7273-49f6-b896-7752cca2a733 None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:16.526085 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a068f-7273-49f6-b896-7752cca2a733 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:16.526604 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a068f-7273-49f6-b896-7752cca2a733 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:16.528263 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a068f-7273-49f6-b896-7752cca2a733 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:16.546821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 435/867] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Jul 19 20:35:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:16.552397 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919b74d-3c47-4658-98c2-b79b9c91d29c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:16.637844 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:16.656859 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919b74d-3c47-4658-98c2-b79b9c91d29c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:16.691071 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeadd25-53cc-437d-985c-e139b230cc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:16.691679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeadd25-53cc-437d-985c-e139b230cc90 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:16.691962 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeadd25-53cc-437d-985c-e139b230cc90 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:16.692752 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeadd25-53cc-437d-985c-e139b230cc90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:16.767187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeadd25-53cc-437d-985c-e139b230cc90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:16.768674 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeadd25-53cc-437d-985c-e139b230cc90 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:16.853546 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:16.875734 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 433/868] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:35:16 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 20:35:16.881473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a068f-7273-49f6-b896-7752cca2a733 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:17.000395 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a068f-7273-49f6-b896-7752cca2a733 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:17.014312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:17.035442 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395965a-b0ae-4c34-bd2a-bfb1b1ccd62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:17.036518 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395965a-b0ae-4c34-bd2a-bfb1b1ccd62f None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:17.036799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395965a-b0ae-4c34-bd2a-bfb1b1ccd62f None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:17.037069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395965a-b0ae-4c34-bd2a-bfb1b1ccd62f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:17.047514 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395965a-b0ae-4c34-bd2a-bfb1b1ccd62f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:17.048938 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395965a-b0ae-4c34-bd2a-bfb1b1ccd62f None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:17.067208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-0395965a-b0ae-4c34-bd2a-bfb1b1ccd62f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:17.067208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:17.067208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:17.067208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:17.067208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:17.067208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:17.067208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:17.067208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:17.067208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:17.067208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:17.067208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:17.067208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:17.067208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:17.067208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:17.067208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:17.068200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:17.068200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:17.068200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:17.068200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:17.068200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:17.068200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:17.068200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:17.068200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:17.068200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:17.068200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:17.068200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:17.068200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:17.068200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:17.068200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:17.068200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:17.068200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:17.068200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:17.069101 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:17.069101 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:17.069101 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:17.069101 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:17.069101 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 436/869] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:17.074265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeadd25-53cc-437d-985c-e139b230cc90 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:17.119894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a72d2a-7514-459f-b99a-2c09f8a06873 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:17.120216 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a72d2a-7514-459f-b99a-2c09f8a06873 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:17.120509 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a72d2a-7514-459f-b99a-2c09f8a06873 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:17.121919 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 437/870] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:35:17.128494 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ed381-9b36-4dbb-91b0-32915d450b58 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:17.128824 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ed381-9b36-4dbb-91b0-32915d450b58 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:17.129049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ed381-9b36-4dbb-91b0-32915d450b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:17.154437 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-6f6ed381-9b36-4dbb-91b0-32915d450b58 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:17.156071 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-6f6ed381-9b36-4dbb-91b0-32915d450b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:17.189556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeadd25-53cc-437d-985c-e139b230cc90 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:17.233866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ea5cc-2a3e-4366-b831-39ea4ecbee98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:17.234776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ea5cc-2a3e-4366-b831-39ea4ecbee98 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:17.235057 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ea5cc-2a3e-4366-b831-39ea4ecbee98 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:17.235372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ea5cc-2a3e-4366-b831-39ea4ecbee98 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:17.236501 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ea5cc-2a3e-4366-b831-39ea4ecbee98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:17.236811 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ea5cc-2a3e-4366-b831-39ea4ecbee98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:17.238411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ea5cc-2a3e-4366-b831-39ea4ecbee98 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:17.250589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 438/871] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:17 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 20:35:17.257260 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 434/872] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:17.258435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ed381-9b36-4dbb-91b0-32915d450b58 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:17.274946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ea5cc-2a3e-4366-b831-39ea4ecbee98 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:17.334632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:17.370565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:17.384201 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ed381-9b36-4dbb-91b0-32915d450b58 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:17.407225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ea5cc-2a3e-4366-b831-39ea4ecbee98 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:17.424089 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba762b80-be59-454b-945a-d774b71ebd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:17.424089 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba762b80-be59-454b-945a-d774b71ebd5d None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:17.424089 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba762b80-be59-454b-945a-d774b71ebd5d None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:17.424089 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba762b80-be59-454b-945a-d774b71ebd5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:17.434876 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba762b80-be59-454b-945a-d774b71ebd5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:17.436677 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba762b80-be59-454b-945a-d774b71ebd5d None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:17.450022 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fab569-d888-4047-9b0d-79cc8dd1410c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:17.450942 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fab569-d888-4047-9b0d-79cc8dd1410c None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:17.451438 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fab569-d888-4047-9b0d-79cc8dd1410c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:17.451921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fab569-d888-4047-9b0d-79cc8dd1410c None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:17.452831 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fab569-d888-4047-9b0d-79cc8dd1410c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:17.454388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fab569-d888-4047-9b0d-79cc8dd1410c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:17.454642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-ba762b80-be59-454b-945a-d774b71ebd5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:17.454642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:17.454642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:17.454642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:17.454642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:17.454642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:17.454642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:17.454642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:17.454642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:17.454642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:17.454642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:17.454642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:17.454642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:35:17.454642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:35:17.454642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:35:17.455633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:35:17.455633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:17.455633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:17.455633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:17.455633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:17.455633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:17.455633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:17.455633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:17.455633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:17.455633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:17.455633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:17.455633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:17.455633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:17.455633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:17.455633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:17.455633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:17.455633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:17.456526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:35:17.456526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:35:17.456526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:35:17.456526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:35:17.456526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:35:17.456526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:35:17.456526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:17.456526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:17.460988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 439/873] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:35:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:17.462531 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba762b80-be59-454b-945a-d774b71ebd5d None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:17.476447 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 435/874] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jul 19 20:35:17 2022] POST /identity/v3/services => generated 269 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:35:17.589512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba762b80-be59-454b-945a-d774b71ebd5d None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:17.590698 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4143c0-a24c-4d44-80b6-654130676598 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:17.591056 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4143c0-a24c-4d44-80b6-654130676598 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:17.591427 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4143c0-a24c-4d44-80b6-654130676598 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:17.593186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 436/875] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:35:17.599613 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec09930-9f4e-4648-8e2c-82e5a33bc512 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:17.600036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec09930-9f4e-4648-8e2c-82e5a33bc512 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:17.600335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec09930-9f4e-4648-8e2c-82e5a33bc512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:17.622537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-eec09930-9f4e-4648-8e2c-82e5a33bc512 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:17.624004 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-eec09930-9f4e-4648-8e2c-82e5a33bc512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:17.636931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20900289-f3f7-4b47-844c-8470f07054c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:17.637814 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20900289-f3f7-4b47-844c-8470f07054c0 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:17.638102 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20900289-f3f7-4b47-844c-8470f07054c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:17.638378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20900289-f3f7-4b47-844c-8470f07054c0 None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:17.639309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20900289-f3f7-4b47-844c-8470f07054c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:17.639616 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20900289-f3f7-4b47-844c-8470f07054c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:17.641163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20900289-f3f7-4b47-844c-8470f07054c0 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:17.658103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 440/876] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:35:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:17.664365 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20900289-f3f7-4b47-844c-8470f07054c0 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:17.678003 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:17.717360 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 437/877] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 20:35:17.745901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec09930-9f4e-4648-8e2c-82e5a33bc512 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:17.783743 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:17.792140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20900289-f3f7-4b47-844c-8470f07054c0 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:17.829421 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1663a0e6-e058-47de-bc14-b5c23a9936ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:17.830079 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663a0e6-e058-47de-bc14-b5c23a9936ed None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:17.830366 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663a0e6-e058-47de-bc14-b5c23a9936ed None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:17.830648 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1663a0e6-e058-47de-bc14-b5c23a9936ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:17.831516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663a0e6-e058-47de-bc14-b5c23a9936ed None admin] RBAC: Adding query filter params (role.id=e5e7de76725748df9add27e3c837d8ef, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=c8f314167aa94d81955ac761a5a28504) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:17.831830 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663a0e6-e058-47de-bc14-b5c23a9936ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:17.833787 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1663a0e6-e058-47de-bc14-b5c23a9936ed None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:17.839991 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 441/878] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:35:17 2022] GET /identity/v3/role_assignments?user.id=c8f314167aa94d81955ac761a5a28504&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=e5e7de76725748df9add27e3c837d8ef => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:17.841162 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7425d-cdce-4b52-946e-12785af8e151 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:17.841450 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7425d-cdce-4b52-946e-12785af8e151 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:17.841727 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7425d-cdce-4b52-946e-12785af8e151 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:17.843132 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 442/879] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:17.853374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b2488-a7bd-4a68-b0d2-c8132d9ace9e None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:17.854281 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b2488-a7bd-4a68-b0d2-c8132d9ace9e None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:17.854281 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b2488-a7bd-4a68-b0d2-c8132d9ace9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:17.873904 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-5f8b2488-a7bd-4a68-b0d2-c8132d9ace9e None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:17.875468 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-5f8b2488-a7bd-4a68-b0d2-c8132d9ace9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:17.880252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec09930-9f4e-4648-8e2c-82e5a33bc512 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:17.930280 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6392ab-7b3b-4608-bc41-8bcfd00542a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:17.931534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6392ab-7b3b-4608-bc41-8bcfd00542a3 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:17.932055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6392ab-7b3b-4608-bc41-8bcfd00542a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:17.932550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6392ab-7b3b-4608-bc41-8bcfd00542a3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:17.933475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6392ab-7b3b-4608-bc41-8bcfd00542a3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:17.935140 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6392ab-7b3b-4608-bc41-8bcfd00542a3 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:17.949171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-5f6392ab-7b3b-4608-bc41-8bcfd00542a3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 20:35:17.949171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:17.949171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:35:17.949171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:35:17.949171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:35:17.949171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:35:17.949171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:35:17.949171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:17.949171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 20:35:17.949171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:17.949171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:17.949171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:17.949171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:17.949171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:17.949171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:17.949171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:17.949171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:17.950317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:17.950317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:17.950317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:17.950317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:17.950317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:17.950317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:17.950317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:35:17.950317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:35:17.950317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:35:17.950317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:35:17.950317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:17.950317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:17.950317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:17.950317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:17.950317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:17.950317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:17.951188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:17.951188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:17.951188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:17.951188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:17.951188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:17.951188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:17.951188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:17.951188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:17.951188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:17.951188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:17.951188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:35:17.951188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:17.951188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 20:35:17.951188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:17.959230 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 438/880] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jul 19 20:35:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:17.961021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6392ab-7b3b-4608-bc41-8bcfd00542a3 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:17.967466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 443/881] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:17.985659 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b2488-a7bd-4a68-b0d2-c8132d9ace9e None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:17.989002 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:18.067994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:18.080075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6392ab-7b3b-4608-bc41-8bcfd00542a3 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:18.112770 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b2488-a7bd-4a68-b0d2-c8132d9ace9e None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:18.126775 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fce26-3eb6-4665-8bb1-752a014b8fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:18.127733 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fce26-3eb6-4665-8bb1-752a014b8fa0 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:18.128224 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fce26-3eb6-4665-8bb1-752a014b8fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:18.128737 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55fce26-3eb6-4665-8bb1-752a014b8fa0 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:18.129444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55fce26-3eb6-4665-8bb1-752a014b8fa0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:18.130327 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55fce26-3eb6-4665-8bb1-752a014b8fa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:18.131885 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55fce26-3eb6-4665-8bb1-752a014b8fa0 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:18.136948 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 439/882] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jul 19 20:35:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:18.143199 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fce26-3eb6-4665-8bb1-752a014b8fa0 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:18.154910 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39053285-98f3-429d-b1b0-f325bc71aa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:18.155760 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39053285-98f3-429d-b1b0-f325bc71aa82 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:18.156043 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39053285-98f3-429d-b1b0-f325bc71aa82 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:18.156319 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39053285-98f3-429d-b1b0-f325bc71aa82 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:18.157224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39053285-98f3-429d-b1b0-f325bc71aa82 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:18.158340 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39053285-98f3-429d-b1b0-f325bc71aa82 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:18.170905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-39053285-98f3-429d-b1b0-f325bc71aa82 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 20:35:18.170905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:18.170905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:35:18.170905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:35:18.170905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:35:18.170905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:35:18.170905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:35:18.170905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:18.170905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 20:35:18.170905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:18.170905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:18.170905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:18.170905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:18.170905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:18.170905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:18.170905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:18.170905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:18.171970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:18.171970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:18.171970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:18.171970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:18.171970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:18.171970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:18.171970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:35:18.171970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:35:18.171970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:35:18.171970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:35:18.171970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:18.171970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:18.171970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:18.171970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:18.171970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:18.171970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:18.172828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:18.172828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:18.172828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:18.172828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:18.172828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:18.172828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:18.172828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:18.172828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:18.172828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:18.172828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:18.172828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:35:18.172828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:18.172828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 20:35:18.172828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:18.172828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 444/883] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Jul 19 20:35:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:18.178271 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39053285-98f3-429d-b1b0-f325bc71aa82 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:18.264995 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55fce26-3eb6-4665-8bb1-752a014b8fa0 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:18.265761 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:18.304919 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83cc74-621c-4ea6-a0ed-a22d311e7570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:18.306048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83cc74-621c-4ea6-a0ed-a22d311e7570 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:18.306625 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83cc74-621c-4ea6-a0ed-a22d311e7570 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:18.307153 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83cc74-621c-4ea6-a0ed-a22d311e7570 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:18.308166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83cc74-621c-4ea6-a0ed-a22d311e7570 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:18.308698 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83cc74-621c-4ea6-a0ed-a22d311e7570 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:18.309593 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39053285-98f3-429d-b1b0-f325bc71aa82 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:18.310526 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83cc74-621c-4ea6-a0ed-a22d311e7570 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:18.321961 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 440/884] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jul 19 20:35:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:18.323166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83cc74-621c-4ea6-a0ed-a22d311e7570 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:18.349517 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:18.353251 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e78611-4572-47c3-b20d-476df9dfe9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:18.354741 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e78611-4572-47c3-b20d-476df9dfe9fa None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:18.355028 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e78611-4572-47c3-b20d-476df9dfe9fa None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:18.355323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e78611-4572-47c3-b20d-476df9dfe9fa None admin] PATH_INFO: `/v3/services` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:18.356456 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e78611-4572-47c3-b20d-476df9dfe9fa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:18.356772 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e78611-4572-47c3-b20d-476df9dfe9fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:18.358423 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e78611-4572-47c3-b20d-476df9dfe9fa None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:18.366259 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 445/885] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Jul 19 20:35:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:18.371464 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e78611-4572-47c3-b20d-476df9dfe9fa None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:18.446817 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83cc74-621c-4ea6-a0ed-a22d311e7570 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:18.489618 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fda761-5491-4504-ab54-609b2108b095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:18.490430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fda761-5491-4504-ab54-609b2108b095 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:18.490710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fda761-5491-4504-ab54-609b2108b095 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:18.490982 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fda761-5491-4504-ab54-609b2108b095 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:18.492095 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fda761-5491-4504-ab54-609b2108b095 None admin] RBAC: Adding query filter params (interface=public, service_id=51931ebb26794df1baa8026952157de3, region_id=RegionOne) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:18.492418 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fda761-5491-4504-ab54-609b2108b095 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:18.494440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fda761-5491-4504-ab54-609b2108b095 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:18.505675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 441/886] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Jul 19 20:35:18 2022] GET /identity/v3/endpoints?service_id=51931ebb26794df1baa8026952157de3&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:18.505839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e78611-4572-47c3-b20d-476df9dfe9fa None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:18.506675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fda761-5491-4504-ab54-609b2108b095 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:18.538816 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:18.544960 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fff3a-fb9e-4e9f-be96-cef7f40e1441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:18.545605 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fff3a-fb9e-4e9f-be96-cef7f40e1441 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:18.545885 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fff3a-fb9e-4e9f-be96-cef7f40e1441 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:18.546254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fff3a-fb9e-4e9f-be96-cef7f40e1441 None admin] PATH_INFO: `/v3/services` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:18.547075 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0fff3a-fb9e-4e9f-be96-cef7f40e1441 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:18.547521 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0fff3a-fb9e-4e9f-be96-cef7f40e1441 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:18.549206 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0fff3a-fb9e-4e9f-be96-cef7f40e1441 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:18.555194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 446/887] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Jul 19 20:35:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:18.610271 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:18.630501 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fda761-5491-4504-ab54-609b2108b095 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:18.670689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91f86d-327e-45e4-b149-af0ed8cc2300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:18.672040 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91f86d-327e-45e4-b149-af0ed8cc2300 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:18.672502 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91f86d-327e-45e4-b149-af0ed8cc2300 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:18.673018 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91f86d-327e-45e4-b149-af0ed8cc2300 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:18.673873 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91f86d-327e-45e4-b149-af0ed8cc2300 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:18.676024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91f86d-327e-45e4-b149-af0ed8cc2300 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:18.685125 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 442/888] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Jul 19 20:35:18 2022] GET /identity/v3/services => generated 1268 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:35:19.685921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad0ac8-b068-4637-b209-1b6467abde63 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:19.686453 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad0ac8-b068-4637-b209-1b6467abde63 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:19.686748 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad0ac8-b068-4637-b209-1b6467abde63 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:19.688536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 447/889] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:19.694823 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bae7c9-bc20-4c35-9f0e-991e4665b240 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:19.695402 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bae7c9-bc20-4c35-9f0e-991e4665b240 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:19.695633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bae7c9-bc20-4c35-9f0e-991e4665b240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:19.714006 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-86bae7c9-bc20-4c35-9f0e-991e4665b240 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:19.715181 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-86bae7c9-bc20-4c35-9f0e-991e4665b240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:19.785229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 443/890] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:19.808149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad0ac8-b068-4637-b209-1b6467abde63 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:19.917097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad0ac8-b068-4637-b209-1b6467abde63 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:19.951298 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137074f1-1c3a-413a-80a5-d551d576d6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:19.952043 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137074f1-1c3a-413a-80a5-d551d576d6bc None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:19.952324 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137074f1-1c3a-413a-80a5-d551d576d6bc None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:19.952593 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137074f1-1c3a-413a-80a5-d551d576d6bc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:19.953235 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137074f1-1c3a-413a-80a5-d551d576d6bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:19.954594 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137074f1-1c3a-413a-80a5-d551d576d6bc None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:19.967378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-137074f1-1c3a-413a-80a5-d551d576d6bc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 20:35:19.967378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:19.967378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:35:19.967378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:35:19.967378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:35:19.967378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:35:19.967378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:35:19.967378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:19.967378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 20:35:19.967378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:19.967378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:19.967378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:19.967378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:19.967378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:19.967378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:19.967378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:19.968339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:19.968339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:19.968339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:19.968339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:19.968339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:19.968339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:19.968339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:19.968339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:35:19.968339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:35:19.968339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:35:19.968339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:35:19.968339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:19.968339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:19.968339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:19.968339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:19.968339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:19.969209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:19.969209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:19.969209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:19.969209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:19.969209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:19.969209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:19.969209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:19.969209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:19.969209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:19.969209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:19.969209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:19.969209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:35:19.969209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:19.969209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 20:35:19.969209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:19.969209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 448/891] 10.222.0.77 () {56 vars in 1132 bytes} [Tue Jul 19 20:35:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:19.975320 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bae7c9-bc20-4c35-9f0e-991e4665b240 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:20.024558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981130ad-877c-4b36-80dc-a26a9ca60a97 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:20.024915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981130ad-877c-4b36-80dc-a26a9ca60a97 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:20.025116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981130ad-877c-4b36-80dc-a26a9ca60a97 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:20.026598 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 449/892] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:35:20.035251 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e4712-1b84-430f-b214-c2a1f02957f2 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:20.035628 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e4712-1b84-430f-b214-c2a1f02957f2 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:20.035830 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e4712-1b84-430f-b214-c2a1f02957f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:20.053914 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-713e4712-1b84-430f-b214-c2a1f02957f2 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:20.055097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-713e4712-1b84-430f-b214-c2a1f02957f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:20.068858 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:20.090531 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bae7c9-bc20-4c35-9f0e-991e4665b240 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:20.113821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:20.127128 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 450/893] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 20:35:20.133872 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f35da6-4b97-42ab-918d-343f5b693e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:20.134543 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f35da6-4b97-42ab-918d-343f5b693e3b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:20.134824 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f35da6-4b97-42ab-918d-343f5b693e3b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:20.135093 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f35da6-4b97-42ab-918d-343f5b693e3b None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:20.135826 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f35da6-4b97-42ab-918d-343f5b693e3b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:20.136127 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f35da6-4b97-42ab-918d-343f5b693e3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:20.137486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f35da6-4b97-42ab-918d-343f5b693e3b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:20.142758 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 444/894] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Jul 19 20:35:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:20.148368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e4712-1b84-430f-b214-c2a1f02957f2 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:20.154510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f35da6-4b97-42ab-918d-343f5b693e3b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:20.254682 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e4712-1b84-430f-b214-c2a1f02957f2 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:20.263227 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f35da6-4b97-42ab-918d-343f5b693e3b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:20.291593 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a902445-5dd3-4a38-a1d9-ae01f59f07e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:20.292353 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a902445-5dd3-4a38-a1d9-ae01f59f07e6 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:20.292738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a902445-5dd3-4a38-a1d9-ae01f59f07e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:20.293018 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a902445-5dd3-4a38-a1d9-ae01f59f07e6 None admin] PATH_INFO: `/v3/services` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:20.293719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a902445-5dd3-4a38-a1d9-ae01f59f07e6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:20.294022 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a902445-5dd3-4a38-a1d9-ae01f59f07e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:20.295589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a902445-5dd3-4a38-a1d9-ae01f59f07e6 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:20.300721 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f16154-6bf1-41d9-bf8b-018ecb29a7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:20.301607 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f16154-6bf1-41d9-bf8b-018ecb29a7c6 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:20.302429 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f16154-6bf1-41d9-bf8b-018ecb29a7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:20.302704 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f16154-6bf1-41d9-bf8b-018ecb29a7c6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:20.306099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 451/895] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Jul 19 20:35:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:20.306984 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a902445-5dd3-4a38-a1d9-ae01f59f07e6 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:20.314037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f16154-6bf1-41d9-bf8b-018ecb29a7c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:35:20.323252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-34f16154-6bf1-41d9-bf8b-018ecb29a7c6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 20:35:20.323252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:20.323252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:20.323252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:20.323252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:20.323252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:20.323252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:20.323252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:20.323252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:20.323252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:20.323252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:20.323252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:20.323252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:35:20.323252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:35:20.323252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:35:20.323252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:35:20.325596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:35:20.325596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:35:20.325596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:35:20.325596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:35:20.325596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:20.325596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:20.325596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:20.325596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:20.325596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:20.325596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:20.325596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:20.325596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:20.325596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:20.325596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:20.325596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:20.325596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:20.327784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:20.327784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:20.327784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:20.327784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:20.327784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:35:20.327784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:35:20.327784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:35:20.327784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:35:20.327784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:35:20.327784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:35:20.327784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 20:35:20.327784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:20.331433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 445/896] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Jul 19 20:35:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:20.333189 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f16154-6bf1-41d9-bf8b-018ecb29a7c6 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:20.338677 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:20.367883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:20.419113 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a902445-5dd3-4a38-a1d9-ae01f59f07e6 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:20.457826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9204b-7446-44f7-8ccb-95d858568cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:20.458956 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9204b-7446-44f7-8ccb-95d858568cff None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:20.459480 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9204b-7446-44f7-8ccb-95d858568cff None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:20.459931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9204b-7446-44f7-8ccb-95d858568cff None admin] PATH_INFO: `/v3/endpoints` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:20.461008 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9204b-7446-44f7-8ccb-95d858568cff None admin] RBAC: Adding query filter params (interface=public, service_id=174d7b67748d434a84e97c07f9d96cd1, region_id=RegionOne) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:20.461556 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9204b-7446-44f7-8ccb-95d858568cff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:20.463148 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba9204b-7446-44f7-8ccb-95d858568cff None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:20.467294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f16154-6bf1-41d9-bf8b-018ecb29a7c6 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:20.476917 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 452/897] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Jul 19 20:35:20 2022] GET /identity/v3/endpoints?service_id=174d7b67748d434a84e97c07f9d96cd1&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:20.478180 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9204b-7446-44f7-8ccb-95d858568cff None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:20.511067 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b14b3-b663-499b-b402-28e43b77ac8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:20.511720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b14b3-b663-499b-b402-28e43b77ac8e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:20.511993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b14b3-b663-499b-b402-28e43b77ac8e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:20.512275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b14b3-b663-499b-b402-28e43b77ac8e None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:20.513298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b14b3-b663-499b-b402-28e43b77ac8e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:20.513611 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b14b3-b663-499b-b402-28e43b77ac8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:20.515720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b14b3-b663-499b-b402-28e43b77ac8e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:20.531330 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 446/898] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Jul 19 20:35:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:20.533351 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b14b3-b663-499b-b402-28e43b77ac8e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:20.606313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:20.612757 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9204b-7446-44f7-8ccb-95d858568cff None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:20.636579 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:20.646926 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b14b3-b663-499b-b402-28e43b77ac8e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:20.659400 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a053edc-c95c-48b3-b564-f6fd43697cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:20.660075 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a053edc-c95c-48b3-b564-f6fd43697cef None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:20.660362 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a053edc-c95c-48b3-b564-f6fd43697cef None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:20.660639 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a053edc-c95c-48b3-b564-f6fd43697cef None admin] PATH_INFO: `/v3/services` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:20.661655 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a053edc-c95c-48b3-b564-f6fd43697cef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:20.663020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a053edc-c95c-48b3-b564-f6fd43697cef None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:20.668812 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 453/899] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Jul 19 20:35:20 2022] GET /identity/v3/services => generated 1268 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:35:20.671418 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d6291-cd6e-449d-a6c3-c113141d5f0c None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:20.671418 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d6291-cd6e-449d-a6c3-c113141d5f0c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:20.671418 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d6291-cd6e-449d-a6c3-c113141d5f0c None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:20.672002 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 454/900] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:20.682776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c711904-7c93-4e22-bd36-62bf1f2c2c2c None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:20.683158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c711904-7c93-4e22-bd36-62bf1f2c2c2c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:20.683647 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c711904-7c93-4e22-bd36-62bf1f2c2c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:20.687175 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72667a5a-5b2c-4f67-8f76-81b176702c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:20.688367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72667a5a-5b2c-4f67-8f76-81b176702c3f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:20.688958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72667a5a-5b2c-4f67-8f76-81b176702c3f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:20.689548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72667a5a-5b2c-4f67-8f76-81b176702c3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:20.703219 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-3c711904-7c93-4e22-bd36-62bf1f2c2c2c None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:20.705178 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-3c711904-7c93-4e22-bd36-62bf1f2c2c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:20.705459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72667a5a-5b2c-4f67-8f76-81b176702c3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:20.706982 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72667a5a-5b2c-4f67-8f76-81b176702c3f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:20.730930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-72667a5a-5b2c-4f67-8f76-81b176702c3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:20.730930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:20.730930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:20.730930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:20.730930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:20.730930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:20.730930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:20.730930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:20.730930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:20.730930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:20.730930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:20.730930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:20.730930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:20.730930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:20.730930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:20.732026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:20.732026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:20.732026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:20.732026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:20.732026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:20.732026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:20.732026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:20.732026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:20.732026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:20.732026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:20.732026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:20.732026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:20.732026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:20.732026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:20.732026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:20.732026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:20.732026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:20.732906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:20.732906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:20.732906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:20.732906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:20.732906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 447/901] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:20.738228 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72667a5a-5b2c-4f67-8f76-81b176702c3f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:20.796302 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 455/902] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:20.824068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c711904-7c93-4e22-bd36-62bf1f2c2c2c None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:20.877559 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72667a5a-5b2c-4f67-8f76-81b176702c3f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:20.900260 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:20.920020 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2c99d-db26-4a55-82d8-aee5707fc69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:20.920749 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2c99d-db26-4a55-82d8-aee5707fc69b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:20.921037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2c99d-db26-4a55-82d8-aee5707fc69b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:20.921313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2c99d-db26-4a55-82d8-aee5707fc69b None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:20.922087 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2c99d-db26-4a55-82d8-aee5707fc69b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:20.922398 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2c99d-db26-4a55-82d8-aee5707fc69b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:20.924057 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2c99d-db26-4a55-82d8-aee5707fc69b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:20.937757 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 448/903] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:20.939364 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982c9fa-1aad-4532-b6d5-76393b92b252 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:20.939655 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982c9fa-1aad-4532-b6d5-76393b92b252 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:20.939932 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982c9fa-1aad-4532-b6d5-76393b92b252 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:20.941291 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 449/904] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:20.944401 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982c9fa-1aad-4532-b6d5-76393b92b252 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:20.948010 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c711904-7c93-4e22-bd36-62bf1f2c2c2c None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:20.962016 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:20.987130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539e479-9f1f-4948-ad9d-1ceb114f7aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:20.987841 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539e479-9f1f-4948-ad9d-1ceb114f7aed None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:20.988547 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539e479-9f1f-4948-ad9d-1ceb114f7aed None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:20.988844 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539e479-9f1f-4948-ad9d-1ceb114f7aed None admin] PATH_INFO: `/v3/services` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:20.989683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539e479-9f1f-4948-ad9d-1ceb114f7aed None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:20.991438 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539e479-9f1f-4948-ad9d-1ceb114f7aed None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:21.008037 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 456/905] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jul 19 20:35:20 2022] POST /identity/v3/services => generated 241 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:35:21.008037 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561b38f-ec8b-4362-8892-b65753ea3e85 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:21.008037 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561b38f-ec8b-4362-8892-b65753ea3e85 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:21.008037 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561b38f-ec8b-4362-8892-b65753ea3e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:21.041777 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-3561b38f-ec8b-4362-8892-b65753ea3e85 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:21.043732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-3561b38f-ec8b-4362-8892-b65753ea3e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:21.075704 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982c9fa-1aad-4532-b6d5-76393b92b252 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:21.124592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451fcf7-d520-45e3-9dba-90f58b17bf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:21.126697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451fcf7-d520-45e3-9dba-90f58b17bf07 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:21.126985 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451fcf7-d520-45e3-9dba-90f58b17bf07 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:21.127278 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451fcf7-d520-45e3-9dba-90f58b17bf07 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:21.136600 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451fcf7-d520-45e3-9dba-90f58b17bf07 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:21.138070 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451fcf7-d520-45e3-9dba-90f58b17bf07 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:21.148555 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 457/906] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:21.155945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-2451fcf7-d520-45e3-9dba-90f58b17bf07 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 20:35:21.155945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:21.155945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:21.155945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:21.155945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:21.155945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:21.155945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:21.155945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:21.155945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:21.155945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:21.155945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:21.155945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:21.155945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:35:21.155945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:35:21.155945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:35:21.155945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:35:21.157035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:21.157035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:21.157035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:35:21.157035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:21.157035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:35:21.157035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:21.157035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:21.157035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:21.157035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:21.157035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:21.157035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:21.157035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:21.157035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:21.157035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:21.157035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:21.157035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:21.157035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:21.157035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:21.158014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:21.158014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:21.158014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:35:21.158014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:35:21.158014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:35:21.158014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:35:21.158014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:35:21.158014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:35:21.158014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 20:35:21.158014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:21.159339 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 450/907] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Jul 19 20:35:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:21.164037 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561b38f-ec8b-4362-8892-b65753ea3e85 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:21.173387 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451fcf7-d520-45e3-9dba-90f58b17bf07 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:21.220787 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:21.280074 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561b38f-ec8b-4362-8892-b65753ea3e85 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:21.281831 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:21.321664 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32c326-175e-42c8-99d5-444dc7fd9228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:21.322410 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32c326-175e-42c8-99d5-444dc7fd9228 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:21.322709 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32c326-175e-42c8-99d5-444dc7fd9228 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:21.322975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc32c326-175e-42c8-99d5-444dc7fd9228 None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:21.324155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32c326-175e-42c8-99d5-444dc7fd9228 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:21.324470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32c326-175e-42c8-99d5-444dc7fd9228 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:21.326039 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc32c326-175e-42c8-99d5-444dc7fd9228 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:21.326336 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451fcf7-d520-45e3-9dba-90f58b17bf07 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:21.348612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 458/908] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Jul 19 20:35:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:21.354652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32c326-175e-42c8-99d5-444dc7fd9228 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:21.375006 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981ceae-7c7f-42f7-8573-56a7d7549e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:21.375919 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981ceae-7c7f-42f7-8573-56a7d7549e33 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:21.376250 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981ceae-7c7f-42f7-8573-56a7d7549e33 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:21.376534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981ceae-7c7f-42f7-8573-56a7d7549e33 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:21.377191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981ceae-7c7f-42f7-8573-56a7d7549e33 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:21.378673 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5981ceae-7c7f-42f7-8573-56a7d7549e33 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:21.392440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-5981ceae-7c7f-42f7-8573-56a7d7549e33 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 20:35:21.392440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:21.392440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:35:21.392440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:35:21.392440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:35:21.392440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:35:21.392440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:35:21.392440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:21.392440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 20:35:21.392440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:21.392440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:21.392440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:21.392440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:21.392440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:21.392440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:21.392440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:21.392440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:21.393540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:21.393540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:21.393540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:21.393540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:21.393540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:21.393540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:21.393540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:35:21.393540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:35:21.393540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:35:21.393540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:35:21.393540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:21.393540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:21.393540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:21.393540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:21.393540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:21.393540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:21.394829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:21.394829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:21.394829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:21.394829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:21.394829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:21.394829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:21.394829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:21.394829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:21.394829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:21.394829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:21.394829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:35:21.394829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:21.394829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 20:35:21.394829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:21.398980 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 451/909] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jul 19 20:35:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:21.399976 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981ceae-7c7f-42f7-8573-56a7d7549e33 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:21.476452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc32c326-175e-42c8-99d5-444dc7fd9228 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:21.513532 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:21.515730 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f124b1-3780-4177-a132-5735eeba5120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:21.516842 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f124b1-3780-4177-a132-5735eeba5120 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:21.517478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5981ceae-7c7f-42f7-8573-56a7d7549e33 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:21.517807 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f124b1-3780-4177-a132-5735eeba5120 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:21.518305 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f124b1-3780-4177-a132-5735eeba5120 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:21.558296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289551da-ce69-4106-9236-885e1f17bddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:21.558955 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289551da-ce69-4106-9236-885e1f17bddf None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:21.559276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289551da-ce69-4106-9236-885e1f17bddf None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:21.559599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289551da-ce69-4106-9236-885e1f17bddf None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:21.560857 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289551da-ce69-4106-9236-885e1f17bddf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:21.560857 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289551da-ce69-4106-9236-885e1f17bddf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:21.562074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289551da-ce69-4106-9236-885e1f17bddf None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:21.572803 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 452/910] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jul 19 20:35:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:21.573689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289551da-ce69-4106-9236-885e1f17bddf None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:21.575649 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:21.599595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f124b1-3780-4177-a132-5735eeba5120 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:21.601562 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f124b1-3780-4177-a132-5735eeba5120 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:21.679902 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289551da-ce69-4106-9236-885e1f17bddf None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:21.713837 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 459/911] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:35:21 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 20:35:21.719294 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f124b1-3780-4177-a132-5735eeba5120 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:21.720262 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b43058-4308-4b76-8a79-cb7f4e3fc601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:21.721029 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b43058-4308-4b76-8a79-cb7f4e3fc601 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:21.721389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b43058-4308-4b76-8a79-cb7f4e3fc601 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:21.721736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b43058-4308-4b76-8a79-cb7f4e3fc601 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:21.722516 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b43058-4308-4b76-8a79-cb7f4e3fc601 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:21.723001 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b43058-4308-4b76-8a79-cb7f4e3fc601 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:21.725358 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b43058-4308-4b76-8a79-cb7f4e3fc601 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:21.735031 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 453/912] 10.222.0.77 () {56 vars in 1114 bytes} [Tue Jul 19 20:35:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:21.736006 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b43058-4308-4b76-8a79-cb7f4e3fc601 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:21.765870 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:21.791537 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:21.841067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f124b1-3780-4177-a132-5735eeba5120 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:21.844547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b43058-4308-4b76-8a79-cb7f4e3fc601 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:21.880504 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ab2a3-d164-4350-bfd4-0dcd7ecc0abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:21.881160 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ab2a3-d164-4350-bfd4-0dcd7ecc0abc None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:21.881472 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ab2a3-d164-4350-bfd4-0dcd7ecc0abc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:21.882132 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6ed17-ee1c-4667-8344-ce70d3583c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:21.883188 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6ed17-ee1c-4667-8344-ce70d3583c35 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:21.883694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6ed17-ee1c-4667-8344-ce70d3583c35 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:21.884113 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d6ed17-ee1c-4667-8344-ce70d3583c35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:21.884878 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ab2a3-d164-4350-bfd4-0dcd7ecc0abc None admin] PATH_INFO: `/v3/endpoints` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:21.885657 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ab2a3-d164-4350-bfd4-0dcd7ecc0abc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:21.887143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ab2a3-d164-4350-bfd4-0dcd7ecc0abc None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:21.899757 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d6ed17-ee1c-4667-8344-ce70d3583c35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:21.901557 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d6ed17-ee1c-4667-8344-ce70d3583c35 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:21.922227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-78d6ed17-ee1c-4667-8344-ce70d3583c35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:21.922227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:21.922227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:21.922227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:21.922227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:21.922227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:21.922227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:21.922227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:21.922227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:21.922227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:21.922227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:21.922227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:21.922227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:21.922227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:21.922227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:21.923505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:21.923505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:21.923505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:21.923505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:21.923505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:21.923505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:21.923505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:21.923505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:21.923505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:21.923505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:21.923505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:21.923505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:21.923505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:21.923505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:21.923505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:21.923505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:21.923505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:21.924438 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:21.924438 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:21.924438 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:21.924438 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:21.924659 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 454/913] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Jul 19 20:35:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:35:21.926473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 460/914] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:21.935390 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ab2a3-d164-4350-bfd4-0dcd7ecc0abc None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:22.030969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:22.058949 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ab2a3-d164-4350-bfd4-0dcd7ecc0abc None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:22.095681 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503720ff-44af-477a-be9b-10e4473df45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:22.096389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503720ff-44af-477a-be9b-10e4473df45a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:22.096749 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503720ff-44af-477a-be9b-10e4473df45a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:22.097029 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503720ff-44af-477a-be9b-10e4473df45a None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:22.097813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503720ff-44af-477a-be9b-10e4473df45a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:22.098125 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503720ff-44af-477a-be9b-10e4473df45a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:22.099610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503720ff-44af-477a-be9b-10e4473df45a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:22.112195 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 455/915] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:22.120292 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6ed17-ee1c-4667-8344-ce70d3583c35 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:22.230418 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d6ed17-ee1c-4667-8344-ce70d3583c35 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:22.244200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:22.265524 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53ca4b-92ab-4566-863b-52a26eba56d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:22.266330 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53ca4b-92ab-4566-863b-52a26eba56d7 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:22.266614 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53ca4b-92ab-4566-863b-52a26eba56d7 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:22.266890 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53ca4b-92ab-4566-863b-52a26eba56d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:22.274621 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53ca4b-92ab-4566-863b-52a26eba56d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:22.276093 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53ca4b-92ab-4566-863b-52a26eba56d7 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:22.290384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-6e53ca4b-92ab-4566-863b-52a26eba56d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:22.290384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:22.290384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:22.290384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:22.290384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:22.290384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:22.290384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:22.290384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:22.290384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:22.290384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:22.290384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:22.290384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:22.290384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:35:22.290384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:35:22.290384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:35:22.291374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:35:22.291374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:22.291374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:22.291374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:22.291374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:22.291374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:22.291374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:22.291374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:22.291374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:22.291374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:22.291374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:22.291374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:22.291374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:22.291374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:22.291374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:22.291374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:22.291374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:22.292672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:35:22.292672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:35:22.292672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:35:22.292672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:35:22.292672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:35:22.292672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:35:22.292672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:22.292672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:22.292672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 461/916] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:35:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:22.299369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503720ff-44af-477a-be9b-10e4473df45a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:22.409513 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503720ff-44af-477a-be9b-10e4473df45a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:22.446745 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4dcd1a-d778-490b-9f4d-8f30276560ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:22.447468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4dcd1a-d778-490b-9f4d-8f30276560ae None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:22.447755 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4dcd1a-d778-490b-9f4d-8f30276560ae None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:22.448032 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4dcd1a-d778-490b-9f4d-8f30276560ae None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:22.448833 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4dcd1a-d778-490b-9f4d-8f30276560ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:22.449148 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4dcd1a-d778-490b-9f4d-8f30276560ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:22.450571 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4dcd1a-d778-490b-9f4d-8f30276560ae None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:22.463547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:22.463875 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 456/917] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:35:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:22.471486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53ca4b-92ab-4566-863b-52a26eba56d7 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:22.575476 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53ca4b-92ab-4566-863b-52a26eba56d7 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:22.611134 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc4a89-944b-4f77-89a8-fed335e12a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:22.611825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc4a89-944b-4f77-89a8-fed335e12a80 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:22.612111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc4a89-944b-4f77-89a8-fed335e12a80 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:22.612390 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc4a89-944b-4f77-89a8-fed335e12a80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:22.613233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc4a89-944b-4f77-89a8-fed335e12a80 None admin] RBAC: Adding query filter params (role.id=8f8d721df639446bb89673cc687829e3, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=c8f314167aa94d81955ac761a5a28504) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:22.613548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc4a89-944b-4f77-89a8-fed335e12a80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:22.615026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc4a89-944b-4f77-89a8-fed335e12a80 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:22.621302 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 462/918] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:35:22 2022] GET /identity/v3/role_assignments?user.id=c8f314167aa94d81955ac761a5a28504&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=8f8d721df639446bb89673cc687829e3 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:22.778478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb9165-8dc5-45cd-b0fb-1aad03d47ff9 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:22.778994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb9165-8dc5-45cd-b0fb-1aad03d47ff9 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:22.778994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb9165-8dc5-45cd-b0fb-1aad03d47ff9 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:22.780685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 457/919] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:22.785824 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc503f-bfbe-4f17-a351-88d27c19c37a None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:22.786574 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc503f-bfbe-4f17-a351-88d27c19c37a None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:22.786746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc503f-bfbe-4f17-a351-88d27c19c37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:22.806321 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-84cc503f-bfbe-4f17-a351-88d27c19c37a None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:22.807544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-84cc503f-bfbe-4f17-a351-88d27c19c37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:22.839071 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:22.886438 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 463/920] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:22.908047 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb9165-8dc5-45cd-b0fb-1aad03d47ff9 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:23.015720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb9165-8dc5-45cd-b0fb-1aad03d47ff9 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:23.050627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930c07c-3743-4c1d-94f7-b94edf5c927c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:23.051485 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930c07c-3743-4c1d-94f7-b94edf5c927c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:23.052299 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930c07c-3743-4c1d-94f7-b94edf5c927c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:23.052577 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930c07c-3743-4c1d-94f7-b94edf5c927c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:23.053259 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930c07c-3743-4c1d-94f7-b94edf5c927c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:23.054613 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930c07c-3743-4c1d-94f7-b94edf5c927c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:23.067991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-f930c07c-3743-4c1d-94f7-b94edf5c927c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 20:35:23.067991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:23.067991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:35:23.067991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:35:23.067991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:35:23.067991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:35:23.067991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:35:23.067991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:23.067991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 20:35:23.067991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:23.067991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:23.067991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:23.067991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:23.067991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:23.067991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:23.067991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:23.069212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:23.069212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:23.069212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:23.069212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:23.069212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:23.069212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:23.069212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:23.069212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:35:23.069212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:35:23.069212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:35:23.069212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:35:23.069212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:23.069212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:23.069212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:23.069212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:23.069212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:23.070468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:23.070468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:23.070468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:23.070468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:23.070468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:23.070468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:23.070468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:23.070468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:23.070468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:23.070468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:23.070468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:23.070468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:35:23.070468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:23.070468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 20:35:23.070468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:23.070468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 458/921] 10.222.0.77 () {56 vars in 1132 bytes} [Tue Jul 19 20:35:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:23.075325 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc503f-bfbe-4f17-a351-88d27c19c37a None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:23.184137 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc503f-bfbe-4f17-a351-88d27c19c37a None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:23.201863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b6a01-31cc-4d20-be6f-3e7a3439d42f None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:23.202150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b6a01-31cc-4d20-be6f-3e7a3439d42f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:23.202436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b6a01-31cc-4d20-be6f-3e7a3439d42f None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:23.204111 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 459/922] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:35:23.209161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204b6d1-d56f-42cc-bb54-1b9a7d6cf5b5 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:23.209456 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204b6d1-d56f-42cc-bb54-1b9a7d6cf5b5 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:23.209738 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204b6d1-d56f-42cc-bb54-1b9a7d6cf5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:23.228343 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-e204b6d1-d56f-42cc-bb54-1b9a7d6cf5b5 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:23.230230 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e204b6d1-d56f-42cc-bb54-1b9a7d6cf5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:23.230877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef2432-8487-4111-a5b7-1d7de8916334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:23.231589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef2432-8487-4111-a5b7-1d7de8916334 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:23.231875 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef2432-8487-4111-a5b7-1d7de8916334 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:23.232156 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef2432-8487-4111-a5b7-1d7de8916334 None admin] PATH_INFO: `/v3/services` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:23.232878 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef2432-8487-4111-a5b7-1d7de8916334 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:23.233192 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef2432-8487-4111-a5b7-1d7de8916334 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:23.234567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef2432-8487-4111-a5b7-1d7de8916334 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:23.240570 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 464/923] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Jul 19 20:35:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:23.248181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef2432-8487-4111-a5b7-1d7de8916334 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:23.303661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:23.314292 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:23.327430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 460/924] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 20:35:23.350133 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204b6d1-d56f-42cc-bb54-1b9a7d6cf5b5 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:23.377729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef2432-8487-4111-a5b7-1d7de8916334 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:23.415420 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898db01a-b10b-4d36-b9cf-0ff62cfac1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:23.416555 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898db01a-b10b-4d36-b9cf-0ff62cfac1ef None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:23.417025 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898db01a-b10b-4d36-b9cf-0ff62cfac1ef None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:23.417487 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898db01a-b10b-4d36-b9cf-0ff62cfac1ef None admin] PATH_INFO: `/v3/services` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:23.418384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898db01a-b10b-4d36-b9cf-0ff62cfac1ef None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:23.418997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898db01a-b10b-4d36-b9cf-0ff62cfac1ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:23.420466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898db01a-b10b-4d36-b9cf-0ff62cfac1ef None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:23.426218 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 465/925] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Jul 19 20:35:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:23.432279 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898db01a-b10b-4d36-b9cf-0ff62cfac1ef None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:23.472232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204b6d1-d56f-42cc-bb54-1b9a7d6cf5b5 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:23.512885 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9a512-c3b5-44b8-9e62-4da3b7931ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:23.513708 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9a512-c3b5-44b8-9e62-4da3b7931ca4 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:23.514150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9a512-c3b5-44b8-9e62-4da3b7931ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:23.514259 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9a512-c3b5-44b8-9e62-4da3b7931ca4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:23.514898 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9a512-c3b5-44b8-9e62-4da3b7931ca4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:23.516325 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9a512-c3b5-44b8-9e62-4da3b7931ca4 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:23.530432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-04b9a512-c3b5-44b8-9e62-4da3b7931ca4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 20:35:23.530432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:23.530432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:35:23.530432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:35:23.530432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:35:23.530432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:35:23.530432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:35:23.530432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:23.530432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 20:35:23.530432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:23.530432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:23.530432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:23.530432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:23.530432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:23.530432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:23.530432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:23.530432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:23.531471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:23.531471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:23.531471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:23.531471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:23.531471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:23.531471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:23.531471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:35:23.531471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:35:23.531471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:35:23.531471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:35:23.531471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:23.531471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:23.531471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:23.531471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:23.531471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:23.531471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:23.532340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:23.532340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:23.532340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:23.532340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:23.532340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:23.532340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:23.532340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:23.532340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:23.532340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:23.532340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:23.532340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:35:23.532340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:23.532340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 20:35:23.532340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:23.537464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 461/926] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Jul 19 20:35:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:23.538287 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9a512-c3b5-44b8-9e62-4da3b7931ca4 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:23.566206 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:23.577076 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898db01a-b10b-4d36-b9cf-0ff62cfac1ef None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:23.604430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:23.627529 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d17800-6eaf-42d9-b8c3-811562b136f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:23.628550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d17800-6eaf-42d9-b8c3-811562b136f9 None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:23.629471 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d17800-6eaf-42d9-b8c3-811562b136f9 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:23.630104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d17800-6eaf-42d9-b8c3-811562b136f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:23.631742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d17800-6eaf-42d9-b8c3-811562b136f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:23.633584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d17800-6eaf-42d9-b8c3-811562b136f9 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:23.656746 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9a512-c3b5-44b8-9e62-4da3b7931ca4 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:23.660327 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 466/927] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Jul 19 20:35:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:35:23.709581 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02038a75-0373-4166-b598-19ad0c0540e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:23.710332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02038a75-0373-4166-b598-19ad0c0540e4 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:23.710624 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02038a75-0373-4166-b598-19ad0c0540e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:23.710901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02038a75-0373-4166-b598-19ad0c0540e4 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:23.711670 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02038a75-0373-4166-b598-19ad0c0540e4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:23.711980 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02038a75-0373-4166-b598-19ad0c0540e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:23.713392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02038a75-0373-4166-b598-19ad0c0540e4 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:23.719972 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 462/928] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Jul 19 20:35:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:23.726221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d17800-6eaf-42d9-b8c3-811562b136f9 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:23.844065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d17800-6eaf-42d9-b8c3-811562b136f9 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:23.880677 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c5fd2-ac71-42ad-a3a8-2f96b039fca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:23.881354 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c5fd2-ac71-42ad-a3a8-2f96b039fca2 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:23.881643 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c5fd2-ac71-42ad-a3a8-2f96b039fca2 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:23.881918 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c5fd2-ac71-42ad-a3a8-2f96b039fca2 None admin] PATH_INFO: `/v3/services` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:23.882640 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c5fd2-ac71-42ad-a3a8-2f96b039fca2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:23.882950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c5fd2-ac71-42ad-a3a8-2f96b039fca2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:23.884360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c5fd2-ac71-42ad-a3a8-2f96b039fca2 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:23.891508 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 467/929] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Jul 19 20:35:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:23.900103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02038a75-0373-4166-b598-19ad0c0540e4 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:24.006612 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02038a75-0373-4166-b598-19ad0c0540e4 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:24.023357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:24.042623 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55618ee6-d95d-40e0-8de7-bf04db5acf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:24.043369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55618ee6-d95d-40e0-8de7-bf04db5acf75 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:24.043661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55618ee6-d95d-40e0-8de7-bf04db5acf75 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:24.043938 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55618ee6-d95d-40e0-8de7-bf04db5acf75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:24.044787 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55618ee6-d95d-40e0-8de7-bf04db5acf75 None admin] RBAC: Adding query filter params (interface=public, service_id=c86932be688a4952bde88008da4c8417, region_id=RegionOne) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:24.045157 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55618ee6-d95d-40e0-8de7-bf04db5acf75 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:24.046595 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55618ee6-d95d-40e0-8de7-bf04db5acf75 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:24.053042 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 463/930] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Jul 19 20:35:23 2022] GET /identity/v3/endpoints?service_id=c86932be688a4952bde88008da4c8417&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:24.058573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c5fd2-ac71-42ad-a3a8-2f96b039fca2 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:24.075612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:24.166044 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c5fd2-ac71-42ad-a3a8-2f96b039fca2 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:24.176984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8a9b7-3f95-40bb-8ae7-192c92901c7f None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:24.177297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8a9b7-3f95-40bb-8ae7-192c92901c7f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:24.177555 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8a9b7-3f95-40bb-8ae7-192c92901c7f None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:24.179296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 464/931] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:35:24.186264 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae17909-ec47-439d-aa4d-cb7c8a472970 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:24.186568 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae17909-ec47-439d-aa4d-cb7c8a472970 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:24.186849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae17909-ec47-439d-aa4d-cb7c8a472970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:24.204604 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-1ae17909-ec47-439d-aa4d-cb7c8a472970 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:24.205831 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-1ae17909-ec47-439d-aa4d-cb7c8a472970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:24.208877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8580ca9-c683-47de-9be4-848ea89b4d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:24.210387 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8580ca9-c683-47de-9be4-848ea89b4d76 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:24.210660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8580ca9-c683-47de-9be4-848ea89b4d76 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:24.210937 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8580ca9-c683-47de-9be4-848ea89b4d76 None admin] PATH_INFO: `/v3/services` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:24.211668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8580ca9-c683-47de-9be4-848ea89b4d76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:24.213038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8580ca9-c683-47de-9be4-848ea89b4d76 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:24.220921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 468/932] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Jul 19 20:35:24 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:35:24.290226 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 465/933] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 20:35:24.314840 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8580ca9-c683-47de-9be4-848ea89b4d76 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:24.412079 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:24.434581 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8580ca9-c683-47de-9be4-848ea89b4d76 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:24.469314 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb3333-9520-499b-8a7f-15d970dd71e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:24.469985 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb3333-9520-499b-8a7f-15d970dd71e6 None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:24.470270 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb3333-9520-499b-8a7f-15d970dd71e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:24.470549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb3333-9520-499b-8a7f-15d970dd71e6 None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:24.471286 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb3333-9520-499b-8a7f-15d970dd71e6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:24.472740 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb3333-9520-499b-8a7f-15d970dd71e6 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:24.474221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: WARNING keystone.server.flask.common [None req-14bb3333-9520-499b-8a7f-15d970dd71e6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 19 20:35:24.493291 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.sql.core [None req-14bb3333-9520-499b-8a7f-15d970dd71e6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 19 20:35:24.493291 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 19 20:35:24.493291 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [parameters: {'id': 'f5816baa5c37448e9f2f47a3a558bad9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 19 20:35:24.493291 dv-cinder-749155-8-smb devstack@keystone.service[92087]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92087) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 20:35:24.501444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-14bb3333-9520-499b-8a7f-15d970dd71e6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f5816baa5c37448e9f2f47a3a558bad9.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f5816baa5c37448e9f2f47a3a558bad9. Jul 19 20:35:24.501444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:24.501444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 20:35:24.501444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 20:35:24.501444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 20:35:24.501444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 20:35:24.501444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 20:35:24.501444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 20:35:24.501444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 20:35:24.501444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application conn.query(q) Jul 19 20:35:24.501444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 20:35:24.501444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 20:35:24.501444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 20:35:24.502231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application result.read() Jul 19 20:35:24.502231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 20:35:24.502231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 20:35:24.502231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 20:35:24.502231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 20:35:24.502231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 20:35:24.502231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 20:35:24.502231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 20:35:24.502231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 20:35:24.502231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 19 20:35:24.502231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:24.502231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 20:35:24.502231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:24.502231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:24.502231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 20:35:24.502231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 20:35:24.502231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 19 20:35:24.502231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 19 20:35:24.503181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 20:35:24.503181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application next(self.gen) Jul 19 20:35:24.503181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 20:35:24.503181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application yield resource Jul 19 20:35:24.503181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 20:35:24.503181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application next(self.gen) Jul 19 20:35:24.503181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 20:35:24.503181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 20:35:24.503181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 20:35:24.503181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 20:35:24.503181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 20:35:24.503181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise self.value Jul 19 20:35:24.503181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 20:35:24.503181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 20:35:24.503181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 20:35:24.503181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application session.commit() Jul 19 20:35:24.503181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 20:35:24.504097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 20:35:24.504097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 20:35:24.504097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 20:35:24.504097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 20:35:24.504097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self.session.flush() Jul 19 20:35:24.504097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 20:35:24.504097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 20:35:24.504097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 20:35:24.504097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 20:35:24.504097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 20:35:24.504097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application compat.raise_( Jul 19 20:35:24.504097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 20:35:24.504097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception Jul 19 20:35:24.504097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 20:35:24.504097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 20:35:24.504097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 20:35:24.504097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 20:35:24.505149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 20:35:24.505149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 20:35:24.505149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 20:35:24.505149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 20:35:24.505149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 19 20:35:24.505149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 19 20:35:24.505149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 20:35:24.505149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 20:35:24.505149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 20:35:24.505149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 20:35:24.505149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 20:35:24.505149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 20:35:24.505149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 20:35:24.505149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 20:35:24.505149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 20:35:24.505955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 20:35:24.505955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 20:35:24.505955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception Jul 19 20:35:24.505955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 20:35:24.505955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 20:35:24.505955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 20:35:24.505955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 20:35:24.505955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 20:35:24.505955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 20:35:24.505955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 20:35:24.505955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application conn.query(q) Jul 19 20:35:24.505955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 20:35:24.505955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 20:35:24.505955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 20:35:24.505955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application result.read() Jul 19 20:35:24.505955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 20:35:24.505955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 20:35:24.506894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 20:35:24.506894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 20:35:24.506894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 20:35:24.506894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 20:35:24.506894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 20:35:24.506894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 20:35:24.506894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 19 20:35:24.506894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 19 20:35:24.506894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [parameters: {'id': 'f5816baa5c37448e9f2f47a3a558bad9', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 19 20:35:24.506894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 20:35:24.506894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:24.506894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:24.506894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:24.506894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:24.506894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 19 20:35:24.509358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 19 20:35:24.509358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 20:35:24.509358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 20:35:24.509358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 19 20:35:24.509358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:24.509358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:24.509358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:24.509358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:24.509358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:24.509358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:24.509358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:24.509358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:24.509358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:24.509358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:24.509358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:24.509358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:24.509358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:24.511487 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:24.511487 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 19 20:35:24.511487 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 19 20:35:24.511487 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:24.511487 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:24.511487 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 19 20:35:24.511487 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 19 20:35:24.511487 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f5816baa5c37448e9f2f47a3a558bad9. Jul 19 20:35:24.511487 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:24.511487 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 469/934] 10.222.0.77 () {60 vars in 1140 bytes} [Tue Jul 19 20:35:24 2022] POST /identity/v3/projects => generated 262 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:24.512844 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae17909-ec47-439d-aa4d-cb7c8a472970 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:24.617519 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae17909-ec47-439d-aa4d-cb7c8a472970 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:24.628599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:24.656664 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f73145-b762-4475-811e-12e6d5854326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:24.657878 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f73145-b762-4475-811e-12e6d5854326 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:24.658369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f73145-b762-4475-811e-12e6d5854326 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:24.658842 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f73145-b762-4475-811e-12e6d5854326 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:24.666192 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f73145-b762-4475-811e-12e6d5854326 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:24.667871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f73145-b762-4475-811e-12e6d5854326 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:24.683510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-f3f73145-b762-4475-811e-12e6d5854326 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:24.683510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:24.683510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:24.683510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:24.683510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:24.683510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:24.683510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:24.683510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:24.683510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:24.683510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:24.683510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:24.683510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:24.683510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:35:24.683510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:35:24.683510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:35:24.684394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:35:24.684394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:24.684394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:24.684394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:24.684394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:24.684394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:24.684394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:24.684394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:24.684394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:24.684394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:24.684394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:24.684394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:24.684394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:24.684394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:24.684394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:24.684394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:24.684394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:24.685298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:35:24.685298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:35:24.685298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:35:24.685298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:35:24.685298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:35:24.685298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:35:24.685298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:24.685298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:24.687734 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 466/935] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:35:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:24.694013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb3333-9520-499b-8a7f-15d970dd71e6 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:24.789617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5eef7-b7af-4619-b2b9-85561d13df4a None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:24.789959 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5eef7-b7af-4619-b2b9-85561d13df4a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:24.790181 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5eef7-b7af-4619-b2b9-85561d13df4a None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:24.792763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 467/936] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:35:24.796846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cf1be-54ee-45ba-a3f4-30a0e748c5cc None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:24.797132 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cf1be-54ee-45ba-a3f4-30a0e748c5cc None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:24.797410 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cf1be-54ee-45ba-a3f4-30a0e748c5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:24.802073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb3333-9520-499b-8a7f-15d970dd71e6 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:24.815281 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-676cf1be-54ee-45ba-a3f4-30a0e748c5cc None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:24.816811 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-676cf1be-54ee-45ba-a3f4-30a0e748c5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:24.842811 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fc201-7493-45a9-b2db-9ebf25eb8938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:24.843827 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fc201-7493-45a9-b2db-9ebf25eb8938 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:24.844114 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fc201-7493-45a9-b2db-9ebf25eb8938 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:24.844671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fc201-7493-45a9-b2db-9ebf25eb8938 None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:24.845417 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fc201-7493-45a9-b2db-9ebf25eb8938 None admin] RBAC: Adding query filter params (name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:24.846114 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fc201-7493-45a9-b2db-9ebf25eb8938 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:24.848306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fc201-7493-45a9-b2db-9ebf25eb8938 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:24.851246 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:24.877628 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 470/937] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jul 19 20:35:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:24.909244 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 468/938] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 20:35:24.938364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fc201-7493-45a9-b2db-9ebf25eb8938 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:25.058780 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fc201-7493-45a9-b2db-9ebf25eb8938 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:25.094472 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802642d-baa5-46bf-ae0f-3a2973a53965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:25.095343 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802642d-baa5-46bf-ae0f-3a2973a53965 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:25.095601 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802642d-baa5-46bf-ae0f-3a2973a53965 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:25.095882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802642d-baa5-46bf-ae0f-3a2973a53965 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:25.108224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802642d-baa5-46bf-ae0f-3a2973a53965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:35:25.117096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-e802642d-baa5-46bf-ae0f-3a2973a53965 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 20:35:25.117096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:25.117096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:25.117096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:25.117096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:25.117096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:25.117096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:25.117096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:25.117096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:25.117096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:25.117096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:25.117096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:25.117096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:35:25.117096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:35:25.117096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:35:25.117096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:35:25.118056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:35:25.118056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:35:25.118056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:35:25.118056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:35:25.118056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:25.118056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:25.118056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:25.118056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:25.118056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:25.118056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:25.118056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:25.118056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:25.118056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:25.118056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:25.118056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:25.118056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:25.118931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:25.118931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:25.118931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:25.118931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:25.118931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:35:25.118931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:35:25.118931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:35:25.118931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:35:25.118931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:35:25.118931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:35:25.118931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 20:35:25.118931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:25.120104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 471/939] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Jul 19 20:35:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:25.124860 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cf1be-54ee-45ba-a3f4-30a0e748c5cc None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:25.225618 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:25.228702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cf1be-54ee-45ba-a3f4-30a0e748c5cc None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:25.265131 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ded6ab-5c3c-4ede-a0c0-87f83dc1cfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:25.265838 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ded6ab-5c3c-4ede-a0c0-87f83dc1cfcc None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:25.266125 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ded6ab-5c3c-4ede-a0c0-87f83dc1cfcc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:25.266398 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ded6ab-5c3c-4ede-a0c0-87f83dc1cfcc None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:25.267143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ded6ab-5c3c-4ede-a0c0-87f83dc1cfcc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:25.267473 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ded6ab-5c3c-4ede-a0c0-87f83dc1cfcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:25.268826 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ded6ab-5c3c-4ede-a0c0-87f83dc1cfcc None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:25.277665 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 469/940] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Jul 19 20:35:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:25.283154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802642d-baa5-46bf-ae0f-3a2973a53965 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:25.348740 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:25.399295 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802642d-baa5-46bf-ae0f-3a2973a53965 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:25.435684 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53333e7-b980-4b74-bf5c-87e84b36a960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:25.436558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53333e7-b980-4b74-bf5c-87e84b36a960 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:25.436889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53333e7-b980-4b74-bf5c-87e84b36a960 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:25.437248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53333e7-b980-4b74-bf5c-87e84b36a960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:25.449767 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53333e7-b980-4b74-bf5c-87e84b36a960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:25.451234 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53333e7-b980-4b74-bf5c-87e84b36a960 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:25.469492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-a53333e7-b980-4b74-bf5c-87e84b36a960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:25.469492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:25.469492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:25.469492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:25.469492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:25.469492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:25.469492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:25.469492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:25.469492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:25.469492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:25.469492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:25.469492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:25.469492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:25.469492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:25.469492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:25.470455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:25.470455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:25.470455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:25.470455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:25.470455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:25.470455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:25.470455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:25.470455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:25.470455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:25.470455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:25.470455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:25.470455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:25.470455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:25.470455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:25.470455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:25.470455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:25.470455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:25.471386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:25.471386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:25.471386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:25.471386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:25.471386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 472/941] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:25.478254 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ded6ab-5c3c-4ede-a0c0-87f83dc1cfcc None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:25.586747 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ded6ab-5c3c-4ede-a0c0-87f83dc1cfcc None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:25.623838 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed5705-fd2c-4f98-bf0c-2a3d6ff4ee93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:25.624514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed5705-fd2c-4f98-bf0c-2a3d6ff4ee93 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:25.624858 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed5705-fd2c-4f98-bf0c-2a3d6ff4ee93 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:25.625136 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed5705-fd2c-4f98-bf0c-2a3d6ff4ee93 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:25.625852 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed5705-fd2c-4f98-bf0c-2a3d6ff4ee93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:25.626159 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed5705-fd2c-4f98-bf0c-2a3d6ff4ee93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:25.627531 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed5705-fd2c-4f98-bf0c-2a3d6ff4ee93 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:25.639821 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 470/942] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:25.645234 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53333e7-b980-4b74-bf5c-87e84b36a960 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:25.757715 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53333e7-b980-4b74-bf5c-87e84b36a960 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:25.765062 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:25.793233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc25dd4-ba74-4eef-9972-f587b40d894f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:25.794052 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc25dd4-ba74-4eef-9972-f587b40d894f None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:25.794334 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc25dd4-ba74-4eef-9972-f587b40d894f None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:25.794606 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc25dd4-ba74-4eef-9972-f587b40d894f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:25.803354 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc25dd4-ba74-4eef-9972-f587b40d894f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:25.804782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc25dd4-ba74-4eef-9972-f587b40d894f None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:25.820704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-0dc25dd4-ba74-4eef-9972-f587b40d894f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 20:35:25.820704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:25.820704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:25.820704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:25.820704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:25.820704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:25.820704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:25.820704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:25.820704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:25.820704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:25.820704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:25.820704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:25.820704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:35:25.820704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:35:25.820704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:35:25.820704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:35:25.821901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:25.821901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:25.821901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:35:25.821901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:25.821901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:35:25.821901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:25.821901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:25.821901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:25.821901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:25.821901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:25.821901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:25.821901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:25.821901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:25.821901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:25.821901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:25.821901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:25.821901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:25.821901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:25.822849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:25.822849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:25.822849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:35:25.822849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:35:25.822849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:35:25.822849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:35:25.822849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:35:25.822849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:35:25.822849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 20:35:25.822849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:25.822849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 473/943] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Jul 19 20:35:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:25.831487 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed5705-fd2c-4f98-bf0c-2a3d6ff4ee93 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:25.856920 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:25.916105 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e044140-74a9-4b11-aa5f-8bca6c0136eb None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:25.916652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e044140-74a9-4b11-aa5f-8bca6c0136eb None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:25.916652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e044140-74a9-4b11-aa5f-8bca6c0136eb None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:25.918276 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 474/944] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:35:25.923188 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634cc5d-87ec-48f2-bd6b-d686b7af5ace None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:25.923667 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634cc5d-87ec-48f2-bd6b-d686b7af5ace None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:25.923956 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634cc5d-87ec-48f2-bd6b-d686b7af5ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:25.941514 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-a634cc5d-87ec-48f2-bd6b-d686b7af5ace None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:25.942098 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed5705-fd2c-4f98-bf0c-2a3d6ff4ee93 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:25.943645 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-a634cc5d-87ec-48f2-bd6b-d686b7af5ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:25.985922 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc2e06-e0d5-4384-ab96-e843bd3c24ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:25.986596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc2e06-e0d5-4384-ab96-e843bd3c24ba None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:25.986879 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc2e06-e0d5-4384-ab96-e843bd3c24ba None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:25.987153 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc2e06-e0d5-4384-ab96-e843bd3c24ba None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:25.988619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc2e06-e0d5-4384-ab96-e843bd3c24ba None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:25.988934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc2e06-e0d5-4384-ab96-e843bd3c24ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:25.991361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc2e06-e0d5-4384-ab96-e843bd3c24ba None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:26.016221 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 471/945] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Jul 19 20:35:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:26.023362 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 475/946] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:26.024690 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc2e06-e0d5-4384-ab96-e843bd3c24ba None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:26.040403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634cc5d-87ec-48f2-bd6b-d686b7af5ace None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:26.116038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:26.140204 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc2e06-e0d5-4384-ab96-e843bd3c24ba None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:26.151850 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:26.158389 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634cc5d-87ec-48f2-bd6b-d686b7af5ace None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:26.192531 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01b041-57e6-4914-bb2a-4a4d39f6b2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:26.193678 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01b041-57e6-4914-bb2a-4a4d39f6b2ce None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:26.194146 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01b041-57e6-4914-bb2a-4a4d39f6b2ce None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:26.194604 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01b041-57e6-4914-bb2a-4a4d39f6b2ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:26.198336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d1dae-c760-45ae-958f-4b66a998e888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:26.199151 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d1dae-c760-45ae-958f-4b66a998e888 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:26.199461 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d1dae-c760-45ae-958f-4b66a998e888 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:26.199744 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d1dae-c760-45ae-958f-4b66a998e888 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:26.200405 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d1dae-c760-45ae-958f-4b66a998e888 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:26.201775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877d1dae-c760-45ae-958f-4b66a998e888 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:26.207475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01b041-57e6-4914-bb2a-4a4d39f6b2ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:26.209175 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a01b041-57e6-4914-bb2a-4a4d39f6b2ce None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:26.215013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-877d1dae-c760-45ae-958f-4b66a998e888 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 20:35:26.215013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:26.215013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:35:26.215013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:35:26.215013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:35:26.215013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:35:26.215013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:35:26.215013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:26.215013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 20:35:26.215013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:26.215013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:26.215013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:26.215013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:26.215013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:26.215013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:26.215013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:26.215013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:26.216067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:26.216067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:26.216067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:26.216067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:26.216067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:26.216067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:26.216067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:35:26.216067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:35:26.216067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:35:26.216067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:35:26.216067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:26.216067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:26.216067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:26.216067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:26.216067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:26.216067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:26.216905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:26.216905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:26.216905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:26.216905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:26.216905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:26.216905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:26.216905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:26.216905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:26.216905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:26.216905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:26.216905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:35:26.216905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:26.216905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 20:35:26.216905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:26.221707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 476/947] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:35:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:26.222569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d1dae-c760-45ae-958f-4b66a998e888 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:26.234699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-2a01b041-57e6-4914-bb2a-4a4d39f6b2ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:26.234699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:26.234699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:26.234699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:26.234699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:26.234699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:26.234699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:26.234699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:26.234699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:26.234699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:26.234699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:26.234699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:26.234699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:26.234699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:26.234699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:26.236011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:26.236011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:26.236011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:26.236011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:26.236011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:26.236011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:26.236011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:26.236011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:26.236011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:26.236011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:26.236011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:26.236011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:26.236011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:26.236011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:26.236011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:26.236011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:26.236011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:26.237271 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:26.237271 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:26.237271 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:26.237271 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:26.239422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 472/948] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:26.246372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01b041-57e6-4914-bb2a-4a4d39f6b2ce None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:26.350773 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877d1dae-c760-45ae-958f-4b66a998e888 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:26.375573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01b041-57e6-4914-bb2a-4a4d39f6b2ce None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:26.387465 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be557067-a225-482c-a584-cbe33750d5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:26.388511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be557067-a225-482c-a584-cbe33750d5e6 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:26.389005 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be557067-a225-482c-a584-cbe33750d5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:26.389491 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be557067-a225-482c-a584-cbe33750d5e6 None admin] PATH_INFO: `/v3/services` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:26.390403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be557067-a225-482c-a584-cbe33750d5e6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:26.390918 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be557067-a225-482c-a584-cbe33750d5e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:26.392528 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be557067-a225-482c-a584-cbe33750d5e6 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:26.402683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 477/949] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jul 19 20:35:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:26.403843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be557067-a225-482c-a584-cbe33750d5e6 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:26.406129 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:26.412792 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74e8c6-5f46-420e-8389-931ed5e8ce77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:26.413458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74e8c6-5f46-420e-8389-931ed5e8ce77 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:26.413737 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74e8c6-5f46-420e-8389-931ed5e8ce77 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:26.414012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74e8c6-5f46-420e-8389-931ed5e8ce77 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:26.414733 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74e8c6-5f46-420e-8389-931ed5e8ce77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:26.415041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74e8c6-5f46-420e-8389-931ed5e8ce77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:26.416437 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74e8c6-5f46-420e-8389-931ed5e8ce77 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:26.428821 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 473/950] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:26.430050 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c48cb-862e-4f51-9bf0-564088e722d0 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:26.430318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c48cb-862e-4f51-9bf0-564088e722d0 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:26.430596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c48cb-862e-4f51-9bf0-564088e722d0 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:26.432084 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 474/951] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:26.434369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c48cb-862e-4f51-9bf0-564088e722d0 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:26.435507 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:26.515321 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be557067-a225-482c-a584-cbe33750d5e6 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:26.548807 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c48cb-862e-4f51-9bf0-564088e722d0 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:26.551655 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f467d-c7bb-467d-9fa9-6c29caaf76e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:26.552350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f467d-c7bb-467d-9fa9-6c29caaf76e2 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:26.552636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f467d-c7bb-467d-9fa9-6c29caaf76e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:26.552915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f467d-c7bb-467d-9fa9-6c29caaf76e2 None admin] PATH_INFO: `/v3/services` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:26.553810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f467d-c7bb-467d-9fa9-6c29caaf76e2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:26.555098 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f467d-c7bb-467d-9fa9-6c29caaf76e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:26.559068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f467d-c7bb-467d-9fa9-6c29caaf76e2 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:26.563982 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 478/952] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jul 19 20:35:26 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:26.571558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf84c3-006b-42e7-94d4-8c2b4e9ed7f7 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:26.571558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf84c3-006b-42e7-94d4-8c2b4e9ed7f7 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:26.571558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf84c3-006b-42e7-94d4-8c2b4e9ed7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:26.596993 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-8dcf84c3-006b-42e7-94d4-8c2b4e9ed7f7 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:26.598335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-8dcf84c3-006b-42e7-94d4-8c2b4e9ed7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:26.601844 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142a9c5-b3a0-48cd-9a2f-d2dabf522fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:26.603977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142a9c5-b3a0-48cd-9a2f-d2dabf522fda None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:26.604467 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142a9c5-b3a0-48cd-9a2f-d2dabf522fda None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:26.604961 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142a9c5-b3a0-48cd-9a2f-d2dabf522fda None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:26.614947 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142a9c5-b3a0-48cd-9a2f-d2dabf522fda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:26.617511 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142a9c5-b3a0-48cd-9a2f-d2dabf522fda None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:26.636097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-8142a9c5-b3a0-48cd-9a2f-d2dabf522fda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:26.636097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:26.636097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:26.636097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:26.636097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:26.636097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:26.636097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:26.636097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:26.636097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:26.636097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:26.636097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:26.636097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:26.636097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:35:26.636097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:35:26.636097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:35:26.637104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:35:26.637104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:26.637104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:26.637104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:26.637104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:26.637104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:26.637104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:26.637104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:26.637104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:26.637104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:26.637104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:26.637104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:26.637104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:26.637104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:26.637104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:26.637104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:26.637104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:26.638208 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:35:26.638208 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:35:26.638208 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:35:26.638208 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:35:26.638208 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:35:26.638208 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:35:26.638208 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:26.638208 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:26.642499 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 475/953] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:35:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:26.643500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142a9c5-b3a0-48cd-9a2f-d2dabf522fda None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:26.691832 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 479/954] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:26.715017 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:26.718206 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf84c3-006b-42e7-94d4-8c2b4e9ed7f7 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:26.742485 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:26.772501 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142a9c5-b3a0-48cd-9a2f-d2dabf522fda None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:26.812392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97e01f-cc5b-414a-82c9-64044874c917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:26.813088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97e01f-cc5b-414a-82c9-64044874c917 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:26.813372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97e01f-cc5b-414a-82c9-64044874c917 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:26.813664 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97e01f-cc5b-414a-82c9-64044874c917 None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:26.814437 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97e01f-cc5b-414a-82c9-64044874c917 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:26.814772 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97e01f-cc5b-414a-82c9-64044874c917 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:26.816314 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97e01f-cc5b-414a-82c9-64044874c917 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:26.829383 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 476/955] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:35:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:26.835553 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97e01f-cc5b-414a-82c9-64044874c917 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:26.846170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf84c3-006b-42e7-94d4-8c2b4e9ed7f7 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:26.890318 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d832c5-a795-4fad-b96d-e28182907731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:26.891148 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d832c5-a795-4fad-b96d-e28182907731 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:26.891463 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d832c5-a795-4fad-b96d-e28182907731 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:26.891742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d832c5-a795-4fad-b96d-e28182907731 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:26.892410 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d832c5-a795-4fad-b96d-e28182907731 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:26.893927 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d832c5-a795-4fad-b96d-e28182907731 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:26.912719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-70d832c5-a795-4fad-b96d-e28182907731 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 20:35:26.912719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:26.912719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:35:26.912719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:35:26.912719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:35:26.912719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:35:26.912719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:35:26.912719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:26.912719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 20:35:26.912719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:26.912719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:26.912719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:26.912719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:26.912719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:26.912719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:26.912719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:26.912719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:26.913988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:26.913988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:26.913988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:26.913988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:26.913988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:26.913988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:26.913988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:35:26.913988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:35:26.913988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:35:26.913988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:35:26.913988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:26.913988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:26.913988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:26.913988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:26.913988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:26.913988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:26.914877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:26.914877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:26.914877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:26.914877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:26.914877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:26.914877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:26.914877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:26.914877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:26.914877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:26.914877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:26.914877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:35:26.914877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:26.914877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 20:35:26.914877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:26.917886 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 480/956] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Jul 19 20:35:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:26.925346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d832c5-a795-4fad-b96d-e28182907731 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:26.954904 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97e01f-cc5b-414a-82c9-64044874c917 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:26.968721 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:26.991509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fa7ca-9e1f-4126-b6c1-b9978231d3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:26.992577 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa7ca-9e1f-4126-b6c1-b9978231d3bc None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:26.992927 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa7ca-9e1f-4126-b6c1-b9978231d3bc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:26.993268 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa7ca-9e1f-4126-b6c1-b9978231d3bc None admin] PATH_INFO: `/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/c8f314167aa94d81955ac761a5a28504/roles/8f8d721df639446bb89673cc687829e3` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:26.995896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fa7ca-9e1f-4126-b6c1-b9978231d3bc None admin] RBAC: Authorizing `identity:create_grant(project_id=327868f4f62e4e4a9c5bef4acd32fb29, user_id=c8f314167aa94d81955ac761a5a28504, role_id=8f8d721df639446bb89673cc687829e3)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:26.997498 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fa7ca-9e1f-4126-b6c1-b9978231d3bc None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:27.014386 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 477/957] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:35:26 2022] PUT /identity/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/c8f314167aa94d81955ac761a5a28504/roles/8f8d721df639446bb89673cc687829e3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:35:27.024586 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:27.048841 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d832c5-a795-4fad-b96d-e28182907731 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:27.089223 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca03a7-5b0c-4e52-85b3-70a0de2ad1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:27.090045 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca03a7-5b0c-4e52-85b3-70a0de2ad1c9 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:27.090329 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca03a7-5b0c-4e52-85b3-70a0de2ad1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:27.090602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca03a7-5b0c-4e52-85b3-70a0de2ad1c9 None admin] PATH_INFO: `/v3/services` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:27.091389 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca03a7-5b0c-4e52-85b3-70a0de2ad1c9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:27.091705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca03a7-5b0c-4e52-85b3-70a0de2ad1c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:27.093181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca03a7-5b0c-4e52-85b3-70a0de2ad1c9 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:27.099406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 481/958] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Jul 19 20:35:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:27.105388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fa7ca-9e1f-4126-b6c1-b9978231d3bc None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:27.204720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c98ee-7a0c-4415-8fa2-7f1ff751363c None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:27.204910 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c98ee-7a0c-4415-8fa2-7f1ff751363c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:27.205196 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c98ee-7a0c-4415-8fa2-7f1ff751363c None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:27.206710 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 482/959] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:35:27.212954 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75be6d5-fb3e-4cd2-a8f9-427a9c4a404e None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:27.213515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75be6d5-fb3e-4cd2-a8f9-427a9c4a404e None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:27.214008 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75be6d5-fb3e-4cd2-a8f9-427a9c4a404e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:27.223585 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fa7ca-9e1f-4126-b6c1-b9978231d3bc None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:27.232186 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-f75be6d5-fb3e-4cd2-a8f9-427a9c4a404e None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:27.233629 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-f75be6d5-fb3e-4cd2-a8f9-427a9c4a404e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:27.260653 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17e442-9a07-425e-9d3a-c5474c6f4dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:27.261579 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17e442-9a07-425e-9d3a-c5474c6f4dc7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:27.262000 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17e442-9a07-425e-9d3a-c5474c6f4dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:27.262419 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17e442-9a07-425e-9d3a-c5474c6f4dc7 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:27.263417 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17e442-9a07-425e-9d3a-c5474c6f4dc7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:27.263868 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17e442-9a07-425e-9d3a-c5474c6f4dc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:27.265476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17e442-9a07-425e-9d3a-c5474c6f4dc7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:27.271588 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 478/960] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Jul 19 20:35:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:27.277691 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17e442-9a07-425e-9d3a-c5474c6f4dc7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:27.316163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 483/961] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:27.327277 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:27.342580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75be6d5-fb3e-4cd2-a8f9-427a9c4a404e None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:27.416431 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17e442-9a07-425e-9d3a-c5474c6f4dc7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:27.433668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:27.461818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75be6d5-fb3e-4cd2-a8f9-427a9c4a404e None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:27.466140 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1852dd-ae2e-4e77-bf8c-a5c671223af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:27.466987 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1852dd-ae2e-4e77-bf8c-a5c671223af4 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:27.467472 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1852dd-ae2e-4e77-bf8c-a5c671223af4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:27.467895 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1852dd-ae2e-4e77-bf8c-a5c671223af4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:27.468786 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1852dd-ae2e-4e77-bf8c-a5c671223af4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:27.470846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1852dd-ae2e-4e77-bf8c-a5c671223af4 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:27.503286 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 479/962] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Jul 19 20:35:27 2022] POST /identity/v3/endpoints => generated 349 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:35:27.519093 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea6545-f32f-4920-9720-db890cc13e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:27.519834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea6545-f32f-4920-9720-db890cc13e99 None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:27.520116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea6545-f32f-4920-9720-db890cc13e99 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:27.520391 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea6545-f32f-4920-9720-db890cc13e99 None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:27.521305 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea6545-f32f-4920-9720-db890cc13e99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:27.522900 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea6545-f32f-4920-9720-db890cc13e99 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:27.537578 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.sql.core [None req-55ea6545-f32f-4920-9720-db890cc13e99 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 19 20:35:27.537578 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 19 20:35:27.537578 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [parameters: {'user_id': '71996a484b1d4ab188c189c274430397', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 19 20:35:27.537578 dv-cinder-749155-8-smb devstack@keystone.service[92087]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=92087) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 20:35:27.545796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-55ea6545-f32f-4920-9720-db890cc13e99 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 19 20:35:27.545796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:27.545796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 20:35:27.545796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 20:35:27.545796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 20:35:27.545796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 20:35:27.545796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 20:35:27.545796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 20:35:27.545796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 20:35:27.545796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application conn.query(q) Jul 19 20:35:27.545796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 20:35:27.545796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 20:35:27.545796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 20:35:27.545796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application result.read() Jul 19 20:35:27.545796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 20:35:27.546776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 20:35:27.546776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 20:35:27.546776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 20:35:27.546776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 20:35:27.546776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 20:35:27.546776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 20:35:27.546776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 20:35:27.546776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 19 20:35:27.546776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:27.546776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 20:35:27.546776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:27.546776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:27.546776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 20:35:27.546776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 20:35:27.546776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 19 20:35:27.546776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 19 20:35:27.546776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 20:35:27.546776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application next(self.gen) Jul 19 20:35:27.547948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 20:35:27.547948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application yield resource Jul 19 20:35:27.547948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 20:35:27.547948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application next(self.gen) Jul 19 20:35:27.547948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 20:35:27.547948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 20:35:27.547948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 20:35:27.547948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 20:35:27.547948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 20:35:27.547948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise self.value Jul 19 20:35:27.547948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 20:35:27.547948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 20:35:27.547948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 20:35:27.547948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application session.commit() Jul 19 20:35:27.547948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 20:35:27.547948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 20:35:27.547948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 20:35:27.548889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 20:35:27.548889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 20:35:27.548889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self.session.flush() Jul 19 20:35:27.548889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 20:35:27.548889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 20:35:27.548889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 20:35:27.548889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 20:35:27.548889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 20:35:27.548889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application compat.raise_( Jul 19 20:35:27.548889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 20:35:27.548889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception Jul 19 20:35:27.548889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 20:35:27.548889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 20:35:27.548889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 20:35:27.548889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 20:35:27.548889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 20:35:27.548889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 20:35:27.549809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 20:35:27.549809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 20:35:27.549809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 19 20:35:27.549809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 19 20:35:27.549809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 20:35:27.549809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 20:35:27.549809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 20:35:27.549809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 20:35:27.549809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 20:35:27.549809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 20:35:27.549809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 20:35:27.549809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 20:35:27.549809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 20:35:27.549809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 20:35:27.549809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 20:35:27.549809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception Jul 19 20:35:27.550663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 20:35:27.550663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 20:35:27.550663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 20:35:27.550663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 20:35:27.550663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 20:35:27.550663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 20:35:27.550663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 20:35:27.550663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application conn.query(q) Jul 19 20:35:27.550663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 20:35:27.550663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 20:35:27.550663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 20:35:27.550663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application result.read() Jul 19 20:35:27.550663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 20:35:27.550663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 20:35:27.550663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 20:35:27.550663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 20:35:27.554901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 20:35:27.554901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 20:35:27.554901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 20:35:27.554901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 20:35:27.554901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 19 20:35:27.554901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 19 20:35:27.554901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [parameters: {'user_id': '71996a484b1d4ab188c189c274430397', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 19 20:35:27.554901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 20:35:27.554901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:27.554901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:27.554901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:27.554901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:27.554901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:27.554901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:27.554901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:27.555815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:27.555815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:27.555815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:27.555815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:27.555815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:27.555815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:27.555815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:27.555815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 19 20:35:27.555815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 19 20:35:27.555815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:27.555815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:27.555815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:35:27.555815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:27.555815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:35:27.555815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:27.555815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 19 20:35:27.555815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 19 20:35:27.556769 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 19 20:35:27.556769 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 19 20:35:27.556769 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 20:35:27.556769 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 20:35:27.556769 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 19 20:35:27.556769 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:27.556769 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 484/963] 10.222.0.77 () {60 vars in 1131 bytes} [Tue Jul 19 20:35:27 2022] POST /identity/v3/users => generated 160 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:27.557188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1852dd-ae2e-4e77-bf8c-a5c671223af4 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:27.665473 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:27.679541 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1852dd-ae2e-4e77-bf8c-a5c671223af4 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:27.718085 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03743a-5b2b-4c1d-9c7f-b41a256a78a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:27.719210 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03743a-5b2b-4c1d-9c7f-b41a256a78a3 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:27.719662 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03743a-5b2b-4c1d-9c7f-b41a256a78a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:27.720082 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03743a-5b2b-4c1d-9c7f-b41a256a78a3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:27.729715 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03743a-5b2b-4c1d-9c7f-b41a256a78a3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:27.731163 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03743a-5b2b-4c1d-9c7f-b41a256a78a3 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:27.747897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-ca03743a-5b2b-4c1d-9c7f-b41a256a78a3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 20:35:27.747897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:27.747897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:27.747897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:27.747897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:27.747897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:27.747897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:27.747897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:27.747897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:27.747897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:27.747897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:27.747897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:27.747897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:35:27.747897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:35:27.747897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:35:27.747897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:35:27.748882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:27.748882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:27.748882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:35:27.748882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:27.748882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:35:27.748882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:27.748882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:27.748882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:27.748882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:27.748882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:27.748882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:27.748882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:27.748882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:27.748882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:27.748882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:27.748882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:27.748882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:27.748882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:27.749866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:27.749866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:27.749866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:35:27.749866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:35:27.749866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:35:27.749866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:35:27.749866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:35:27.749866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:35:27.749866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 20:35:27.749866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:27.752633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 480/964] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:35:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:27.759498 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea6545-f32f-4920-9720-db890cc13e99 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:27.870788 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea6545-f32f-4920-9720-db890cc13e99 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:27.905333 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60e37a0-d694-439e-ad03-75ad073bae0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:27.906011 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e37a0-d694-439e-ad03-75ad073bae0b None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:27.906295 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e37a0-d694-439e-ad03-75ad073bae0b None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:27.906570 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60e37a0-d694-439e-ad03-75ad073bae0b None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:27.907414 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e37a0-d694-439e-ad03-75ad073bae0b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:27.907724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e37a0-d694-439e-ad03-75ad073bae0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:27.909358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60e37a0-d694-439e-ad03-75ad073bae0b None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:27.911652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:27.950017 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 485/965] 10.222.0.77 () {56 vars in 1101 bytes} [Tue Jul 19 20:35:27 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:28.698190 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60183730-2b5d-45fe-8657-d082a4833e7b None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:28.698765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60183730-2b5d-45fe-8657-d082a4833e7b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:28.698765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60183730-2b5d-45fe-8657-d082a4833e7b None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:28.700187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 481/966] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:28.706101 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93886702-2a56-4fc7-82d6-b9a190fcb22c None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:28.706402 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93886702-2a56-4fc7-82d6-b9a190fcb22c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:28.706666 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93886702-2a56-4fc7-82d6-b9a190fcb22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:28.725515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-93886702-2a56-4fc7-82d6-b9a190fcb22c None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:28.727006 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-93886702-2a56-4fc7-82d6-b9a190fcb22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:28.794992 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 486/967] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:28.816508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60183730-2b5d-45fe-8657-d082a4833e7b None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:28.925669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60183730-2b5d-45fe-8657-d082a4833e7b None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:28.959102 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17f202-b05b-41cf-ae99-3631c2f25361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:28.959713 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17f202-b05b-41cf-ae99-3631c2f25361 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:28.959989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17f202-b05b-41cf-ae99-3631c2f25361 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:28.960255 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17f202-b05b-41cf-ae99-3631c2f25361 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:28.960971 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17f202-b05b-41cf-ae99-3631c2f25361 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:28.962309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17f202-b05b-41cf-ae99-3631c2f25361 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:28.976561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 482/968] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jul 19 20:35:28 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:35:29.170500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626a6c3-f936-4d6d-ab02-cc6b0e6222ad None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:29.171044 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626a6c3-f936-4d6d-ab02-cc6b0e6222ad None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:29.171044 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626a6c3-f936-4d6d-ab02-cc6b0e6222ad None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:29.172667 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 487/969] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:29.177861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafc01a-6d3e-48d9-a4fb-e37d8ca36b7a None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:29.178156 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafc01a-6d3e-48d9-a4fb-e37d8ca36b7a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:29.178433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafc01a-6d3e-48d9-a4fb-e37d8ca36b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:29.195841 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-aeafc01a-6d3e-48d9-a4fb-e37d8ca36b7a None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:29.197023 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-aeafc01a-6d3e-48d9-a4fb-e37d8ca36b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:29.204769 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:29.276198 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 483/970] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:29.299908 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626a6c3-f936-4d6d-ab02-cc6b0e6222ad None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:29.406403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626a6c3-f936-4d6d-ab02-cc6b0e6222ad None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:29.429562 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:29.442270 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f24b2-5e17-4155-9f99-258ba684283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:29.444939 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f24b2-5e17-4155-9f99-258ba684283f None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:29.444939 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f24b2-5e17-4155-9f99-258ba684283f None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:29.444939 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f24b2-5e17-4155-9f99-258ba684283f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:29.454708 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f24b2-5e17-4155-9f99-258ba684283f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:35:29.463592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-8b9f24b2-5e17-4155-9f99-258ba684283f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 20:35:29.463592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:29.463592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:29.463592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:29.463592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:29.463592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:29.463592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:29.463592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:29.463592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:29.463592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:29.463592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:29.463592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:29.463592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:35:29.463592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:35:29.463592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:35:29.463592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:35:29.464522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:35:29.464522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:35:29.464522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:35:29.464522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:35:29.464522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:29.464522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:29.464522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:29.464522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:29.464522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:29.464522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:29.464522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:29.464522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:29.464522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:29.464522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:29.464522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:29.464522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:29.465364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:29.465364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:29.465364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:29.465364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:29.465364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:35:29.465364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:35:29.465364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:35:29.465364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:35:29.465364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:35:29.465364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:35:29.465364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 20:35:29.465364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:29.467615 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 488/971] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Jul 19 20:35:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:29.470659 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafc01a-6d3e-48d9-a4fb-e37d8ca36b7a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:29.572838 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafc01a-6d3e-48d9-a4fb-e37d8ca36b7a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:29.607177 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e308d9-1bff-4e08-8b57-79cf50fa73ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:29.607905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e308d9-1bff-4e08-8b57-79cf50fa73ae None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:29.608188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e308d9-1bff-4e08-8b57-79cf50fa73ae None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:29.608465 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e308d9-1bff-4e08-8b57-79cf50fa73ae None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:29.609278 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e308d9-1bff-4e08-8b57-79cf50fa73ae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:29.609584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e308d9-1bff-4e08-8b57-79cf50fa73ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:29.610937 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e308d9-1bff-4e08-8b57-79cf50fa73ae None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:29.616213 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:29.626068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f24b2-5e17-4155-9f99-258ba684283f None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:29.626682 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 484/972] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Jul 19 20:35:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:29.644190 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe8820-daa0-4ead-8a80-22ac3993bad0 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:29.644476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe8820-daa0-4ead-8a80-22ac3993bad0 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:29.644757 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe8820-daa0-4ead-8a80-22ac3993bad0 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:29.646895 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 485/973] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:29.653466 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086575c-a8e9-4378-918a-28c06d11dc84 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:29.653957 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086575c-a8e9-4378-918a-28c06d11dc84 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:29.654479 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086575c-a8e9-4378-918a-28c06d11dc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:29.675841 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-e086575c-a8e9-4378-918a-28c06d11dc84 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:29.677449 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e086575c-a8e9-4378-918a-28c06d11dc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:29.740320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f24b2-5e17-4155-9f99-258ba684283f None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:29.754436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 486/974] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 20:35:29.776447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba1e71-a85e-457f-afad-efd41f666934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:29.777360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba1e71-a85e-457f-afad-efd41f666934 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:29.777923 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba1e71-a85e-457f-afad-efd41f666934 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:29.778207 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba1e71-a85e-457f-afad-efd41f666934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:29.778546 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086575c-a8e9-4378-918a-28c06d11dc84 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:29.790045 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba1e71-a85e-457f-afad-efd41f666934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:29.791510 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba1e71-a85e-457f-afad-efd41f666934 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:29.809012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-2aba1e71-a85e-457f-afad-efd41f666934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:29.809012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:29.809012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:29.809012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:29.809012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:29.809012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:29.809012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:29.809012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:29.809012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:29.809012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:29.809012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:29.809012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:29.809012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:29.809012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:29.809012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:29.809915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:29.809915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:29.809915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:29.809915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:29.809915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:29.809915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:29.809915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:29.809915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:29.809915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:29.809915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:29.809915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:29.809915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:29.809915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:29.809915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:29.809915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:29.809915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:29.809915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:29.811526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:29.811526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:29.811526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:29.811526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:29.811526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 489/975] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:29.815683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba1e71-a85e-457f-afad-efd41f666934 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:29.852936 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:29.894106 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086575c-a8e9-4378-918a-28c06d11dc84 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:29.925650 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:29.931778 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba1e71-a85e-457f-afad-efd41f666934 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:29.933329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61adb3d-3004-49f7-a5f2-2ce22d8b616e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:29.934920 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61adb3d-3004-49f7-a5f2-2ce22d8b616e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:29.935210 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61adb3d-3004-49f7-a5f2-2ce22d8b616e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:29.935533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61adb3d-3004-49f7-a5f2-2ce22d8b616e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:29.936197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61adb3d-3004-49f7-a5f2-2ce22d8b616e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:29.937567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61adb3d-3004-49f7-a5f2-2ce22d8b616e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:29.951608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-b61adb3d-3004-49f7-a5f2-2ce22d8b616e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 20:35:29.951608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:29.951608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:35:29.951608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:35:29.951608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:35:29.951608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:35:29.951608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:35:29.951608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:29.951608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 20:35:29.951608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:29.951608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:29.951608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:29.951608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:29.951608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:29.951608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:29.951608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:29.951608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:29.952687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:29.952687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:29.952687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:29.952687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:29.952687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:29.952687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:29.952687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:35:29.952687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:35:29.952687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:35:29.952687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:35:29.952687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:29.952687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:29.952687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:29.952687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:29.952687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:29.952687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:29.953547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:29.953547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:29.953547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:29.953547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:29.953547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:29.953547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:29.953547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:29.953547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:29.953547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:29.953547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:29.953547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:35:29.953547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:29.953547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 20:35:29.953547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:29.953547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 487/976] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Jul 19 20:35:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:29.958794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61adb3d-3004-49f7-a5f2-2ce22d8b616e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:29.970645 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fb977-3f51-4f61-bc0b-47985996a0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:29.971665 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fb977-3f51-4f61-bc0b-47985996a0a0 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:29.972164 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fb977-3f51-4f61-bc0b-47985996a0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:29.972399 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fb977-3f51-4f61-bc0b-47985996a0a0 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:29.973134 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fb977-3f51-4f61-bc0b-47985996a0a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:29.973523 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fb977-3f51-4f61-bc0b-47985996a0a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:29.975390 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fb977-3f51-4f61-bc0b-47985996a0a0 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:29.993621 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 490/977] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:29.995558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fb977-3f51-4f61-bc0b-47985996a0a0 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:30.070729 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61adb3d-3004-49f7-a5f2-2ce22d8b616e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:30.100100 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:30.108717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89922df5-dcd8-4a50-8e9b-99f7227cd808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:30.109059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fb977-3f51-4f61-bc0b-47985996a0a0 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:30.109316 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89922df5-dcd8-4a50-8e9b-99f7227cd808 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:30.109600 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89922df5-dcd8-4a50-8e9b-99f7227cd808 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:30.109877 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89922df5-dcd8-4a50-8e9b-99f7227cd808 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:30.110621 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89922df5-dcd8-4a50-8e9b-99f7227cd808 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:30.110930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89922df5-dcd8-4a50-8e9b-99f7227cd808 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:30.112335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89922df5-dcd8-4a50-8e9b-99f7227cd808 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:30.119629 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 488/978] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Jul 19 20:35:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:30.123491 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89922df5-dcd8-4a50-8e9b-99f7227cd808 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:30.147196 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8092c1-1773-4e4a-9fbd-f24f89bee099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:30.148049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8092c1-1773-4e4a-9fbd-f24f89bee099 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:30.148332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8092c1-1773-4e4a-9fbd-f24f89bee099 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:30.148604 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8092c1-1773-4e4a-9fbd-f24f89bee099 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:30.157333 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8092c1-1773-4e4a-9fbd-f24f89bee099 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:30.158758 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8092c1-1773-4e4a-9fbd-f24f89bee099 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:30.174530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-fc8092c1-1773-4e4a-9fbd-f24f89bee099 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 20:35:30.174530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:30.174530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:30.174530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:30.174530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:30.174530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:30.174530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:30.174530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:30.174530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:30.174530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:30.174530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:30.174530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:30.174530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:35:30.174530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:35:30.174530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:35:30.174530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:35:30.175975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:30.175975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:30.175975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:35:30.175975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:30.175975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:35:30.175975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:30.175975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:30.175975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:30.175975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:30.175975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:30.175975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:30.175975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:30.175975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:30.175975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:30.175975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:30.175975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:30.175975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:30.175975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:30.177566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:30.177566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:30.177566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:35:30.177566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:35:30.177566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:35:30.177566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:35:30.177566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:35:30.177566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:35:30.177566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 20:35:30.177566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:30.177566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 491/979] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Jul 19 20:35:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:30.182069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8092c1-1773-4e4a-9fbd-f24f89bee099 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:30.191527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:30.238084 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89922df5-dcd8-4a50-8e9b-99f7227cd808 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:30.276005 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e17127-f741-4489-b54d-c9e82914624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:30.276848 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e17127-f741-4489-b54d-c9e82914624e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:30.277136 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e17127-f741-4489-b54d-c9e82914624e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:30.277413 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e17127-f741-4489-b54d-c9e82914624e None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:30.278438 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e17127-f741-4489-b54d-c9e82914624e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:30.278745 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e17127-f741-4489-b54d-c9e82914624e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:30.280171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e17127-f741-4489-b54d-c9e82914624e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:30.286211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 489/980] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Jul 19 20:35:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:30.293168 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e17127-f741-4489-b54d-c9e82914624e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:30.300200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8092c1-1773-4e4a-9fbd-f24f89bee099 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:30.338461 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e9e2f-53a2-4b89-8efb-980ef1854be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:30.339133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e9e2f-53a2-4b89-8efb-980ef1854be1 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:30.339462 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e9e2f-53a2-4b89-8efb-980ef1854be1 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:30.339743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e9e2f-53a2-4b89-8efb-980ef1854be1 None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:30.340571 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e9e2f-53a2-4b89-8efb-980ef1854be1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:30.340965 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e9e2f-53a2-4b89-8efb-980ef1854be1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:30.342339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e9e2f-53a2-4b89-8efb-980ef1854be1 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:30.361190 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 492/981] 10.222.0.77 () {56 vars in 1149 bytes} [Tue Jul 19 20:35:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:30.367332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e9e2f-53a2-4b89-8efb-980ef1854be1 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:30.382417 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:30.401093 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e17127-f741-4489-b54d-c9e82914624e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:30.425129 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:30.439450 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5196ec7-f29e-4cf8-b6c5-2fefd2a7be00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:30.440174 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5196ec7-f29e-4cf8-b6c5-2fefd2a7be00 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:30.440464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5196ec7-f29e-4cf8-b6c5-2fefd2a7be00 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:30.440743 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5196ec7-f29e-4cf8-b6c5-2fefd2a7be00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:30.441536 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5196ec7-f29e-4cf8-b6c5-2fefd2a7be00 None admin] RBAC: Adding query filter params (interface=admin, service_id=c86932be688a4952bde88008da4c8417, region_id=RegionOne) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:30.441850 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5196ec7-f29e-4cf8-b6c5-2fefd2a7be00 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:30.444216 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5196ec7-f29e-4cf8-b6c5-2fefd2a7be00 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:30.449405 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 490/982] 10.222.0.77 () {56 vars in 1249 bytes} [Tue Jul 19 20:35:30 2022] GET /identity/v3/endpoints?service_id=c86932be688a4952bde88008da4c8417&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:30.454685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5196ec7-f29e-4cf8-b6c5-2fefd2a7be00 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:30.474997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e9e2f-53a2-4b89-8efb-980ef1854be1 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:30.510861 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d9839-6414-46e4-b0d4-fbe4b486c5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:30.511553 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d9839-6414-46e4-b0d4-fbe4b486c5ab None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:30.511833 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d9839-6414-46e4-b0d4-fbe4b486c5ab None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:30.512113 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d9839-6414-46e4-b0d4-fbe4b486c5ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:30.562816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5196ec7-f29e-4cf8-b6c5-2fefd2a7be00 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:30.586531 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d9839-6414-46e4-b0d4-fbe4b486c5ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:30.588004 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d9839-6414-46e4-b0d4-fbe4b486c5ab None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:30.599033 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba99af0-1c00-4f83-9db9-6a42552b45ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:30.599730 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba99af0-1c00-4f83-9db9-6a42552b45ba None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:30.600017 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba99af0-1c00-4f83-9db9-6a42552b45ba None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:30.600296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba99af0-1c00-4f83-9db9-6a42552b45ba None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:30.600977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba99af0-1c00-4f83-9db9-6a42552b45ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:30.602324 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba99af0-1c00-4f83-9db9-6a42552b45ba None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:30.603395 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:30.619389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 491/983] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Jul 19 20:35:30 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:35:30.709620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 493/984] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:35:30 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 20:35:30.715695 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba99af0-1c00-4f83-9db9-6a42552b45ba None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:30.771010 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:30.824033 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba99af0-1c00-4f83-9db9-6a42552b45ba None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:30.858159 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c72f0-6812-433c-945a-7867044f3695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:30.858957 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c72f0-6812-433c-945a-7867044f3695 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:30.859241 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c72f0-6812-433c-945a-7867044f3695 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:30.859546 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c72f0-6812-433c-945a-7867044f3695 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:30.871477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c72f0-6812-433c-945a-7867044f3695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:30.872857 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c72f0-6812-433c-945a-7867044f3695 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:30.895533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-3b4c72f0-6812-433c-945a-7867044f3695 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:30.895533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:30.895533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:30.895533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:30.895533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:30.895533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:30.895533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:30.895533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:30.895533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:30.895533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:30.895533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:30.895533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:30.895533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:30.895533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:30.895533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:30.896462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:30.896462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:30.896462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:30.896462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:30.896462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:30.896462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:30.896462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:30.896462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:30.896462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:30.896462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:30.896462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:30.896462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:30.896462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:30.896462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:30.896462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:30.896462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:30.896462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:30.902077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:30.902077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:30.902077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:30.902077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:30.902077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 492/985] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:30.908403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d9839-6414-46e4-b0d4-fbe4b486c5ab None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:31.012279 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d9839-6414-46e4-b0d4-fbe4b486c5ab None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:31.026428 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:31.047362 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62b352-a974-43fc-9c59-ead94320e36d None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:31.047685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62b352-a974-43fc-9c59-ead94320e36d None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:31.047972 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62b352-a974-43fc-9c59-ead94320e36d None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:31.049467 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 493/986] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:35:31.050427 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea99809-0515-4601-a91b-eaf8b2c55a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:31.051101 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea99809-0515-4601-a91b-eaf8b2c55a9a None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:31.051419 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea99809-0515-4601-a91b-eaf8b2c55a9a None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:31.051692 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea99809-0515-4601-a91b-eaf8b2c55a9a None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:31.052448 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea99809-0515-4601-a91b-eaf8b2c55a9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:31.052754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea99809-0515-4601-a91b-eaf8b2c55a9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:31.054283 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d400e-5f52-4f20-8171-e4d1af538e5d None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:31.054479 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea99809-0515-4601-a91b-eaf8b2c55a9a None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:31.054558 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d400e-5f52-4f20-8171-e4d1af538e5d None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:31.054843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d400e-5f52-4f20-8171-e4d1af538e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:31.072252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 494/987] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:31.072439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-4e1d400e-5f52-4f20-8171-e4d1af538e5d None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:31.072826 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-4e1d400e-5f52-4f20-8171-e4d1af538e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:31.073319 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea99809-0515-4601-a91b-eaf8b2c55a9a None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:31.151671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 494/988] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 20:35:31.166412 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d400e-5f52-4f20-8171-e4d1af538e5d None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:31.176426 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea99809-0515-4601-a91b-eaf8b2c55a9a None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:31.196643 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:31.213105 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18be0b-b937-43d2-a508-196969514149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:31.213909 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18be0b-b937-43d2-a508-196969514149 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:31.214193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18be0b-b937-43d2-a508-196969514149 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:31.214472 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18be0b-b937-43d2-a508-196969514149 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:31.221595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18be0b-b937-43d2-a508-196969514149 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:31.223028 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d18be0b-b937-43d2-a508-196969514149 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:31.237973 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-5d18be0b-b937-43d2-a508-196969514149 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:31.237973 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:31.237973 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:31.237973 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:31.237973 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:31.237973 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:31.237973 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:31.237973 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:31.237973 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:31.237973 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:31.237973 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:31.237973 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:31.237973 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:35:31.237973 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:35:31.237973 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:35:31.239145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:35:31.239145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:31.239145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:31.239145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:31.239145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:31.239145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:31.239145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:31.239145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:31.239145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:31.239145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:31.239145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:31.239145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:31.239145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:31.239145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:31.239145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:31.239145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:31.239145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:31.240299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:35:31.240299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:35:31.240299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:35:31.240299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:35:31.240299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:35:31.240299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:35:31.240299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:31.240299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:31.240299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 495/989] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:35:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:31.244774 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18be0b-b937-43d2-a508-196969514149 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:31.276205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:31.277177 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d400e-5f52-4f20-8171-e4d1af538e5d None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:31.313064 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced02f0b-f1ec-4c3b-97c3-41eaf1b73c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:31.313871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced02f0b-f1ec-4c3b-97c3-41eaf1b73c96 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:31.314156 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced02f0b-f1ec-4c3b-97c3-41eaf1b73c96 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:31.314433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced02f0b-f1ec-4c3b-97c3-41eaf1b73c96 None admin] PATH_INFO: `/v3/services/compute` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:31.315096 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced02f0b-f1ec-4c3b-97c3-41eaf1b73c96 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:31.316511 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced02f0b-f1ec-4c3b-97c3-41eaf1b73c96 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:31.328998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-ced02f0b-f1ec-4c3b-97c3-41eaf1b73c96 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 20:35:31.328998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:31.328998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:35:31.328998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:35:31.328998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:35:31.328998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:35:31.328998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:35:31.328998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:31.328998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 20:35:31.328998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:31.328998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:31.328998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:31.328998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:31.328998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:31.328998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:31.328998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:31.328998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:31.330036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:31.330036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:31.330036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:31.330036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:31.330036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:31.330036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:31.330036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:35:31.330036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:35:31.330036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:35:31.330036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:35:31.330036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:31.330036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:31.330036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:31.330036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:31.330036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:31.330036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:31.330876 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:31.330876 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:31.330876 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:31.330876 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:31.330876 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:31.330876 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:31.330876 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:31.330876 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:31.330876 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:31.330876 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:31.330876 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:35:31.330876 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:31.330876 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 20:35:31.330876 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:31.330876 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 495/990] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:35:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:31.336482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced02f0b-f1ec-4c3b-97c3-41eaf1b73c96 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:31.356510 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d18be0b-b937-43d2-a508-196969514149 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:31.394848 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66e75d-9002-4abe-81b0-a6fef008c39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:31.395546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66e75d-9002-4abe-81b0-a6fef008c39a None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:31.395858 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66e75d-9002-4abe-81b0-a6fef008c39a None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:31.396167 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66e75d-9002-4abe-81b0-a6fef008c39a None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:31.396925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66e75d-9002-4abe-81b0-a6fef008c39a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:31.397235 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66e75d-9002-4abe-81b0-a6fef008c39a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:31.398651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66e75d-9002-4abe-81b0-a6fef008c39a None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:31.410653 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 496/991] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:35:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:31.417006 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66e75d-9002-4abe-81b0-a6fef008c39a None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:31.437341 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:31.445036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced02f0b-f1ec-4c3b-97c3-41eaf1b73c96 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:31.489866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a1865-6f41-44e6-827e-da7262b6ce8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:31.490855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a1865-6f41-44e6-827e-da7262b6ce8e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:31.491381 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a1865-6f41-44e6-827e-da7262b6ce8e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:31.491839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a1865-6f41-44e6-827e-da7262b6ce8e None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:31.492718 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a1865-6f41-44e6-827e-da7262b6ce8e None admin] RBAC: Adding query filter params (name=compute) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:31.493227 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a1865-6f41-44e6-827e-da7262b6ce8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:31.494760 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a1865-6f41-44e6-827e-da7262b6ce8e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:31.500217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 496/992] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jul 19 20:35:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:31.505955 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a1865-6f41-44e6-827e-da7262b6ce8e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:31.517987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:31.528036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66e75d-9002-4abe-81b0-a6fef008c39a None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:31.563960 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f37dd-65f3-48a3-9f6c-5f320fb05e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:31.564707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f37dd-65f3-48a3-9f6c-5f320fb05e8e None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:31.564998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f37dd-65f3-48a3-9f6c-5f320fb05e8e None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:31.565304 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f37dd-65f3-48a3-9f6c-5f320fb05e8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:31.566137 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f37dd-65f3-48a3-9f6c-5f320fb05e8e None admin] RBAC: Adding query filter params (role.id=8f8d721df639446bb89673cc687829e3, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=c8f314167aa94d81955ac761a5a28504) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:31.566452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f37dd-65f3-48a3-9f6c-5f320fb05e8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:31.568455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f37dd-65f3-48a3-9f6c-5f320fb05e8e None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:31.579667 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 497/993] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:35:31 2022] GET /identity/v3/role_assignments?user.id=c8f314167aa94d81955ac761a5a28504&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=8f8d721df639446bb89673cc687829e3 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:31.614889 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a1865-6f41-44e6-827e-da7262b6ce8e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:31.652856 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1361-26b4-450d-bc79-b6246346e35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:31.653528 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1361-26b4-450d-bc79-b6246346e35d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:31.653809 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1361-26b4-450d-bc79-b6246346e35d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:31.654083 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef1361-26b4-450d-bc79-b6246346e35d None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:31.654792 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef1361-26b4-450d-bc79-b6246346e35d None admin] RBAC: Adding query filter params (type=compute) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:31.655096 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef1361-26b4-450d-bc79-b6246346e35d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:31.656517 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef1361-26b4-450d-bc79-b6246346e35d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:31.667360 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 497/994] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jul 19 20:35:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:31.668416 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f37dd-65f3-48a3-9f6c-5f320fb05e8e None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:31.780493 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f37dd-65f3-48a3-9f6c-5f320fb05e8e None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:31.814649 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92fa5ad-1c87-4ca0-b417-0da855203979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:31.815344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fa5ad-1c87-4ca0-b417-0da855203979 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:31.815633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fa5ad-1c87-4ca0-b417-0da855203979 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:31.815909 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92fa5ad-1c87-4ca0-b417-0da855203979 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:31.816708 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92fa5ad-1c87-4ca0-b417-0da855203979 None admin] RBAC: Adding query filter params (interface=public, service_id=5822d68497b54d2b90262e691c0fab96, region_id=RegionOne) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:31.817018 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92fa5ad-1c87-4ca0-b417-0da855203979 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:31.818436 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92fa5ad-1c87-4ca0-b417-0da855203979 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:31.823875 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 498/995] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Jul 19 20:35:31 2022] GET /identity/v3/endpoints?service_id=5822d68497b54d2b90262e691c0fab96&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:31.829506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1361-26b4-450d-bc79-b6246346e35d None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:31.856957 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:31.941653 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef1361-26b4-450d-bc79-b6246346e35d None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:31.975437 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce03e6d-6fdd-4582-b496-53e5a247b0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:31.976097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce03e6d-6fdd-4582-b496-53e5a247b0c5 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:31.976377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce03e6d-6fdd-4582-b496-53e5a247b0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:31.976649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce03e6d-6fdd-4582-b496-53e5a247b0c5 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:31.977317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce03e6d-6fdd-4582-b496-53e5a247b0c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:31.978660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce03e6d-6fdd-4582-b496-53e5a247b0c5 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:31.984991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 498/996] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Jul 19 20:35:31 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:35:32.679064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c06fb-7a31-4e41-b619-294bcc339260 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:32.679616 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c06fb-7a31-4e41-b619-294bcc339260 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:32.679696 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c06fb-7a31-4e41-b619-294bcc339260 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:32.681059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 499/997] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:32.686312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7018ed-9180-4e2f-9c5b-c1a9e9962754 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:32.686603 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7018ed-9180-4e2f-9c5b-c1a9e9962754 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:32.686881 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7018ed-9180-4e2f-9c5b-c1a9e9962754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:32.704025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-4f7018ed-9180-4e2f-9c5b-c1a9e9962754 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:32.705209 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-4f7018ed-9180-4e2f-9c5b-c1a9e9962754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:32.775412 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 499/998] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 20:35:32.798748 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c06fb-7a31-4e41-b619-294bcc339260 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:32.822672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:32.911071 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c06fb-7a31-4e41-b619-294bcc339260 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:32.945717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548287d-ca9d-45f8-9ae1-ddd173fa7d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:32.946466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548287d-ca9d-45f8-9ae1-ddd173fa7d18 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:32.946749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548287d-ca9d-45f8-9ae1-ddd173fa7d18 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:32.947021 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548287d-ca9d-45f8-9ae1-ddd173fa7d18 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:32.947702 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548287d-ca9d-45f8-9ae1-ddd173fa7d18 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:32.949062 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548287d-ca9d-45f8-9ae1-ddd173fa7d18 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:32.964644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-4548287d-ca9d-45f8-9ae1-ddd173fa7d18 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 20:35:32.964644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:32.964644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:35:32.964644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:35:32.964644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:35:32.964644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:35:32.964644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:35:32.964644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:32.964644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 20:35:32.964644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:32.964644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:32.964644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:32.964644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:32.964644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:32.964644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:32.964644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:32.964644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:32.966551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:32.966551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:32.966551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:32.966551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:32.966551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:32.966551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:32.966551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:35:32.966551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:35:32.966551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:35:32.966551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:35:32.966551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:32.966551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:32.966551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:32.966551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:32.966551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:32.966551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:32.967949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:32.967949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:32.967949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:32.967949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:32.967949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:32.967949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:32.967949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:32.967949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:32.967949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:32.967949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:32.967949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:35:32.967949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:32.967949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 20:35:32.967949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:32.967949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 500/999] 10.222.0.77 () {56 vars in 1126 bytes} [Tue Jul 19 20:35:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:32.973413 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7018ed-9180-4e2f-9c5b-c1a9e9962754 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:32.993896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:33.085646 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7018ed-9180-4e2f-9c5b-c1a9e9962754 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:33.121593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422d666-42f2-4c23-8afb-69ccc00d1d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:33.122255 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422d666-42f2-4c23-8afb-69ccc00d1d6d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:33.122532 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422d666-42f2-4c23-8afb-69ccc00d1d6d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:33.122803 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0422d666-42f2-4c23-8afb-69ccc00d1d6d None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:33.123520 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422d666-42f2-4c23-8afb-69ccc00d1d6d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:33.123824 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422d666-42f2-4c23-8afb-69ccc00d1d6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:33.125176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0422d666-42f2-4c23-8afb-69ccc00d1d6d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:33.135117 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 500/1000] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Jul 19 20:35:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:33.136339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548287d-ca9d-45f8-9ae1-ddd173fa7d18 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:33.221610 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:33.238692 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548287d-ca9d-45f8-9ae1-ddd173fa7d18 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:33.272568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2599c-a25b-4822-8372-206e1cf92d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:33.273230 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2599c-a25b-4822-8372-206e1cf92d6a None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:33.273511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2599c-a25b-4822-8372-206e1cf92d6a None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:33.273781 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2599c-a25b-4822-8372-206e1cf92d6a None admin] PATH_INFO: `/v3/services` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:33.274476 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2599c-a25b-4822-8372-206e1cf92d6a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:33.274776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2599c-a25b-4822-8372-206e1cf92d6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:33.276197 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2599c-a25b-4822-8372-206e1cf92d6a None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:33.285853 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 501/1001] 10.222.0.77 () {56 vars in 1122 bytes} [Tue Jul 19 20:35:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:33.288307 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422d666-42f2-4c23-8afb-69ccc00d1d6d None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:33.372488 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:33.393028 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0422d666-42f2-4c23-8afb-69ccc00d1d6d None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:33.426776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdeceac-6d09-4a94-bae0-ad6232bb7ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:33.427995 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeceac-6d09-4a94-bae0-ad6232bb7ada None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:33.428276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeceac-6d09-4a94-bae0-ad6232bb7ada None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:33.428550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdeceac-6d09-4a94-bae0-ad6232bb7ada None admin] PATH_INFO: `/v3/endpoints` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:33.429299 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdeceac-6d09-4a94-bae0-ad6232bb7ada None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:33.430651 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdeceac-6d09-4a94-bae0-ad6232bb7ada None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:33.451659 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 501/1002] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Jul 19 20:35:33 2022] POST /identity/v3/endpoints => generated 325 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:35:33.682792 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf325d-485b-4e1e-8254-b3e05f42a6e3 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:33.683327 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf325d-485b-4e1e-8254-b3e05f42a6e3 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:33.683327 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf325d-485b-4e1e-8254-b3e05f42a6e3 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:33.684673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 502/1003] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:33.690060 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac39d63-6368-4043-8419-9aa169fbfe46 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:33.690358 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac39d63-6368-4043-8419-9aa169fbfe46 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:33.690640 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac39d63-6368-4043-8419-9aa169fbfe46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:33.708587 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-0ac39d63-6368-4043-8419-9aa169fbfe46 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:33.709775 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-0ac39d63-6368-4043-8419-9aa169fbfe46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:33.785180 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 502/1004] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:33.808176 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf325d-485b-4e1e-8254-b3e05f42a6e3 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:33.916524 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf325d-485b-4e1e-8254-b3e05f42a6e3 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:33.951687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242cb3b-fe9c-4859-ac5a-ee2dd7258024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:33.952862 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242cb3b-fe9c-4859-ac5a-ee2dd7258024 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:33.953356 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242cb3b-fe9c-4859-ac5a-ee2dd7258024 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:33.953850 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242cb3b-fe9c-4859-ac5a-ee2dd7258024 None admin] PATH_INFO: `/v3/services/image` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:33.954716 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242cb3b-fe9c-4859-ac5a-ee2dd7258024 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:33.956318 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242cb3b-fe9c-4859-ac5a-ee2dd7258024 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:33.969253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-a242cb3b-fe9c-4859-ac5a-ee2dd7258024 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 20:35:33.969253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:33.969253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:35:33.969253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:35:33.969253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:35:33.969253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:35:33.969253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:35:33.969253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:33.969253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 20:35:33.969253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:33.969253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:33.969253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:33.969253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:33.969253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:33.969253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:33.969253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:33.969253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:33.970259 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:33.970259 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:33.970259 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:33.970259 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:33.970259 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:33.970259 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:33.970259 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:35:33.970259 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:35:33.970259 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:35:33.970259 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:35:33.970259 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:33.970259 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:33.970259 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:33.970259 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:33.970259 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:33.970259 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:33.971153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:33.971153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:33.971153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:33.971153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:33.971153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:33.971153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:33.971153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:33.971153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:33.971153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:33.971153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:33.971153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:35:33.971153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:33.971153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 20:35:33.971153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:33.977478 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 503/1005] 10.222.0.77 () {56 vars in 1105 bytes} [Tue Jul 19 20:35:33 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:33.977994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac39d63-6368-4043-8419-9aa169fbfe46 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:34.027549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d936653-d466-4ffe-aaf7-09e62400a644 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:34.027894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d936653-d466-4ffe-aaf7-09e62400a644 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:34.028107 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d936653-d466-4ffe-aaf7-09e62400a644 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:34.029605 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 504/1006] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:35:34.034178 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407cb6a-53be-426a-a9fa-8b54e0e3719e None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:34.034460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407cb6a-53be-426a-a9fa-8b54e0e3719e None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:34.034732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407cb6a-53be-426a-a9fa-8b54e0e3719e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:34.049227 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:34.053043 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-b407cb6a-53be-426a-a9fa-8b54e0e3719e None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:34.054234 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b407cb6a-53be-426a-a9fa-8b54e0e3719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:34.062065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:34.089961 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac39d63-6368-4043-8419-9aa169fbfe46 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:34.126560 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 505/1007] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:34 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 20:35:34.126990 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b74f9-34ec-45ff-95d9-1308009b35ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:34.127692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b74f9-34ec-45ff-95d9-1308009b35ea None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:34.127979 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b74f9-34ec-45ff-95d9-1308009b35ea None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:34.128255 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b74f9-34ec-45ff-95d9-1308009b35ea None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:34.128968 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b74f9-34ec-45ff-95d9-1308009b35ea None admin] RBAC: Adding query filter params (name=image) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:34.129274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b74f9-34ec-45ff-95d9-1308009b35ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:34.130701 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b74f9-34ec-45ff-95d9-1308009b35ea None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:34.143308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 503/1008] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:34.145085 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407cb6a-53be-426a-a9fa-8b54e0e3719e None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:34.149872 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b74f9-34ec-45ff-95d9-1308009b35ea None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:34.249957 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407cb6a-53be-426a-a9fa-8b54e0e3719e None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:34.251582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b74f9-34ec-45ff-95d9-1308009b35ea None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:34.281312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:34.285782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552fcbd-3ec4-4926-94a2-db5d71649581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:34.287050 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552fcbd-3ec4-4926-94a2-db5d71649581 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:34.287620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552fcbd-3ec4-4926-94a2-db5d71649581 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:34.287924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8354e1e-afaf-45cb-b176-f6dff2598dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:34.288341 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a552fcbd-3ec4-4926-94a2-db5d71649581 None admin] PATH_INFO: `/v3/services` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:34.288716 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8354e1e-afaf-45cb-b176-f6dff2598dec None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:34.288991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8354e1e-afaf-45cb-b176-f6dff2598dec None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:34.289260 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8354e1e-afaf-45cb-b176-f6dff2598dec None admin] PATH_INFO: `/v3/services/compute` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:34.289871 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552fcbd-3ec4-4926-94a2-db5d71649581 None admin] RBAC: Adding query filter params (type=image) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:34.289989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8354e1e-afaf-45cb-b176-f6dff2598dec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:34.290542 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552fcbd-3ec4-4926-94a2-db5d71649581 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:34.291243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8354e1e-afaf-45cb-b176-f6dff2598dec None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:34.292360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a552fcbd-3ec4-4926-94a2-db5d71649581 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:34.297569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 506/1009] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:34 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:34.304120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-e8354e1e-afaf-45cb-b176-f6dff2598dec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 20:35:34.304120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:34.304120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:35:34.304120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:35:34.304120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:35:34.304120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:35:34.304120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:35:34.304120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:34.304120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 20:35:34.304120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:34.304120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:34.304120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:34.304120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:34.304120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:34.304120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:34.304120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:34.304120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:34.305191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:34.305191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:34.305191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:34.305191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:34.305191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:34.305191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:34.305191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:35:34.305191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:35:34.305191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:35:34.305191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:35:34.305191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:34.305191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:34.305191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:34.305191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:34.305191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:34.305191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:34.308332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:34.308332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:34.308332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:34.308332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:34.308332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:34.308332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:34.308332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:34.308332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:34.308332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:34.308332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:34.308332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:35:34.308332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:34.308332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 20:35:34.308332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:34.308332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 504/1010] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:35:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:34.311686 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552fcbd-3ec4-4926-94a2-db5d71649581 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:34.321347 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:34.431711 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a552fcbd-3ec4-4926-94a2-db5d71649581 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:34.469408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033b6cf-ec72-4f5c-a028-3a3fddb0708d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:34.470083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033b6cf-ec72-4f5c-a028-3a3fddb0708d None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:34.470361 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033b6cf-ec72-4f5c-a028-3a3fddb0708d None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:34.470634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033b6cf-ec72-4f5c-a028-3a3fddb0708d None admin] PATH_INFO: `/v3/services` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:34.471368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033b6cf-ec72-4f5c-a028-3a3fddb0708d None admin] RBAC: Adding query filter params (name=compute) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:34.471674 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033b6cf-ec72-4f5c-a028-3a3fddb0708d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:34.473024 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033b6cf-ec72-4f5c-a028-3a3fddb0708d None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:34.478304 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 507/1011] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jul 19 20:35:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:34.484688 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8354e1e-afaf-45cb-b176-f6dff2598dec None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:34.589212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8354e1e-afaf-45cb-b176-f6dff2598dec None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:34.622982 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce30e7b-524f-4945-9f76-84c2b43cd55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:34.623682 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce30e7b-524f-4945-9f76-84c2b43cd55e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:34.623963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce30e7b-524f-4945-9f76-84c2b43cd55e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:34.624235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce30e7b-524f-4945-9f76-84c2b43cd55e None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:34.624941 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce30e7b-524f-4945-9f76-84c2b43cd55e None admin] RBAC: Adding query filter params (type=compute) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:34.625246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce30e7b-524f-4945-9f76-84c2b43cd55e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:34.626600 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce30e7b-524f-4945-9f76-84c2b43cd55e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:34.636834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 505/1012] 10.222.0.77 () {56 vars in 1112 bytes} [Tue Jul 19 20:35:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:34.637900 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033b6cf-ec72-4f5c-a028-3a3fddb0708d None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:34.712981 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:34.753435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033b6cf-ec72-4f5c-a028-3a3fddb0708d None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:34.790211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167e8c7-4d0c-462b-9f3a-13c1a2b4e10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:34.790211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167e8c7-4d0c-462b-9f3a-13c1a2b4e10c None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:34.790211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167e8c7-4d0c-462b-9f3a-13c1a2b4e10c None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:34.790211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167e8c7-4d0c-462b-9f3a-13c1a2b4e10c None admin] PATH_INFO: `/v3/endpoints` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:34.790840 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167e8c7-4d0c-462b-9f3a-13c1a2b4e10c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:34.792215 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167e8c7-4d0c-462b-9f3a-13c1a2b4e10c None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:34.815340 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 508/1013] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Jul 19 20:35:34 2022] POST /identity/v3/endpoints => generated 334 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:35:35.526330 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f1f63-bdc8-4ad8-8b0c-f8a90f70f87c None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:35.526854 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f1f63-bdc8-4ad8-8b0c-f8a90f70f87c None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:35.526854 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f1f63-bdc8-4ad8-8b0c-f8a90f70f87c None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:35.528287 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 506/1014] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:35.533367 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e6ee5-3cb0-41c9-8b6c-53e886615d3c None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:35.533665 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e6ee5-3cb0-41c9-8b6c-53e886615d3c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:35.533945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e6ee5-3cb0-41c9-8b6c-53e886615d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:35.551632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-6b4e6ee5-3cb0-41c9-8b6c-53e886615d3c None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:35.552861 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-6b4e6ee5-3cb0-41c9-8b6c-53e886615d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:35.625556 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 509/1015] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:35 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:35.648962 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f1f63-bdc8-4ad8-8b0c-f8a90f70f87c None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:35.709571 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:35.753252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f1f63-bdc8-4ad8-8b0c-f8a90f70f87c None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:35.787048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fc4f5-f272-4264-86bb-839e264317c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:35.787806 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fc4f5-f272-4264-86bb-839e264317c9 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:35.788089 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fc4f5-f272-4264-86bb-839e264317c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:35.788359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fc4f5-f272-4264-86bb-839e264317c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:35.789543 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fc4f5-f272-4264-86bb-839e264317c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:35.790959 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fc4f5-f272-4264-86bb-839e264317c9 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:35.792825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 507/1016] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:35.798472 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e6ee5-3cb0-41c9-8b6c-53e886615d3c None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:35.852060 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:35.909185 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e6ee5-3cb0-41c9-8b6c-53e886615d3c None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:35.944141 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b018376-a35d-4eaf-a85c-d91d36101b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:35.945107 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b018376-a35d-4eaf-a85c-d91d36101b8d None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:35.945602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b018376-a35d-4eaf-a85c-d91d36101b8d None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:35.946067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b018376-a35d-4eaf-a85c-d91d36101b8d None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:35.946985 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b018376-a35d-4eaf-a85c-d91d36101b8d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:35.948611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b018376-a35d-4eaf-a85c-d91d36101b8d None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:35.975442 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 510/1017] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jul 19 20:35:35 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:35:36.394514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bdfd0-e088-4f58-b89a-cd100211ab94 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:36.394817 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bdfd0-e088-4f58-b89a-cd100211ab94 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:36.395225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bdfd0-e088-4f58-b89a-cd100211ab94 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:36.397172 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 508/1018] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:36.402444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f461e43-48dc-4212-85d6-b6ca7480c179 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:36.402739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f461e43-48dc-4212-85d6-b6ca7480c179 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:36.403018 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f461e43-48dc-4212-85d6-b6ca7480c179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:36.421214 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-5f461e43-48dc-4212-85d6-b6ca7480c179 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:36.422465 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-5f461e43-48dc-4212-85d6-b6ca7480c179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:36.492922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 511/1019] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:36 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 20:35:36.515526 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bdfd0-e088-4f58-b89a-cd100211ab94 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:36.622943 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bdfd0-e088-4f58-b89a-cd100211ab94 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:36.649473 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:36.658608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de658d14-0820-4ad9-9372-3c9baa708958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:36.659283 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de658d14-0820-4ad9-9372-3c9baa708958 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:36.659574 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de658d14-0820-4ad9-9372-3c9baa708958 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:36.659849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de658d14-0820-4ad9-9372-3c9baa708958 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:36.660579 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de658d14-0820-4ad9-9372-3c9baa708958 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:36.662709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de658d14-0820-4ad9-9372-3c9baa708958 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:36.676162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 509/1020] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jul 19 20:35:36 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:35:36.971452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a8890-2260-45d4-9c2a-5cbd02965621 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:36.971983 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a8890-2260-45d4-9c2a-5cbd02965621 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:36.972071 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a8890-2260-45d4-9c2a-5cbd02965621 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:36.973519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 512/1021] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:36.978670 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa345c3-99a8-4ace-98e9-1b4fff26704a None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:36.978966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa345c3-99a8-4ace-98e9-1b4fff26704a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:36.979247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa345c3-99a8-4ace-98e9-1b4fff26704a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:36.996542 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-1fa345c3-99a8-4ace-98e9-1b4fff26704a None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:36.997733 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-1fa345c3-99a8-4ace-98e9-1b4fff26704a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:37.073008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 510/1022] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:37.096156 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a8890-2260-45d4-9c2a-5cbd02965621 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:37.134290 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:37.205030 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a8890-2260-45d4-9c2a-5cbd02965621 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:37.238199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c45ea-60fe-4ce0-b5b4-f0d9b65f6cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:37.238923 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c45ea-60fe-4ce0-b5b4-f0d9b65f6cb2 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:37.239206 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c45ea-60fe-4ce0-b5b4-f0d9b65f6cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:37.240034 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c45ea-60fe-4ce0-b5b4-f0d9b65f6cb2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:37.249887 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c45ea-60fe-4ce0-b5b4-f0d9b65f6cb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:35:37.258729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-2c6c45ea-60fe-4ce0-b5b4-f0d9b65f6cb2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 20:35:37.258729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:37.258729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:37.258729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:37.258729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:37.258729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:37.258729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:37.258729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:37.258729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:37.258729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:37.258729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:37.258729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:37.258729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:35:37.258729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:35:37.258729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:35:37.258729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:35:37.259698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:35:37.259698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:35:37.259698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:35:37.259698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:35:37.259698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:37.259698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:37.259698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:37.259698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:37.259698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:37.259698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:37.259698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:37.259698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:37.259698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:37.259698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:37.259698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:37.259698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:37.260564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:37.260564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:37.260564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:37.260564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:37.260564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:35:37.260564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:35:37.260564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:35:37.260564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:35:37.260564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:35:37.260564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:35:37.260564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 20:35:37.260564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:37.260564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 513/1023] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Jul 19 20:35:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:37.267321 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa345c3-99a8-4ace-98e9-1b4fff26704a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:37.365022 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa345c3-99a8-4ace-98e9-1b4fff26704a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:37.378853 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:37.400541 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c81ab-39a6-458b-9796-259356235964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:37.401217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c81ab-39a6-458b-9796-259356235964 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:37.401498 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c81ab-39a6-458b-9796-259356235964 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:37.401770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c81ab-39a6-458b-9796-259356235964 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:37.402505 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c81ab-39a6-458b-9796-259356235964 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:37.402806 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c81ab-39a6-458b-9796-259356235964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:37.404183 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c81ab-39a6-458b-9796-259356235964 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:37.413827 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 511/1024] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Jul 19 20:35:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:37.419301 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c45ea-60fe-4ce0-b5b4-f0d9b65f6cb2 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:37.512158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:37.520022 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c45ea-60fe-4ce0-b5b4-f0d9b65f6cb2 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:37.554215 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f1fa6-8580-4595-983f-096f90f18fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:37.555058 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f1fa6-8580-4595-983f-096f90f18fb4 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:37.555370 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f1fa6-8580-4595-983f-096f90f18fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:37.555644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f1fa6-8580-4595-983f-096f90f18fb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:37.566260 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f1fa6-8580-4595-983f-096f90f18fb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:37.568231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f1fa6-8580-4595-983f-096f90f18fb4 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:37.585545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-f06f1fa6-8580-4595-983f-096f90f18fb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:37.585545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:37.585545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:37.585545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:37.585545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:37.585545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:37.585545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:37.585545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:37.585545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:37.585545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:37.585545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:37.585545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:37.585545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:37.585545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:37.585545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:37.586477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:37.586477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:37.586477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:37.586477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:37.586477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:37.586477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:37.586477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:37.586477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:37.586477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:37.586477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:37.586477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:37.586477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:37.586477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:37.586477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:37.586477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:37.586477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:37.586477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:37.587440 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:37.587440 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:37.587440 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:37.587440 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:37.592837 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 514/1025] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:37.592967 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c81ab-39a6-458b-9796-259356235964 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:37.697029 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c81ab-39a6-458b-9796-259356235964 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:37.734717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b736e2-0f68-4799-972d-b4255b043b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:37.735730 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b736e2-0f68-4799-972d-b4255b043b0a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:37.736178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b736e2-0f68-4799-972d-b4255b043b0a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:37.736630 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b736e2-0f68-4799-972d-b4255b043b0a None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:37.737501 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b736e2-0f68-4799-972d-b4255b043b0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:37.738049 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b736e2-0f68-4799-972d-b4255b043b0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:37.740115 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b736e2-0f68-4799-972d-b4255b043b0a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:37.752875 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 512/1026] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:37.758926 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f1fa6-8580-4595-983f-096f90f18fb4 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:37.862506 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f1fa6-8580-4595-983f-096f90f18fb4 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:37.903623 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de27f10-343f-4d9b-9668-7fb8f0dc8794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:37.904436 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de27f10-343f-4d9b-9668-7fb8f0dc8794 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:37.904722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de27f10-343f-4d9b-9668-7fb8f0dc8794 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:37.905001 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de27f10-343f-4d9b-9668-7fb8f0dc8794 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:37.913412 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de27f10-343f-4d9b-9668-7fb8f0dc8794 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:37.914851 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de27f10-343f-4d9b-9668-7fb8f0dc8794 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:37.929826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-0de27f10-343f-4d9b-9668-7fb8f0dc8794 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 20:35:37.929826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:37.929826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:37.929826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:37.929826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:37.929826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:37.929826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:37.929826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:37.929826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:37.929826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:37.929826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:37.929826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:37.929826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:35:37.929826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:35:37.929826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:35:37.929826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:35:37.930799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:37.930799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:37.930799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:35:37.930799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:37.930799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:35:37.930799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:37.930799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:37.930799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:37.930799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:37.930799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:37.930799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:37.930799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:37.930799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:37.930799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:37.930799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:37.930799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:37.930799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:37.930799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:37.931796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:37.931796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:37.931796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:35:37.931796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:35:37.931796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:35:37.931796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:35:37.931796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:35:37.931796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:35:37.931796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 20:35:37.931796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:37.931796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 515/1027] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Jul 19 20:35:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:37.938517 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b736e2-0f68-4799-972d-b4255b043b0a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:37.974748 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:38.040905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b736e2-0f68-4799-972d-b4255b043b0a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:38.049632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15b257-2c3c-40e0-a912-70025da273ce None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:38.050116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15b257-2c3c-40e0-a912-70025da273ce None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:38.050197 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15b257-2c3c-40e0-a912-70025da273ce None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:38.051728 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 516/1028] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:35:38.057213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd02ab-4bef-4f6f-88ea-5c639d831d7b None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:38.057504 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd02ab-4bef-4f6f-88ea-5c639d831d7b None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:38.057783 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd02ab-4bef-4f6f-88ea-5c639d831d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:38.070481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:38.076533 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-2fcd02ab-4bef-4f6f-88ea-5c639d831d7b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:38.077738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-2fcd02ab-4bef-4f6f-88ea-5c639d831d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:38.079551 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b69cd-2d8c-42e7-a7b3-ae50b9e69018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:38.080430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b69cd-2d8c-42e7-a7b3-ae50b9e69018 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:38.081552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b69cd-2d8c-42e7-a7b3-ae50b9e69018 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:38.081844 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b69cd-2d8c-42e7-a7b3-ae50b9e69018 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:38.082935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b69cd-2d8c-42e7-a7b3-ae50b9e69018 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:38.083117 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b69cd-2d8c-42e7-a7b3-ae50b9e69018 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:38.084615 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b69cd-2d8c-42e7-a7b3-ae50b9e69018 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:38.104535 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 513/1029] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Jul 19 20:35:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:38.110915 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b69cd-2d8c-42e7-a7b3-ae50b9e69018 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:38.156296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 517/1030] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:38.181699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd02ab-4bef-4f6f-88ea-5c639d831d7b None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:38.208018 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:38.215613 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b69cd-2d8c-42e7-a7b3-ae50b9e69018 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:38.254293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8e29b-4a7a-4df1-a161-bf01602c34d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:38.254943 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8e29b-4a7a-4df1-a161-bf01602c34d8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:38.255279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8e29b-4a7a-4df1-a161-bf01602c34d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:38.255566 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be8e29b-4a7a-4df1-a161-bf01602c34d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:38.287817 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd02ab-4bef-4f6f-88ea-5c639d831d7b None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:38.327879 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8e29b-4a7a-4df1-a161-bf01602c34d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:38.329581 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be8e29b-4a7a-4df1-a161-bf01602c34d8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:38.329876 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28490d4f-f3ba-4750-be0b-7f11c8144e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:38.330690 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28490d4f-f3ba-4750-be0b-7f11c8144e58 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:38.330979 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28490d4f-f3ba-4750-be0b-7f11c8144e58 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:38.331548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28490d4f-f3ba-4750-be0b-7f11c8144e58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:38.334154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28490d4f-f3ba-4750-be0b-7f11c8144e58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:38.335651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28490d4f-f3ba-4750-be0b-7f11c8144e58 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:38.339557 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 518/1031] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:38.342900 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28490d4f-f3ba-4750-be0b-7f11c8144e58 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:38.347204 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:38.442086 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:38.451059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 514/1032] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:35:38 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 20:35:38.452242 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28490d4f-f3ba-4750-be0b-7f11c8144e58 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:38.457094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8e29b-4a7a-4df1-a161-bf01602c34d8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:38.492636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe52b74-9a23-4694-8d77-309ee5e0cf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:38.493422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe52b74-9a23-4694-8d77-309ee5e0cf68 None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:38.493698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe52b74-9a23-4694-8d77-309ee5e0cf68 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:38.494592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe52b74-9a23-4694-8d77-309ee5e0cf68 None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:38.494706 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe52b74-9a23-4694-8d77-309ee5e0cf68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:38.496097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe52b74-9a23-4694-8d77-309ee5e0cf68 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:38.519188 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 519/1033] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jul 19 20:35:38 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:35:38.569384 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be8e29b-4a7a-4df1-a161-bf01602c34d8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:38.609164 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b478b-79e2-462a-8cc1-66fb2a5eecb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:38.609978 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b478b-79e2-462a-8cc1-66fb2a5eecb7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:38.610259 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b478b-79e2-462a-8cc1-66fb2a5eecb7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:38.610534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b478b-79e2-462a-8cc1-66fb2a5eecb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:38.622473 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b478b-79e2-462a-8cc1-66fb2a5eecb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:38.623978 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b478b-79e2-462a-8cc1-66fb2a5eecb7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:38.643116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-bf6b478b-79e2-462a-8cc1-66fb2a5eecb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:38.643116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:38.643116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:38.643116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:38.643116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:38.643116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:38.643116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:38.643116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:38.643116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:38.643116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:38.643116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:38.643116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:38.643116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:38.643116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:38.643116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:38.644150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:38.644150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:38.644150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:38.644150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:38.644150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:38.644150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:38.644150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:38.644150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:38.644150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:38.644150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:38.644150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:38.644150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:38.644150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:38.644150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:38.644150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:38.644150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:38.644150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:38.645074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:38.645074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:38.645074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:38.645074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:38.645074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 515/1034] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:38.650711 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe52b74-9a23-4694-8d77-309ee5e0cf68 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:38.713861 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:38.759941 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af9a4f-d528-48a7-a715-33ea64396eb9 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:38.760461 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af9a4f-d528-48a7-a715-33ea64396eb9 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:38.760572 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe52b74-9a23-4694-8d77-309ee5e0cf68 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:38.760813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af9a4f-d528-48a7-a715-33ea64396eb9 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:38.762191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 516/1035] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:38.768795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19e986-287c-4554-90ca-90002529df27 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:38.769082 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19e986-287c-4554-90ca-90002529df27 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:38.769350 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19e986-287c-4554-90ca-90002529df27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:38.788273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-9e19e986-287c-4554-90ca-90002529df27 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:38.789704 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-9e19e986-287c-4554-90ca-90002529df27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:38.806005 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d5164-1f10-42ce-b91c-931ff10edfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:38.806657 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d5164-1f10-42ce-b91c-931ff10edfbd None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:38.806945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d5164-1f10-42ce-b91c-931ff10edfbd None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:38.807250 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d5164-1f10-42ce-b91c-931ff10edfbd None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:38.808229 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d5164-1f10-42ce-b91c-931ff10edfbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:38.808541 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d5164-1f10-42ce-b91c-931ff10edfbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:38.809957 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d5164-1f10-42ce-b91c-931ff10edfbd None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:38.824106 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 520/1036] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:38.829527 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d5164-1f10-42ce-b91c-931ff10edfbd None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:38.842022 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:38.868725 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 517/1037] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 20:35:38.891894 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19e986-287c-4554-90ca-90002529df27 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:38.947192 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d5164-1f10-42ce-b91c-931ff10edfbd None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:38.969352 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:38.985235 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9460d-7762-4c28-a76f-22a0b09f72bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:38.986031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9460d-7762-4c28-a76f-22a0b09f72bf None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:38.986320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9460d-7762-4c28-a76f-22a0b09f72bf None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:38.986601 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9460d-7762-4c28-a76f-22a0b09f72bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:38.993923 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9460d-7762-4c28-a76f-22a0b09f72bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:38.995506 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9460d-7762-4c28-a76f-22a0b09f72bf None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:38.996954 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19e986-287c-4554-90ca-90002529df27 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:39.011026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-37f9460d-7762-4c28-a76f-22a0b09f72bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:39.011026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:39.011026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:39.011026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:39.011026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:39.011026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:39.011026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:39.011026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:39.011026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:39.011026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:39.011026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:39.011026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:39.011026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:35:39.011026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:35:39.011026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:35:39.012036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:35:39.012036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:39.012036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:39.012036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:39.012036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:39.012036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:39.012036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:39.012036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:39.012036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:39.012036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:39.012036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:39.012036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:39.012036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:39.012036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:39.012036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:39.012036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:39.012036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:39.017749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:35:39.017749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:35:39.017749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:35:39.017749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:35:39.017749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:35:39.017749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:35:39.017749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:39.017749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:39.017749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 521/1038] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:35:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:39.018322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9460d-7762-4c28-a76f-22a0b09f72bf None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:39.033327 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff30895-eb2b-473a-af91-10e32f295bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:39.034174 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff30895-eb2b-473a-af91-10e32f295bbd None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:39.034461 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff30895-eb2b-473a-af91-10e32f295bbd None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:39.034737 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff30895-eb2b-473a-af91-10e32f295bbd None admin] PATH_INFO: `/v3/services/image` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:39.035435 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff30895-eb2b-473a-af91-10e32f295bbd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:39.037119 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff30895-eb2b-473a-af91-10e32f295bbd None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:39.048910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-dff30895-eb2b-473a-af91-10e32f295bbd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 20:35:39.048910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:39.048910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:35:39.048910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:35:39.048910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:35:39.048910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:35:39.048910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:35:39.048910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:39.048910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 20:35:39.048910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:39.048910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:39.048910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:39.048910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:39.048910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:39.048910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:39.048910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:39.048910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:39.049973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:39.049973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:39.049973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:39.049973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:39.049973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:39.049973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:39.049973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:35:39.049973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:35:39.049973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:35:39.049973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:35:39.049973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:39.049973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:39.049973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:39.049973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:39.049973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:39.049973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:39.050836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:39.050836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:39.050836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:39.050836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:39.050836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:39.050836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:39.050836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:39.050836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:39.050836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:39.050836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:39.050836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:35:39.050836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:39.050836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 20:35:39.050836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:39.050836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 518/1039] 10.222.0.77 () {56 vars in 1105 bytes} [Tue Jul 19 20:35:38 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:39.056076 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff30895-eb2b-473a-af91-10e32f295bbd None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:39.101393 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:39.147582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9460d-7762-4c28-a76f-22a0b09f72bf None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:39.171648 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff30895-eb2b-473a-af91-10e32f295bbd None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:39.185540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee2062-590f-49a4-835c-7e3516550622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:39.186179 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee2062-590f-49a4-835c-7e3516550622 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:39.186460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee2062-590f-49a4-835c-7e3516550622 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:39.186737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee2062-590f-49a4-835c-7e3516550622 None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:39.187555 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee2062-590f-49a4-835c-7e3516550622 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:39.187974 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee2062-590f-49a4-835c-7e3516550622 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:39.189502 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee2062-590f-49a4-835c-7e3516550622 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:39.209053 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 522/1040] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:35:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:39.209214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211a53c-eed8-41ce-a2b8-e993444e5825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:39.209214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211a53c-eed8-41ce-a2b8-e993444e5825 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:39.209214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211a53c-eed8-41ce-a2b8-e993444e5825 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:39.209214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211a53c-eed8-41ce-a2b8-e993444e5825 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:39.209538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211a53c-eed8-41ce-a2b8-e993444e5825 None admin] RBAC: Adding query filter params (name=image) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:39.209538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211a53c-eed8-41ce-a2b8-e993444e5825 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:39.210074 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee2062-590f-49a4-835c-7e3516550622 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:39.210329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211a53c-eed8-41ce-a2b8-e993444e5825 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:39.219936 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 519/1041] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:39.220897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211a53c-eed8-41ce-a2b8-e993444e5825 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:39.255966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:39.321813 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee2062-590f-49a4-835c-7e3516550622 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:39.325109 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211a53c-eed8-41ce-a2b8-e993444e5825 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:39.328312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:39.360885 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ef7c2-eeb0-4c42-8fd7-dd4cd3501a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:39.361603 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44d9de-8133-488c-aa73-8c6de039fc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:39.361730 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ef7c2-eeb0-4c42-8fd7-dd4cd3501a3c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:39.361978 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ef7c2-eeb0-4c42-8fd7-dd4cd3501a3c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:39.362254 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ef7c2-eeb0-4c42-8fd7-dd4cd3501a3c None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:39.362364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44d9de-8133-488c-aa73-8c6de039fc0e None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:39.362535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44d9de-8133-488c-aa73-8c6de039fc0e None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:39.362801 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44d9de-8133-488c-aa73-8c6de039fc0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:39.362960 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ef7c2-eeb0-4c42-8fd7-dd4cd3501a3c None admin] RBAC: Adding query filter params (type=image) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:39.363289 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ef7c2-eeb0-4c42-8fd7-dd4cd3501a3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:39.363662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44d9de-8133-488c-aa73-8c6de039fc0e None admin] RBAC: Adding query filter params (role.id=8f8d721df639446bb89673cc687829e3, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=6dbbb8f7b3f2449fb9c64ca3815b6c1b) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:39.363973 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44d9de-8133-488c-aa73-8c6de039fc0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:39.365182 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ef7c2-eeb0-4c42-8fd7-dd4cd3501a3c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:39.365910 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44d9de-8133-488c-aa73-8c6de039fc0e None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:39.370339 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 520/1042] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:39.374437 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 523/1043] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:35:39 2022] GET /identity/v3/role_assignments?user.id=6dbbb8f7b3f2449fb9c64ca3815b6c1b&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=8f8d721df639446bb89673cc687829e3 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:39.376144 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ef7c2-eeb0-4c42-8fd7-dd4cd3501a3c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:39.485884 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ef7c2-eeb0-4c42-8fd7-dd4cd3501a3c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:39.524580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c4697-f5e0-4fb4-bb96-86121043dfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:39.525260 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c4697-f5e0-4fb4-bb96-86121043dfa4 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:39.525542 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c4697-f5e0-4fb4-bb96-86121043dfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:39.525817 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c4697-f5e0-4fb4-bb96-86121043dfa4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:39.526617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c4697-f5e0-4fb4-bb96-86121043dfa4 None admin] RBAC: Adding query filter params (interface=public, service_id=f5389012a1224bcca5eca60341acd7a9, region_id=RegionOne) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:39.526929 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c4697-f5e0-4fb4-bb96-86121043dfa4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:39.528398 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c4697-f5e0-4fb4-bb96-86121043dfa4 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:39.540039 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 521/1044] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Jul 19 20:35:39 2022] GET /identity/v3/endpoints?service_id=f5389012a1224bcca5eca60341acd7a9&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:39.541643 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44d9de-8133-488c-aa73-8c6de039fc0e None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:39.648406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44d9de-8133-488c-aa73-8c6de039fc0e None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:39.650744 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:39.683574 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58998b85-6f10-4fa5-8d98-5421c39265eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:39.684251 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58998b85-6f10-4fa5-8d98-5421c39265eb None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:39.684531 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58998b85-6f10-4fa5-8d98-5421c39265eb None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:39.684805 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58998b85-6f10-4fa5-8d98-5421c39265eb None admin] PATH_INFO: `/v3/services` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:39.685484 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58998b85-6f10-4fa5-8d98-5421c39265eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:39.686844 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58998b85-6f10-4fa5-8d98-5421c39265eb None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:39.700147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 524/1045] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Jul 19 20:35:39 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:35:40.658390 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3febff1-5373-4cbc-b2c1-f553139dbb2a None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:40.658917 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3febff1-5373-4cbc-b2c1-f553139dbb2a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:40.658917 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3febff1-5373-4cbc-b2c1-f553139dbb2a None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:40.660483 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 522/1046] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:40.665804 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095df96-32de-4c80-b6bb-ec502e4c42f5 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:40.666186 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095df96-32de-4c80-b6bb-ec502e4c42f5 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:40.666378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095df96-32de-4c80-b6bb-ec502e4c42f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:40.683474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-3095df96-32de-4c80-b6bb-ec502e4c42f5 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:40.684662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-3095df96-32de-4c80-b6bb-ec502e4c42f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:40.756705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 525/1047] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:40.779514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3febff1-5373-4cbc-b2c1-f553139dbb2a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:40.814354 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:40.891382 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3febff1-5373-4cbc-b2c1-f553139dbb2a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:40.926698 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b03d9-42c6-48a9-bcb4-8b1eea396811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:40.927960 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b03d9-42c6-48a9-bcb4-8b1eea396811 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:40.928244 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b03d9-42c6-48a9-bcb4-8b1eea396811 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:40.928520 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b03d9-42c6-48a9-bcb4-8b1eea396811 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:40.939652 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b03d9-42c6-48a9-bcb4-8b1eea396811 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:35:40.947993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-a07b03d9-42c6-48a9-bcb4-8b1eea396811 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:35:40.947993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:40.947993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:40.947993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:40.947993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:40.947993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:40.947993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:40.947993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:40.947993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:40.947993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:40.947993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:40.947993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:40.947993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:35:40.947993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:35:40.947993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:35:40.947993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:35:40.948931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:35:40.948931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:35:40.948931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:35:40.948931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:35:40.948931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:40.948931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:40.948931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:40.948931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:40.948931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:40.948931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:40.948931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:40.948931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:40.948931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:40.948931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:40.948931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:40.948931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:40.955573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:40.955573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:40.955573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:40.955573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:40.955573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:35:40.955573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:35:40.955573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:35:40.955573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:35:40.955573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:35:40.955573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:35:40.955573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:35:40.955573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:40.955573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 523/1048] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:35:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:40.956287 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095df96-32de-4c80-b6bb-ec502e4c42f5 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:41.052888 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:41.057499 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095df96-32de-4c80-b6bb-ec502e4c42f5 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:41.092588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63d251-9e38-4f63-9a1b-d3806d1a21a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:41.093263 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63d251-9e38-4f63-9a1b-d3806d1a21a3 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:41.093549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63d251-9e38-4f63-9a1b-d3806d1a21a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:41.093827 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de63d251-9e38-4f63-9a1b-d3806d1a21a3 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:41.094577 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63d251-9e38-4f63-9a1b-d3806d1a21a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:41.094886 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63d251-9e38-4f63-9a1b-d3806d1a21a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:41.096275 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de63d251-9e38-4f63-9a1b-d3806d1a21a3 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:41.109210 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 526/1049] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:35:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:41.110386 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b03d9-42c6-48a9-bcb4-8b1eea396811 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:41.203415 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:41.213562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b03d9-42c6-48a9-bcb4-8b1eea396811 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:41.246754 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a02cc-20ec-43f7-a0bc-f68c20b4e3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:41.247651 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a02cc-20ec-43f7-a0bc-f68c20b4e3cc None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:41.247936 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a02cc-20ec-43f7-a0bc-f68c20b4e3cc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:41.248210 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a02cc-20ec-43f7-a0bc-f68c20b4e3cc None admin] PATH_INFO: `/v3/users/d2eaf62546514f3798185f0cdd022812` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:41.261867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a02cc-20ec-43f7-a0bc-f68c20b4e3cc None admin] RBAC: Authorizing `identity:get_user(user_id=d2eaf62546514f3798185f0cdd022812)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:41.263340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a02cc-20ec-43f7-a0bc-f68c20b4e3cc None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:41.265188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 524/1050] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:35:41 2022] GET /identity/v3/users/d2eaf62546514f3798185f0cdd022812 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:41.271451 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63d251-9e38-4f63-9a1b-d3806d1a21a3 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:41.373210 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de63d251-9e38-4f63-9a1b-d3806d1a21a3 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:41.407015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf27512-3a6c-4b7a-aecb-0f4c166fa97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:41.407697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf27512-3a6c-4b7a-aecb-0f4c166fa97d None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:41.407984 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf27512-3a6c-4b7a-aecb-0f4c166fa97d None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:41.408269 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf27512-3a6c-4b7a-aecb-0f4c166fa97d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:41.420640 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcb1e7-a5da-4800-ba0a-e81388664ba4 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:41.420928 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcb1e7-a5da-4800-ba0a-e81388664ba4 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:41.421209 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcb1e7-a5da-4800-ba0a-e81388664ba4 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:41.422693 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 525/1051] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:41.428008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae27b6-8779-4931-86fe-a930d4bd7fdf None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:41.428298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae27b6-8779-4931-86fe-a930d4bd7fdf None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:41.428573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae27b6-8779-4931-86fe-a930d4bd7fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:41.439340 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:41.445445 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-36ae27b6-8779-4931-86fe-a930d4bd7fdf None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:41.446644 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-36ae27b6-8779-4931-86fe-a930d4bd7fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:41.487689 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf27512-3a6c-4b7a-aecb-0f4c166fa97d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:41.489148 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf27512-3a6c-4b7a-aecb-0f4c166fa97d None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:41.543307 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 526/1052] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 20:35:41.564229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae27b6-8779-4931-86fe-a930d4bd7fdf None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:41.602540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 527/1053] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:35:41 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 20:35:41.608596 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf27512-3a6c-4b7a-aecb-0f4c166fa97d None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:41.659340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:41.669197 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:41.687276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae27b6-8779-4931-86fe-a930d4bd7fdf None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:41.713154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf27512-3a6c-4b7a-aecb-0f4c166fa97d None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:41.727894 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864f172-966f-4647-9908-cee34192ce6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:41.729080 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864f172-966f-4647-9908-cee34192ce6d None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:41.729508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864f172-966f-4647-9908-cee34192ce6d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:41.729787 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864f172-966f-4647-9908-cee34192ce6d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:41.741204 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864f172-966f-4647-9908-cee34192ce6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:35:41.748968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b758a-68aa-4c40-90eb-3d49fcd9d0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:41.749454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-6864f172-966f-4647-9908-cee34192ce6d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 20:35:41.749454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:41.749454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:41.749454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:41.749454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:41.749454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:41.749454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:41.749454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:41.749454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:41.749454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:41.749454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:41.749454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:41.749454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:35:41.749454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:35:41.749454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:35:41.749454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:35:41.750556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:35:41.750556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:35:41.750556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:35:41.750556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:35:41.750556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:41.750556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:41.750556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:41.750556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:41.750556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:41.750556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:41.750556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:41.750556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:41.750556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:41.750556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:41.750556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:41.750556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:41.751825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:41.751825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:41.751825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:41.751825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:41.751825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:35:41.751825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:35:41.751825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:35:41.751825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:35:41.751825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:35:41.751825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:35:41.751825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 20:35:41.751825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:41.752479 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b758a-68aa-4c40-90eb-3d49fcd9d0bd None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:41.752479 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b758a-68aa-4c40-90eb-3d49fcd9d0bd None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:41.752479 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b758a-68aa-4c40-90eb-3d49fcd9d0bd None admin] PATH_INFO: `/v3/projects/57998d612a404f0abed72d2e59b14298` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:41.752681 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 527/1054] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Jul 19 20:35:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:41.752681 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7396e8d-14e7-46c8-92a9-2540e858caac None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:41.752681 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7396e8d-14e7-46c8-92a9-2540e858caac None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:41.752681 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7396e8d-14e7-46c8-92a9-2540e858caac None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:41.753608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 528/1055] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:41.756233 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7396e8d-14e7-46c8-92a9-2540e858caac None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:41.756400 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b758a-68aa-4c40-90eb-3d49fcd9d0bd None admin] RBAC: Authorizing `identity:get_project(project_id=57998d612a404f0abed72d2e59b14298)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:41.757754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192b758a-68aa-4c40-90eb-3d49fcd9d0bd None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:41.759609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 528/1056] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:35:41 2022] GET /identity/v3/projects/57998d612a404f0abed72d2e59b14298 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:41.760782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab19c7-2fc5-40cf-8f64-8c88cc38c88f None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:41.761071 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab19c7-2fc5-40cf-8f64-8c88cc38c88f None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:41.761441 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab19c7-2fc5-40cf-8f64-8c88cc38c88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:41.778278 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-14ab19c7-2fc5-40cf-8f64-8c88cc38c88f None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:41.779495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-14ab19c7-2fc5-40cf-8f64-8c88cc38c88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:41.849948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 529/1057] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:41.850809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab19c7-2fc5-40cf-8f64-8c88cc38c88f None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:41.880869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7396e8d-14e7-46c8-92a9-2540e858caac None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:41.917665 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5050b8d-b1c8-4db5-acc7-5201bd47bae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:41.917877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:41.918336 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5050b8d-b1c8-4db5-acc7-5201bd47bae7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:41.918663 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5050b8d-b1c8-4db5-acc7-5201bd47bae7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:41.918894 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5050b8d-b1c8-4db5-acc7-5201bd47bae7 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:41.919857 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5050b8d-b1c8-4db5-acc7-5201bd47bae7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:41.920188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5050b8d-b1c8-4db5-acc7-5201bd47bae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:41.921542 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5050b8d-b1c8-4db5-acc7-5201bd47bae7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:41.930382 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 529/1058] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Jul 19 20:35:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:41.932213 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5050b8d-b1c8-4db5-acc7-5201bd47bae7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:41.934763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:41.960578 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab19c7-2fc5-40cf-8f64-8c88cc38c88f None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:41.993883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce9037-2a54-47dc-9fb6-ae179bf51f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:41.994470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce9037-2a54-47dc-9fb6-ae179bf51f1c None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:41.994750 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce9037-2a54-47dc-9fb6-ae179bf51f1c None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:41.995028 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce9037-2a54-47dc-9fb6-ae179bf51f1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:41.995893 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce9037-2a54-47dc-9fb6-ae179bf51f1c None admin] RBAC: Adding query filter params (role.id=b30f01ef95004a1b84fc029830bdf053, scope.project.id=57998d612a404f0abed72d2e59b14298, user.id=d2eaf62546514f3798185f0cdd022812) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:41.996206 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce9037-2a54-47dc-9fb6-ae179bf51f1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:41.997628 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce9037-2a54-47dc-9fb6-ae179bf51f1c None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:42.003004 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 530/1059] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:35:41 2022] GET /identity/v3/role_assignments?user.id=d2eaf62546514f3798185f0cdd022812&scope.project.id=57998d612a404f0abed72d2e59b14298&role.id=b30f01ef95004a1b84fc029830bdf053 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:42.003819 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce9037-2a54-47dc-9fb6-ae179bf51f1c None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:42.035816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5050b8d-b1c8-4db5-acc7-5201bd47bae7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:42.072619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de971849-60dd-4f69-9651-ea9f25af307a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:42.073435 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de971849-60dd-4f69-9651-ea9f25af307a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:42.073721 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de971849-60dd-4f69-9651-ea9f25af307a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:42.073997 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de971849-60dd-4f69-9651-ea9f25af307a None admin] PATH_INFO: `/v3/services/image` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:42.074663 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de971849-60dd-4f69-9651-ea9f25af307a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:42.076226 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de971849-60dd-4f69-9651-ea9f25af307a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:42.089193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-de971849-60dd-4f69-9651-ea9f25af307a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 20:35:42.089193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:42.089193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:35:42.089193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:35:42.089193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:35:42.089193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:35:42.089193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:35:42.089193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:42.089193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 20:35:42.089193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:42.089193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:35:42.089193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:42.089193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:42.089193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:42.089193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:42.089193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:42.089193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:42.090514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:42.090514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:42.090514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:42.090514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:42.090514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:42.090514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:42.090514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:35:42.090514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:35:42.090514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:35:42.090514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:35:42.090514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:42.090514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:42.090514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:42.090514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:42.090514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:42.090514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:42.091570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:42.091570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:42.091570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:42.091570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:42.091570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:42.091570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:42.091570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:42.091570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:42.091570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:42.091570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:42.091570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:35:42.091570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:35:42.091570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 20:35:42.091570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:42.091570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 530/1060] 10.222.0.77 () {56 vars in 1105 bytes} [Tue Jul 19 20:35:41 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:42.096637 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de971849-60dd-4f69-9651-ea9f25af307a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:42.135450 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce9037-2a54-47dc-9fb6-ae179bf51f1c None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:42.161314 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:42.174518 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f08eaf-e006-4a04-8d12-c8c272fa3cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:42.175380 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:42.175496 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f08eaf-e006-4a04-8d12-c8c272fa3cda None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:42.175780 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f08eaf-e006-4a04-8d12-c8c272fa3cda None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:42.176051 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f08eaf-e006-4a04-8d12-c8c272fa3cda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:42.187028 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f08eaf-e006-4a04-8d12-c8c272fa3cda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:42.188506 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f08eaf-e006-4a04-8d12-c8c272fa3cda None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:42.206020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-f6f08eaf-e006-4a04-8d12-c8c272fa3cda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:42.206020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:42.206020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:42.206020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:42.206020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:42.206020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:42.206020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:42.206020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:42.206020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:42.206020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:42.206020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:42.206020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:42.206020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:42.206020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:42.206020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:42.206987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:42.206987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:42.206987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:42.206987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:42.206987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:42.206987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:42.206987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:42.206987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:42.206987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:42.206987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:42.206987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:42.206987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:42.206987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:42.206987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:42.206987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:42.206987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:42.206987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:42.213652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:42.213652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:42.213652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:42.213652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:42.213652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 531/1061] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:42.213944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f08eaf-e006-4a04-8d12-c8c272fa3cda None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:42.221913 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de971849-60dd-4f69-9651-ea9f25af307a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:42.259376 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cb74b-643d-4e6c-985b-641324425132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:42.259964 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cb74b-643d-4e6c-985b-641324425132 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:42.260310 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cb74b-643d-4e6c-985b-641324425132 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:42.260592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cb74b-643d-4e6c-985b-641324425132 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:42.261459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cb74b-643d-4e6c-985b-641324425132 None admin] RBAC: Adding query filter params (name=image) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:42.261797 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cb74b-643d-4e6c-985b-641324425132 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:42.263242 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cb74b-643d-4e6c-985b-641324425132 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:42.268542 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 531/1062] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:42.274907 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cb74b-643d-4e6c-985b-641324425132 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:42.319464 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f08eaf-e006-4a04-8d12-c8c272fa3cda None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:42.353752 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4aba3-4484-4a60-a955-c178ff07dba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:42.354520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4aba3-4484-4a60-a955-c178ff07dba0 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:42.354828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4aba3-4484-4a60-a955-c178ff07dba0 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:42.355108 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4aba3-4484-4a60-a955-c178ff07dba0 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:42.355876 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4aba3-4484-4a60-a955-c178ff07dba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:42.356184 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4aba3-4484-4a60-a955-c178ff07dba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:42.357543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4aba3-4484-4a60-a955-c178ff07dba0 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:42.369513 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 532/1063] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:42.375395 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4aba3-4484-4a60-a955-c178ff07dba0 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:42.386592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cb74b-643d-4e6c-985b-641324425132 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:42.411103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:42.417604 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:42.424509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bf9cd-f899-4c31-aaea-f075b9caf56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:42.425171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bf9cd-f899-4c31-aaea-f075b9caf56c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:42.425450 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bf9cd-f899-4c31-aaea-f075b9caf56c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:42.425719 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bf9cd-f899-4c31-aaea-f075b9caf56c None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:42.426418 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bf9cd-f899-4c31-aaea-f075b9caf56c None admin] RBAC: Adding query filter params (type=image) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:42.426719 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bf9cd-f899-4c31-aaea-f075b9caf56c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:42.428681 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bf9cd-f899-4c31-aaea-f075b9caf56c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:42.438580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 532/1064] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:42.439600 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bf9cd-f899-4c31-aaea-f075b9caf56c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:42.492054 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4aba3-4484-4a60-a955-c178ff07dba0 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:42.526115 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769071f2-330e-49aa-924b-8ef5cdef8755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:42.526833 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769071f2-330e-49aa-924b-8ef5cdef8755 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:42.527122 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769071f2-330e-49aa-924b-8ef5cdef8755 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:42.527434 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769071f2-330e-49aa-924b-8ef5cdef8755 None admin] PATH_INFO: `/v3/users/nova` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:42.534592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769071f2-330e-49aa-924b-8ef5cdef8755 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:42.536049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769071f2-330e-49aa-924b-8ef5cdef8755 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:42.549224 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bf9cd-f899-4c31-aaea-f075b9caf56c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:42.551376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-769071f2-330e-49aa-924b-8ef5cdef8755 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 20:35:42.551376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:42.551376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:42.551376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:42.551376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:42.551376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:42.551376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:42.551376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:42.551376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:42.551376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:42.551376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:42.551376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:42.551376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:35:42.551376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:35:42.551376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:35:42.551376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:35:42.552500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:42.552500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:42.552500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:35:42.552500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:42.552500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:35:42.552500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:42.552500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:42.552500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:42.552500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:42.552500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:42.552500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:42.552500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:42.552500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:42.552500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:42.552500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:42.552500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:42.552500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:42.552500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:42.553550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:42.553550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:42.553550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:35:42.553550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:35:42.553550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:35:42.553550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:35:42.553550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:35:42.553550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:35:42.553550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 20:35:42.553550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:42.553550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 533/1065] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Jul 19 20:35:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:42.560128 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769071f2-330e-49aa-924b-8ef5cdef8755 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:42.593086 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175ff60-2583-4f6c-aaf1-d35ff9e14d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:42.593855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175ff60-2583-4f6c-aaf1-d35ff9e14d8a None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:42.594262 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175ff60-2583-4f6c-aaf1-d35ff9e14d8a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:42.594554 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175ff60-2583-4f6c-aaf1-d35ff9e14d8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:42.595313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175ff60-2583-4f6c-aaf1-d35ff9e14d8a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:42.596703 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175ff60-2583-4f6c-aaf1-d35ff9e14d8a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:42.617057 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 533/1066] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Jul 19 20:35:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:35:42.669892 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:42.677829 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769071f2-330e-49aa-924b-8ef5cdef8755 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:42.724402 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe6fbc-4dda-43b3-b062-618489252873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:42.725099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe6fbc-4dda-43b3-b062-618489252873 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:42.725423 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe6fbc-4dda-43b3-b062-618489252873 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:42.725703 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe6fbc-4dda-43b3-b062-618489252873 None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:42.726559 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe6fbc-4dda-43b3-b062-618489252873 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:42.726872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe6fbc-4dda-43b3-b062-618489252873 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:42.728343 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe6fbc-4dda-43b3-b062-618489252873 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:42.748138 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 534/1067] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Jul 19 20:35:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:42.754117 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175ff60-2583-4f6c-aaf1-d35ff9e14d8a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:42.810233 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:42.864155 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175ff60-2583-4f6c-aaf1-d35ff9e14d8a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:42.905757 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aea7eb-0de0-42f3-a0d4-e672ab43f9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:42.906570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aea7eb-0de0-42f3-a0d4-e672ab43f9c5 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:42.906855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aea7eb-0de0-42f3-a0d4-e672ab43f9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:42.907134 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aea7eb-0de0-42f3-a0d4-e672ab43f9c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:42.918503 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aea7eb-0de0-42f3-a0d4-e672ab43f9c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:42.920005 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aea7eb-0de0-42f3-a0d4-e672ab43f9c5 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:42.937353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-19aea7eb-0de0-42f3-a0d4-e672ab43f9c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:42.937353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:42.937353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:42.937353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:42.937353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:42.937353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:42.937353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:42.937353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:42.937353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:42.937353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:42.937353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:42.937353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:42.937353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:42.937353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:42.937353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:42.938261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:42.938261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:42.938261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:42.938261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:42.938261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:42.938261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:42.938261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:42.938261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:42.938261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:42.938261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:42.938261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:42.938261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:42.938261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:42.938261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:42.938261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:42.938261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:42.938261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:42.939176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:42.939176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:42.939176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:42.939176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:42.939176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 534/1068] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:42.946214 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe6fbc-4dda-43b3-b062-618489252873 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:43.047703 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe6fbc-4dda-43b3-b062-618489252873 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:43.082351 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796c397-f7df-4aa7-be42-ae9997b53eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:43.082931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796c397-f7df-4aa7-be42-ae9997b53eb0 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:43.083212 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796c397-f7df-4aa7-be42-ae9997b53eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:43.083591 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796c397-f7df-4aa7-be42-ae9997b53eb0 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:43.084308 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796c397-f7df-4aa7-be42-ae9997b53eb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:43.084609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796c397-f7df-4aa7-be42-ae9997b53eb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:43.085967 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796c397-f7df-4aa7-be42-ae9997b53eb0 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:43.102055 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 535/1069] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:43.103234 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aea7eb-0de0-42f3-a0d4-e672ab43f9c5 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:43.207146 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aea7eb-0de0-42f3-a0d4-e672ab43f9c5 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:43.209242 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:43.244225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b731a1-705a-4d12-bf0d-62399aad25fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:43.245024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b731a1-705a-4d12-bf0d-62399aad25fe None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:43.245310 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b731a1-705a-4d12-bf0d-62399aad25fe None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:43.245599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b731a1-705a-4d12-bf0d-62399aad25fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:43.252401 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b731a1-705a-4d12-bf0d-62399aad25fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:43.253827 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b731a1-705a-4d12-bf0d-62399aad25fe None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:43.267966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-70b731a1-705a-4d12-bf0d-62399aad25fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:43.267966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:43.267966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:43.267966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:43.267966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:43.267966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:43.267966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:43.267966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:43.267966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:43.267966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:43.267966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:43.267966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:43.267966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:35:43.267966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:35:43.267966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:35:43.268874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:35:43.268874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:43.268874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:43.268874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:43.268874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:43.268874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:43.268874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:43.268874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:43.268874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:43.268874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:43.268874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:43.268874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:43.268874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:43.268874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:43.268874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:43.268874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:43.268874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:43.269872 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:35:43.269872 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:35:43.269872 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:35:43.269872 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:35:43.269872 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:35:43.269872 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:35:43.269872 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:43.269872 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:43.271408 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 535/1070] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:35:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:43.275483 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796c397-f7df-4aa7-be42-ae9997b53eb0 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:43.287461 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:43.381318 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796c397-f7df-4aa7-be42-ae9997b53eb0 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:43.415179 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172efe2-c1f9-4058-9a7d-5a717e11efb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:43.415882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172efe2-c1f9-4058-9a7d-5a717e11efb7 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:43.416169 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172efe2-c1f9-4058-9a7d-5a717e11efb7 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:43.416443 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172efe2-c1f9-4058-9a7d-5a717e11efb7 None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:43.417229 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172efe2-c1f9-4058-9a7d-5a717e11efb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:43.417539 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172efe2-c1f9-4058-9a7d-5a717e11efb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:43.418963 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172efe2-c1f9-4058-9a7d-5a717e11efb7 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:43.435548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 536/1071] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:35:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:43.437094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b731a1-705a-4d12-bf0d-62399aad25fe None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:43.538432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b731a1-705a-4d12-bf0d-62399aad25fe None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:43.572760 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d66741-179e-45ac-b42b-4f28b4a8db58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:43.573641 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d66741-179e-45ac-b42b-4f28b4a8db58 None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:43.573920 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d66741-179e-45ac-b42b-4f28b4a8db58 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:43.574191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d66741-179e-45ac-b42b-4f28b4a8db58 None admin] PATH_INFO: `/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/6dbbb8f7b3f2449fb9c64ca3815b6c1b/roles/8f8d721df639446bb89673cc687829e3` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:43.576388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d66741-179e-45ac-b42b-4f28b4a8db58 None admin] RBAC: Authorizing `identity:create_grant(project_id=327868f4f62e4e4a9c5bef4acd32fb29, user_id=6dbbb8f7b3f2449fb9c64ca3815b6c1b, role_id=8f8d721df639446bb89673cc687829e3)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:43.577794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d66741-179e-45ac-b42b-4f28b4a8db58 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:43.592944 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 536/1072] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:35:43 2022] PUT /identity/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/6dbbb8f7b3f2449fb9c64ca3815b6c1b/roles/8f8d721df639446bb89673cc687829e3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:35:44.050319 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a9eeb-dd56-480b-bd3c-da5da4b8b962 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:44.050830 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a9eeb-dd56-480b-bd3c-da5da4b8b962 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:44.050908 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a9eeb-dd56-480b-bd3c-da5da4b8b962 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:44.052863 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 537/1073] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:44.058176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba1d0b-4f31-49b4-8d97-5ba4ef01fb52 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:44.058572 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba1d0b-4f31-49b4-8d97-5ba4ef01fb52 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:44.058743 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba1d0b-4f31-49b4-8d97-5ba4ef01fb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:44.075706 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-8bba1d0b-4f31-49b4-8d97-5ba4ef01fb52 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:44.077009 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-8bba1d0b-4f31-49b4-8d97-5ba4ef01fb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:44.094499 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:44.150420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 537/1074] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:44.172296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a9eeb-dd56-480b-bd3c-da5da4b8b962 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:44.247854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:44.284613 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a9eeb-dd56-480b-bd3c-da5da4b8b962 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:44.322200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b8a7b-c365-4086-8035-a95780a15570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:44.323014 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b8a7b-c365-4086-8035-a95780a15570 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:44.323310 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b8a7b-c365-4086-8035-a95780a15570 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:44.323592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b8a7b-c365-4086-8035-a95780a15570 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:44.334647 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b8a7b-c365-4086-8035-a95780a15570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:35:44.342520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-f06b8a7b-c365-4086-8035-a95780a15570 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:35:44.342520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:44.342520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:44.342520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:44.342520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:44.342520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:44.342520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:44.342520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:44.342520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:44.342520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:44.342520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:44.342520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:44.342520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:35:44.342520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:35:44.342520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:35:44.342520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:35:44.343720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:35:44.343720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:35:44.343720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:35:44.343720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:35:44.343720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:44.343720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:44.343720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:44.343720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:44.343720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:44.343720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:44.343720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:44.343720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:44.343720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:44.343720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:44.343720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:44.343720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:44.349530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:44.349530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:44.349530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:44.349530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:44.349530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:35:44.349530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:35:44.349530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:35:44.349530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:35:44.349530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:35:44.349530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:35:44.349530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:35:44.349530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:44.349530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 538/1075] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:35:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:44.350245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba1d0b-4f31-49b4-8d97-5ba4ef01fb52 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:44.450195 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba1d0b-4f31-49b4-8d97-5ba4ef01fb52 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:44.484300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f6aac-63bd-4609-8eab-68f9285a8317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:44.484964 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f6aac-63bd-4609-8eab-68f9285a8317 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:44.485297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f6aac-63bd-4609-8eab-68f9285a8317 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:44.485578 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f6aac-63bd-4609-8eab-68f9285a8317 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:44.486322 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f6aac-63bd-4609-8eab-68f9285a8317 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:44.486628 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f6aac-63bd-4609-8eab-68f9285a8317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:44.488094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006f6aac-63bd-4609-8eab-68f9285a8317 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:44.501429 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 538/1076] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:35:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:44.502669 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b8a7b-c365-4086-8035-a95780a15570 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:44.608265 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b8a7b-c365-4086-8035-a95780a15570 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:44.634236 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:44.643101 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30305597-d564-479e-85af-2dd3d281646a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:44.644063 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30305597-d564-479e-85af-2dd3d281646a None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:44.644349 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30305597-d564-479e-85af-2dd3d281646a None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:44.644624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30305597-d564-479e-85af-2dd3d281646a None admin] PATH_INFO: `/v3/users/d2eaf62546514f3798185f0cdd022812` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:44.646419 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30305597-d564-479e-85af-2dd3d281646a None admin] RBAC: Authorizing `identity:get_user(user_id=d2eaf62546514f3798185f0cdd022812)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:44.648017 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30305597-d564-479e-85af-2dd3d281646a None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:44.654580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 539/1077] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:35:44 2022] GET /identity/v3/users/d2eaf62546514f3798185f0cdd022812 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:44.655573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f6aac-63bd-4609-8eab-68f9285a8317 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:44.673147 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:44.712542 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116295c-0559-4dbe-ae1f-ebb65a47f702 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:44.712841 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116295c-0559-4dbe-ae1f-ebb65a47f702 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:44.713117 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116295c-0559-4dbe-ae1f-ebb65a47f702 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:44.714620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 540/1078] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:35:44.719477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb67ddb-4da7-4a7a-b9e6-4ecb5ae7c826 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:44.719770 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb67ddb-4da7-4a7a-b9e6-4ecb5ae7c826 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:44.720072 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb67ddb-4da7-4a7a-b9e6-4ecb5ae7c826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:44.736666 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-dfb67ddb-4da7-4a7a-b9e6-4ecb5ae7c826 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:44.737884 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-dfb67ddb-4da7-4a7a-b9e6-4ecb5ae7c826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:44.769463 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006f6aac-63bd-4609-8eab-68f9285a8317 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:44.805936 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e3f40-2f42-4366-a7fd-4b3ecf19f751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:44.806800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e3f40-2f42-4366-a7fd-4b3ecf19f751 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:44.807083 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e3f40-2f42-4366-a7fd-4b3ecf19f751 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:44.807558 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e3f40-2f42-4366-a7fd-4b3ecf19f751 None admin] PATH_INFO: `/v3/projects/57998d612a404f0abed72d2e59b14298` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:44.808564 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e3f40-2f42-4366-a7fd-4b3ecf19f751 None admin] RBAC: Authorizing `identity:get_project(project_id=57998d612a404f0abed72d2e59b14298)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:44.809987 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e3f40-2f42-4366-a7fd-4b3ecf19f751 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:44.816761 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 539/1079] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:35:44 2022] GET /identity/v3/projects/57998d612a404f0abed72d2e59b14298 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:44.816906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 541/1080] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 20:35:44.818785 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e3f40-2f42-4366-a7fd-4b3ecf19f751 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:44.836022 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb67ddb-4da7-4a7a-b9e6-4ecb5ae7c826 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:44.908727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:44.930891 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e3f40-2f42-4366-a7fd-4b3ecf19f751 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:44.950704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb67ddb-4da7-4a7a-b9e6-4ecb5ae7c826 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:44.965796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22074076-511d-41dd-9f41-55d494fe169d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:44.966622 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22074076-511d-41dd-9f41-55d494fe169d None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:44.966908 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22074076-511d-41dd-9f41-55d494fe169d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:44.967185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22074076-511d-41dd-9f41-55d494fe169d None admin] PATH_INFO: `/v3/projects/57998d612a404f0abed72d2e59b14298/users/d2eaf62546514f3798185f0cdd022812/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:44.969194 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22074076-511d-41dd-9f41-55d494fe169d None admin] RBAC: Authorizing `identity:create_grant(project_id=57998d612a404f0abed72d2e59b14298, user_id=d2eaf62546514f3798185f0cdd022812, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:44.970613 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22074076-511d-41dd-9f41-55d494fe169d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:44.981067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:44.995305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 540/1081] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:35:44 2022] PUT /identity/v3/projects/57998d612a404f0abed72d2e59b14298/users/d2eaf62546514f3798185f0cdd022812/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:35:45.001688 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a6ef8-07fb-46e5-b609-b6af9fd9080e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:45.002373 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a6ef8-07fb-46e5-b609-b6af9fd9080e None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:45.002659 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a6ef8-07fb-46e5-b609-b6af9fd9080e None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:45.002935 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a6ef8-07fb-46e5-b609-b6af9fd9080e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:45.077101 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a6ef8-07fb-46e5-b609-b6af9fd9080e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:45.078576 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a6ef8-07fb-46e5-b609-b6af9fd9080e None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:45.186123 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 542/1082] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:35:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 20:35:45.192048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22074076-511d-41dd-9f41-55d494fe169d None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:45.298027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22074076-511d-41dd-9f41-55d494fe169d None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:45.332394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef434ee9-8be4-4a6b-9d3e-9e1f6f0332e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:45.333205 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef434ee9-8be4-4a6b-9d3e-9e1f6f0332e8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:45.334019 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef434ee9-8be4-4a6b-9d3e-9e1f6f0332e8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:45.334297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef434ee9-8be4-4a6b-9d3e-9e1f6f0332e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:45.346037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef434ee9-8be4-4a6b-9d3e-9e1f6f0332e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:45.347498 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef434ee9-8be4-4a6b-9d3e-9e1f6f0332e8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:45.349462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:45.367524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-ef434ee9-8be4-4a6b-9d3e-9e1f6f0332e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:45.367524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:45.367524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:45.367524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:45.367524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:45.367524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:45.367524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:45.367524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:45.367524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:45.367524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:45.367524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:45.367524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:45.367524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:45.367524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:45.367524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:45.368671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:45.368671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:45.368671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:45.368671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:45.368671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:45.368671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:45.368671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:45.368671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:45.368671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:45.368671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:45.368671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:45.368671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:45.368671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:45.368671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:45.368671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:45.368671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:45.368671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:45.369798 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:45.369798 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:45.369798 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:45.369798 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:45.376499 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 541/1083] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:45.377936 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a6ef8-07fb-46e5-b609-b6af9fd9080e None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:45.406437 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:45.485674 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a6ef8-07fb-46e5-b609-b6af9fd9080e None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:45.521744 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af5e02-3ca8-46a6-a2a7-83ddc633d147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:45.522705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af5e02-3ca8-46a6-a2a7-83ddc633d147 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:45.523201 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af5e02-3ca8-46a6-a2a7-83ddc633d147 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:45.523716 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af5e02-3ca8-46a6-a2a7-83ddc633d147 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:45.524626 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af5e02-3ca8-46a6-a2a7-83ddc633d147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:45.525111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af5e02-3ca8-46a6-a2a7-83ddc633d147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:45.526650 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af5e02-3ca8-46a6-a2a7-83ddc633d147 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:45.539514 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 543/1084] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:45.621689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141a195-6235-40d3-b0de-20ea5cad3831 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:45.621870 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141a195-6235-40d3-b0de-20ea5cad3831 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:45.622142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141a195-6235-40d3-b0de-20ea5cad3831 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:45.623754 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 542/1085] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:45.629464 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30390275-6fea-4726-ade3-bb9c07581ab3 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:45.629792 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30390275-6fea-4726-ade3-bb9c07581ab3 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:45.630024 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30390275-6fea-4726-ade3-bb9c07581ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:45.647985 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-30390275-6fea-4726-ade3-bb9c07581ab3 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:45.649205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-30390275-6fea-4726-ade3-bb9c07581ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:45.723671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 544/1086] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:45.747704 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141a195-6235-40d3-b0de-20ea5cad3831 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:45.857786 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141a195-6235-40d3-b0de-20ea5cad3831 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:45.894456 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf30cc-f01b-4208-baeb-00f7138fc964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:45.895299 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf30cc-f01b-4208-baeb-00f7138fc964 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:45.895590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf30cc-f01b-4208-baeb-00f7138fc964 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:45.896437 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf30cc-f01b-4208-baeb-00f7138fc964 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:45.908970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf30cc-f01b-4208-baeb-00f7138fc964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:35:45.917422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-05cf30cc-f01b-4208-baeb-00f7138fc964 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 20:35:45.917422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:45.917422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:45.917422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:45.917422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:45.917422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:45.917422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:45.917422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:45.917422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:45.917422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:45.917422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:45.917422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:45.917422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:35:45.917422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:35:45.917422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:35:45.917422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:35:45.918433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:35:45.918433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:35:45.918433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:35:45.918433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:35:45.918433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:45.918433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:45.918433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:45.918433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:45.918433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:45.918433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:45.918433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:45.918433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:45.918433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:45.918433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:45.918433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:45.918433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:45.919312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:45.919312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:45.919312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:45.919312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:45.919312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:35:45.919312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:35:45.919312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:35:45.919312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:35:45.919312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:35:45.919312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:35:45.919312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 20:35:45.919312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:45.919312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 543/1087] 10.222.0.77 () {56 vars in 1120 bytes} [Tue Jul 19 20:35:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:45.924578 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30390275-6fea-4726-ade3-bb9c07581ab3 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:45.941764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:46.021911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30390275-6fea-4726-ade3-bb9c07581ab3 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:46.056290 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd2f9b-6da0-4b67-af79-d1fcfeb6a55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:46.056960 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd2f9b-6da0-4b67-af79-d1fcfeb6a55b None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:46.057244 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd2f9b-6da0-4b67-af79-d1fcfeb6a55b None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:46.057520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd2f9b-6da0-4b67-af79-d1fcfeb6a55b None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:46.058269 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd2f9b-6da0-4b67-af79-d1fcfeb6a55b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:46.058576 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd2f9b-6da0-4b67-af79-d1fcfeb6a55b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:46.059972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd2f9b-6da0-4b67-af79-d1fcfeb6a55b None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:46.073577 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 545/1088] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Jul 19 20:35:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:46.074761 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf30cc-f01b-4208-baeb-00f7138fc964 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:46.132051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:46.177629 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf30cc-f01b-4208-baeb-00f7138fc964 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:46.210388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3681d-89e6-4d16-8a89-bc0882db9f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:46.211164 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3681d-89e6-4d16-8a89-bc0882db9f50 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:46.211467 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3681d-89e6-4d16-8a89-bc0882db9f50 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:46.211737 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3681d-89e6-4d16-8a89-bc0882db9f50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:46.221359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3681d-89e6-4d16-8a89-bc0882db9f50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:46.222788 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3681d-89e6-4d16-8a89-bc0882db9f50 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:46.240661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-9dd3681d-89e6-4d16-8a89-bc0882db9f50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:46.240661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:46.240661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:46.240661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:46.240661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:46.240661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:46.240661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:46.240661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:46.240661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:46.240661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:46.240661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:46.240661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:46.240661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:46.240661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:46.240661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:46.241548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:46.241548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:46.241548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:46.241548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:46.241548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:46.241548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:46.241548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:46.241548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:46.241548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:46.241548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:46.241548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:46.241548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:46.241548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:46.241548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:46.241548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:46.241548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:46.241548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:46.242594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:46.242594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:46.242594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:46.242594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:46.242594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 544/1089] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:46.247555 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd2f9b-6da0-4b67-af79-d1fcfeb6a55b None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:46.324004 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:46.344617 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd2f9b-6da0-4b67-af79-d1fcfeb6a55b None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:46.376519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0380a9-b503-4ccd-a348-f7a7257bc935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:46.377166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0380a9-b503-4ccd-a348-f7a7257bc935 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:46.377450 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0380a9-b503-4ccd-a348-f7a7257bc935 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:46.377720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0380a9-b503-4ccd-a348-f7a7257bc935 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:46.378426 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0380a9-b503-4ccd-a348-f7a7257bc935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:46.378726 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0380a9-b503-4ccd-a348-f7a7257bc935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:46.380097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0380a9-b503-4ccd-a348-f7a7257bc935 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:46.392093 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 546/1090] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:46.397461 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3681d-89e6-4d16-8a89-bc0882db9f50 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:46.496959 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3681d-89e6-4d16-8a89-bc0882db9f50 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:46.503868 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:46.530404 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87c1da-ed25-4297-934c-83c90ce7a5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:46.531198 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87c1da-ed25-4297-934c-83c90ce7a5bf None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:46.531509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87c1da-ed25-4297-934c-83c90ce7a5bf None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:46.531787 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87c1da-ed25-4297-934c-83c90ce7a5bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:46.539952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87c1da-ed25-4297-934c-83c90ce7a5bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:46.541387 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87c1da-ed25-4297-934c-83c90ce7a5bf None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:46.555187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-3c87c1da-ed25-4297-934c-83c90ce7a5bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 20:35:46.555187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:46.555187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:46.555187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:46.555187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:46.555187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:46.555187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:46.555187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:46.555187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:46.555187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:46.555187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:46.555187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:46.555187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:35:46.555187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:35:46.555187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:35:46.555187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:35:46.556267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:46.556267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:46.556267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:35:46.556267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:46.556267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:35:46.556267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:35:46.556267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:46.556267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:46.556267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:46.556267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:46.556267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:46.556267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:46.556267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:46.556267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:46.556267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:46.556267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:46.556267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:46.556267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:46.557253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:46.557253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:46.557253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:35:46.557253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:35:46.557253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:35:46.557253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:35:46.557253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:35:46.557253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:35:46.557253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 20:35:46.557253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:46.557253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 545/1091] 10.222.0.77 () {56 vars in 1093 bytes} [Tue Jul 19 20:35:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:35:46.562341 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0380a9-b503-4ccd-a348-f7a7257bc935 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:46.660363 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0380a9-b503-4ccd-a348-f7a7257bc935 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:46.694915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09fa69-4def-444d-be78-381458dd5407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:46.695614 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09fa69-4def-444d-be78-381458dd5407 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:46.695904 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09fa69-4def-444d-be78-381458dd5407 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:46.696179 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09fa69-4def-444d-be78-381458dd5407 None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:46.697014 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09fa69-4def-444d-be78-381458dd5407 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:46.697324 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09fa69-4def-444d-be78-381458dd5407 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:46.698739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09fa69-4def-444d-be78-381458dd5407 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:46.706552 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:46.718076 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 547/1092] 10.222.0.77 () {56 vars in 1133 bytes} [Tue Jul 19 20:35:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:46.724406 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87c1da-ed25-4297-934c-83c90ce7a5bf None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:46.822492 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87c1da-ed25-4297-934c-83c90ce7a5bf None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:46.854473 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b10d50-21b9-48ea-9344-93d75ab65802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:46.855112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b10d50-21b9-48ea-9344-93d75ab65802 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:46.855426 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b10d50-21b9-48ea-9344-93d75ab65802 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:46.855697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b10d50-21b9-48ea-9344-93d75ab65802 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:46.890389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:46.924636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b10d50-21b9-48ea-9344-93d75ab65802 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:46.926064 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b10d50-21b9-48ea-9344-93d75ab65802 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:47.020532 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 546/1093] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:35:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 20:35:47.026247 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09fa69-4def-444d-be78-381458dd5407 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:47.074620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e08fe0-da06-4e9e-9d2a-745d85b2d709 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:47.074828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e08fe0-da06-4e9e-9d2a-745d85b2d709 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:47.075113 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e08fe0-da06-4e9e-9d2a-745d85b2d709 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:47.076713 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 547/1094] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:47.081500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c9851-c453-452f-8b73-a9d470487115 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:47.081784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c9851-c453-452f-8b73-a9d470487115 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:47.082070 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c9851-c453-452f-8b73-a9d470487115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:47.098595 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-276c9851-c453-452f-8b73-a9d470487115 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:47.099891 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-276c9851-c453-452f-8b73-a9d470487115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:47.124532 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09fa69-4def-444d-be78-381458dd5407 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:47.158872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3acf22-1ff6-4758-bf9c-d88775e0cc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:47.159404 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:47.159701 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3acf22-1ff6-4758-bf9c-d88775e0cc91 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:47.159988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3acf22-1ff6-4758-bf9c-d88775e0cc91 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:47.160333 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3acf22-1ff6-4758-bf9c-d88775e0cc91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:47.167914 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 548/1095] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 20:35:47.172687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3acf22-1ff6-4758-bf9c-d88775e0cc91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:47.175230 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3acf22-1ff6-4758-bf9c-d88775e0cc91 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:47.191881 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c9851-c453-452f-8b73-a9d470487115 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:47.194977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-3c3acf22-1ff6-4758-bf9c-d88775e0cc91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:47.194977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:47.194977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:47.194977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:47.194977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:47.194977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:47.194977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:47.194977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:47.194977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:47.194977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:47.194977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:47.194977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:47.194977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:35:47.194977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:35:47.194977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:35:47.196068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:35:47.196068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:47.196068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:47.196068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:47.196068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:47.196068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:47.196068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:47.196068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:47.196068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:47.196068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:47.196068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:47.196068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:47.196068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:47.196068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:47.196068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:47.196068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:47.196068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:47.197207 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:35:47.197207 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:35:47.197207 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:35:47.197207 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:35:47.197207 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 548/1096] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:47.201620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3acf22-1ff6-4758-bf9c-d88775e0cc91 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:47.251724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:47.295655 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c9851-c453-452f-8b73-a9d470487115 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:47.302677 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3acf22-1ff6-4758-bf9c-d88775e0cc91 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:47.328903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839e07d-8e39-4d72-8bcf-82e7eda4bbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:47.329625 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839e07d-8e39-4d72-8bcf-82e7eda4bbdd None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:47.329906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839e07d-8e39-4d72-8bcf-82e7eda4bbdd None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:47.330179 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839e07d-8e39-4d72-8bcf-82e7eda4bbdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:47.336706 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e81122-cfc3-4015-a3ce-53d43a39f993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:47.337371 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e81122-cfc3-4015-a3ce-53d43a39f993 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:47.337657 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e81122-cfc3-4015-a3ce-53d43a39f993 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:47.337934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e81122-cfc3-4015-a3ce-53d43a39f993 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:47.338656 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e81122-cfc3-4015-a3ce-53d43a39f993 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:47.338963 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e81122-cfc3-4015-a3ce-53d43a39f993 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:47.340357 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e81122-cfc3-4015-a3ce-53d43a39f993 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:47.340908 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839e07d-8e39-4d72-8bcf-82e7eda4bbdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:35:47.348599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-9839e07d-8e39-4d72-8bcf-82e7eda4bbdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:35:47.348599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:47.348599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:47.348599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:47.348599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:47.348599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:47.348599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:47.348599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:47.348599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:47.348599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:47.348599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:47.348599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:47.348599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:35:47.348599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:35:47.348599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:35:47.348599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:35:47.349720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:35:47.349720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:35:47.349720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:35:47.349720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:35:47.349720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:47.349720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:47.349720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:47.349720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:47.349720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:47.349720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:47.349720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:47.349720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:47.349720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:47.349720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:47.349720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:47.349720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:47.350580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:47.350580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:47.350580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:47.350580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:47.350580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:35:47.350580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:35:47.350580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:35:47.350580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:35:47.350580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:35:47.350580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:35:47.350580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:35:47.350580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:47.351617 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 549/1097] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:47.354914 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 549/1098] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:35:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:47.356049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e81122-cfc3-4015-a3ce-53d43a39f993 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:47.356798 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839e07d-8e39-4d72-8bcf-82e7eda4bbdd None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:47.413778 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:47.456073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e81122-cfc3-4015-a3ce-53d43a39f993 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:47.459459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839e07d-8e39-4d72-8bcf-82e7eda4bbdd None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:47.465479 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:47.491813 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1340953-96cf-4185-ba9c-6ede0ad97588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:47.492482 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1340953-96cf-4185-ba9c-6ede0ad97588 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:47.492763 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1340953-96cf-4185-ba9c-6ede0ad97588 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:47.493036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1340953-96cf-4185-ba9c-6ede0ad97588 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:47.493278 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12f957-451e-4ace-b319-387800ff4ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:47.493773 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1340953-96cf-4185-ba9c-6ede0ad97588 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:47.494076 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1340953-96cf-4185-ba9c-6ede0ad97588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:47.499679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12f957-451e-4ace-b319-387800ff4ba3 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:47.499679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12f957-451e-4ace-b319-387800ff4ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:47.499679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12f957-451e-4ace-b319-387800ff4ba3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:47.499923 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1340953-96cf-4185-ba9c-6ede0ad97588 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:47.503554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 550/1099] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:35:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:47.505846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12f957-451e-4ace-b319-387800ff4ba3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:47.507338 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12f957-451e-4ace-b319-387800ff4ba3 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:47.509910 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1340953-96cf-4185-ba9c-6ede0ad97588 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:47.522660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-4a12f957-451e-4ace-b319-387800ff4ba3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:47.522660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:35:47.522660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:35:47.522660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:35:47.522660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:35:47.522660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:35:47.522660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:35:47.522660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:35:47.522660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:35:47.522660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:35:47.522660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:35:47.522660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:35:47.522660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:35:47.522660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:35:47.522660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:35:47.523846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:35:47.523846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:35:47.523846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:35:47.523846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:35:47.523846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:35:47.523846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:35:47.523846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:35:47.523846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:35:47.523846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:35:47.523846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:35:47.523846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:35:47.523846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:35:47.523846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:35:47.523846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:35:47.523846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:35:47.523846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:35:47.523846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:35:47.525366 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:35:47.525366 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:35:47.525366 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:35:47.525366 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:35:47.525366 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:35:47.525366 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:35:47.525366 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:35:47.525366 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:35:47.527421 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 550/1100] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:35:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:35:47.529738 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12f957-451e-4ace-b319-387800ff4ba3 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:47.616279 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1340953-96cf-4185-ba9c-6ede0ad97588 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:47.629396 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12f957-451e-4ace-b319-387800ff4ba3 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:47.646813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:47.650656 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9da58-bdfd-4cae-9544-7d9737bc8014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:47.651566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9da58-bdfd-4cae-9544-7d9737bc8014 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:47.651854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9da58-bdfd-4cae-9544-7d9737bc8014 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:47.652136 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9da58-bdfd-4cae-9544-7d9737bc8014 None admin] PATH_INFO: `/v3/users/d2eaf62546514f3798185f0cdd022812` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:47.653327 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9da58-bdfd-4cae-9544-7d9737bc8014 None admin] RBAC: Authorizing `identity:get_user(user_id=d2eaf62546514f3798185f0cdd022812)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:47.654749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9da58-bdfd-4cae-9544-7d9737bc8014 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:47.656424 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 551/1101] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:35:47 2022] GET /identity/v3/users/d2eaf62546514f3798185f0cdd022812 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:47.662361 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9da58-bdfd-4cae-9544-7d9737bc8014 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:47.666328 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a6a4a-d909-4ae6-b85d-938a28926640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:47.666989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a6a4a-d909-4ae6-b85d-938a28926640 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:47.667289 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a6a4a-d909-4ae6-b85d-938a28926640 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:47.667576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a6a4a-d909-4ae6-b85d-938a28926640 None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:47.668363 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a6a4a-d909-4ae6-b85d-938a28926640 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:47.668674 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a6a4a-d909-4ae6-b85d-938a28926640 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:47.670103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a6a4a-d909-4ae6-b85d-938a28926640 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:47.682279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 551/1102] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:35:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:47.688207 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a6a4a-d909-4ae6-b85d-938a28926640 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:47.703678 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:47.763713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9da58-bdfd-4cae-9544-7d9737bc8014 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:47.786397 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a6a4a-d909-4ae6-b85d-938a28926640 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:47.798816 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b86212-ed56-4da3-9e30-252808b69fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:47.799488 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b86212-ed56-4da3-9e30-252808b69fbf None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:47.799772 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b86212-ed56-4da3-9e30-252808b69fbf None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:47.800051 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b86212-ed56-4da3-9e30-252808b69fbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:47.821877 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06aea7-778f-4021-af62-ea9209fbbaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:47.822608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06aea7-778f-4021-af62-ea9209fbbaf1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:47.822887 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06aea7-778f-4021-af62-ea9209fbbaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:47.823160 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad06aea7-778f-4021-af62-ea9209fbbaf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:47.824041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06aea7-778f-4021-af62-ea9209fbbaf1 None admin] RBAC: Adding query filter params (role.id=8f8d721df639446bb89673cc687829e3, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=6dbbb8f7b3f2449fb9c64ca3815b6c1b) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:47.824367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06aea7-778f-4021-af62-ea9209fbbaf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:47.825794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad06aea7-778f-4021-af62-ea9209fbbaf1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:47.831618 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 552/1103] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:35:47 2022] GET /identity/v3/role_assignments?user.id=6dbbb8f7b3f2449fb9c64ca3815b6c1b&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=8f8d721df639446bb89673cc687829e3 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:47.870152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b86212-ed56-4da3-9e30-252808b69fbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:47.871572 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b86212-ed56-4da3-9e30-252808b69fbf None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:47.916796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:47.980238 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 552/1104] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:35:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 20:35:47.986366 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06aea7-778f-4021-af62-ea9209fbbaf1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:48.028912 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:48.089727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad06aea7-778f-4021-af62-ea9209fbbaf1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:48.124143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f919666-c653-41aa-a1a4-13a9d329f262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:48.124936 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f919666-c653-41aa-a1a4-13a9d329f262 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:48.125214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f919666-c653-41aa-a1a4-13a9d329f262 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:48.125489 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f919666-c653-41aa-a1a4-13a9d329f262 None admin] PATH_INFO: `/v3/projects/57998d612a404f0abed72d2e59b14298` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:48.126676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f919666-c653-41aa-a1a4-13a9d329f262 None admin] RBAC: Authorizing `identity:get_project(project_id=57998d612a404f0abed72d2e59b14298)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:48.128139 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f919666-c653-41aa-a1a4-13a9d329f262 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:48.129844 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 553/1105] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:35:47 2022] GET /identity/v3/projects/57998d612a404f0abed72d2e59b14298 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:35:48.136673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b86212-ed56-4da3-9e30-252808b69fbf None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:48.236941 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b86212-ed56-4da3-9e30-252808b69fbf None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:48.271703 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb45023-6c63-4feb-8e90-120ee003a92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:48.272360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb45023-6c63-4feb-8e90-120ee003a92d None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:48.272636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb45023-6c63-4feb-8e90-120ee003a92d None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:48.272920 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb45023-6c63-4feb-8e90-120ee003a92d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:48.273758 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb45023-6c63-4feb-8e90-120ee003a92d None admin] RBAC: Adding query filter params (role.id=b30f01ef95004a1b84fc029830bdf053, scope.project.id=57998d612a404f0abed72d2e59b14298, user.id=d2eaf62546514f3798185f0cdd022812) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:48.274076 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb45023-6c63-4feb-8e90-120ee003a92d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:48.275544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb45023-6c63-4feb-8e90-120ee003a92d None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:48.281793 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 553/1106] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:35:48 2022] GET /identity/v3/role_assignments?user.id=d2eaf62546514f3798185f0cdd022812&scope.project.id=57998d612a404f0abed72d2e59b14298&role.id=b30f01ef95004a1b84fc029830bdf053 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:50.348382 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f4c94-b6a8-43a1-96c1-2ca32206c236 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:50.348953 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f4c94-b6a8-43a1-96c1-2ca32206c236 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:50.348953 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f4c94-b6a8-43a1-96c1-2ca32206c236 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:50.350922 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 554/1107] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:50.356398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3319-0ac7-4343-97fe-65b229727d0b None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:50.356824 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3319-0ac7-4343-97fe-65b229727d0b None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:50.357013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3319-0ac7-4343-97fe-65b229727d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:50.362060 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:50.375238 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-e79b3319-0ac7-4343-97fe-65b229727d0b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:50.376453 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e79b3319-0ac7-4343-97fe-65b229727d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:50.441207 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 554/1108] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 20:35:50.465885 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f4c94-b6a8-43a1-96c1-2ca32206c236 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:50.567345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f4c94-b6a8-43a1-96c1-2ca32206c236 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:50.576120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:50.602891 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43663ea7-eea2-4659-a72b-813b429e0463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:50.603638 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43663ea7-eea2-4659-a72b-813b429e0463 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:50.603926 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43663ea7-eea2-4659-a72b-813b429e0463 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:50.604201 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43663ea7-eea2-4659-a72b-813b429e0463 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:50.605373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43663ea7-eea2-4659-a72b-813b429e0463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:50.606804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43663ea7-eea2-4659-a72b-813b429e0463 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:50.608457 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 555/1109] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:35:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:50.614718 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b3319-0ac7-4343-97fe-65b229727d0b None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:50.713347 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b3319-0ac7-4343-97fe-65b229727d0b None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:50.742831 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:50.748528 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d44ee-75c9-4ff3-a889-386882be8dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:50.750188 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d44ee-75c9-4ff3-a889-386882be8dd4 None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:50.750654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d44ee-75c9-4ff3-a889-386882be8dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:50.751045 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d44ee-75c9-4ff3-a889-386882be8dd4 None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:50.751735 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d44ee-75c9-4ff3-a889-386882be8dd4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:50.753261 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d44ee-75c9-4ff3-a889-386882be8dd4 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:50.773535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 555/1110] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jul 19 20:35:50 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:35:52.845394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df81de3-ac86-4110-8fda-79ba33c703e5 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:52.845994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df81de3-ac86-4110-8fda-79ba33c703e5 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:52.845994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df81de3-ac86-4110-8fda-79ba33c703e5 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:52.847328 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 556/1111] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:52.852650 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608a2b9-2fca-4f10-a1bd-ed6c08e95184 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:52.853077 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608a2b9-2fca-4f10-a1bd-ed6c08e95184 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:52.853219 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608a2b9-2fca-4f10-a1bd-ed6c08e95184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:52.870580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-b608a2b9-2fca-4f10-a1bd-ed6c08e95184 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:52.871815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b608a2b9-2fca-4f10-a1bd-ed6c08e95184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:52.942102 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 556/1112] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:52.966745 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df81de3-ac86-4110-8fda-79ba33c703e5 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:53.067277 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df81de3-ac86-4110-8fda-79ba33c703e5 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:53.103481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ef9a3-c085-4d21-a088-832aadc90025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:53.104264 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ef9a3-c085-4d21-a088-832aadc90025 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:53.104546 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ef9a3-c085-4d21-a088-832aadc90025 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:53.104821 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ef9a3-c085-4d21-a088-832aadc90025 None admin] PATH_INFO: `/v3/roles/92567de587bf40dab488cc1eb666b221` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:53.106303 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ef9a3-c085-4d21-a088-832aadc90025 None admin] RBAC: Authorizing `identity:get_role(role_id=92567de587bf40dab488cc1eb666b221)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:53.107711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ef9a3-c085-4d21-a088-832aadc90025 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:53.109086 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 557/1113] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:35:52 2022] GET /identity/v3/roles/92567de587bf40dab488cc1eb666b221 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:53.115452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608a2b9-2fca-4f10-a1bd-ed6c08e95184 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:53.213735 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608a2b9-2fca-4f10-a1bd-ed6c08e95184 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:53.231111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:53.249768 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaff193-86ed-4f1e-b3c8-c24b0023e06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:53.250710 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaff193-86ed-4f1e-b3c8-c24b0023e06d None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:53.251038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaff193-86ed-4f1e-b3c8-c24b0023e06d None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:53.251431 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaff193-86ed-4f1e-b3c8-c24b0023e06d None admin] PATH_INFO: `/v3/users/f8e61a854e914e2a80c2f816f80e0649` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:53.264726 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaff193-86ed-4f1e-b3c8-c24b0023e06d None admin] RBAC: Authorizing `identity:get_user(user_id=f8e61a854e914e2a80c2f816f80e0649)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:53.266144 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaff193-86ed-4f1e-b3c8-c24b0023e06d None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:53.267839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 557/1114] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:35:53 2022] GET /identity/v3/users/f8e61a854e914e2a80c2f816f80e0649 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:53.273726 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ef9a3-c085-4d21-a088-832aadc90025 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:53.319769 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:53.373627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ef9a3-c085-4d21-a088-832aadc90025 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:53.405933 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5e886-3399-40e2-8d6d-6ef8c24cd9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:53.406640 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5e886-3399-40e2-8d6d-6ef8c24cd9a0 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:53.406924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5e886-3399-40e2-8d6d-6ef8c24cd9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:53.407197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5e886-3399-40e2-8d6d-6ef8c24cd9a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:53.475138 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5e886-3399-40e2-8d6d-6ef8c24cd9a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:53.476738 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5e886-3399-40e2-8d6d-6ef8c24cd9a0 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:53.519732 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:53.576003 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 558/1115] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:35:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 20:35:53.582311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaff193-86ed-4f1e-b3c8-c24b0023e06d None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:53.681400 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaff193-86ed-4f1e-b3c8-c24b0023e06d None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:53.715388 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aa3cdc-4e65-4e3e-96a2-cb8e2a4550c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:53.716246 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa3cdc-4e65-4e3e-96a2-cb8e2a4550c0 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:53.716530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa3cdc-4e65-4e3e-96a2-cb8e2a4550c0 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:53.716805 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aa3cdc-4e65-4e3e-96a2-cb8e2a4550c0 None admin] PATH_INFO: `/v3/projects/57998d612a404f0abed72d2e59b14298` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:53.717984 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa3cdc-4e65-4e3e-96a2-cb8e2a4550c0 None admin] RBAC: Authorizing `identity:get_project(project_id=57998d612a404f0abed72d2e59b14298)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:53.719443 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aa3cdc-4e65-4e3e-96a2-cb8e2a4550c0 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:53.721175 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 558/1116] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:35:53 2022] GET /identity/v3/projects/57998d612a404f0abed72d2e59b14298 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:53.728181 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5e886-3399-40e2-8d6d-6ef8c24cd9a0 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:53.825464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5e886-3399-40e2-8d6d-6ef8c24cd9a0 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:53.859291 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b94ee-1e53-44c0-a200-941a0864a94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:53.860077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b94ee-1e53-44c0-a200-941a0864a94c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:53.860296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b94ee-1e53-44c0-a200-941a0864a94c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:53.860568 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b94ee-1e53-44c0-a200-941a0864a94c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:53.861391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b94ee-1e53-44c0-a200-941a0864a94c None admin] RBAC: Adding query filter params (role.id=92567de587bf40dab488cc1eb666b221, scope.project.id=57998d612a404f0abed72d2e59b14298, user.id=f8e61a854e914e2a80c2f816f80e0649) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:53.861696 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b94ee-1e53-44c0-a200-941a0864a94c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:53.863102 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b94ee-1e53-44c0-a200-941a0864a94c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:53.869310 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 559/1117] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:35:53 2022] GET /identity/v3/role_assignments?user.id=f8e61a854e914e2a80c2f816f80e0649&scope.project.id=57998d612a404f0abed72d2e59b14298&role.id=92567de587bf40dab488cc1eb666b221 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:55.899150 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0ed3f-ce0f-40d0-84fe-0558c34eeae8 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:55.899970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0ed3f-ce0f-40d0-84fe-0558c34eeae8 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:55.900120 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0ed3f-ce0f-40d0-84fe-0558c34eeae8 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:55.901699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 559/1118] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:55.907071 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144f4fb-0ac5-40f4-b623-ecac36794d99 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:55.907544 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144f4fb-0ac5-40f4-b623-ecac36794d99 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:55.907759 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144f4fb-0ac5-40f4-b623-ecac36794d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:55.925178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-3144f4fb-0ac5-40f4-b623-ecac36794d99 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:55.926364 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3144f4fb-0ac5-40f4-b623-ecac36794d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:55.928462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:55.993318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 560/1119] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:56.015703 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0ed3f-ce0f-40d0-84fe-0558c34eeae8 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:56.078457 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:56.136136 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0ed3f-ce0f-40d0-84fe-0558c34eeae8 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:56.169939 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c4be3-11a7-4abb-a8e8-f187b07ed226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:56.170791 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c4be3-11a7-4abb-a8e8-f187b07ed226 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:56.171074 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c4be3-11a7-4abb-a8e8-f187b07ed226 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:56.171380 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c4be3-11a7-4abb-a8e8-f187b07ed226 None admin] PATH_INFO: `/v3/roles/92567de587bf40dab488cc1eb666b221` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:56.172868 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c4be3-11a7-4abb-a8e8-f187b07ed226 None admin] RBAC: Authorizing `identity:get_role(role_id=92567de587bf40dab488cc1eb666b221)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:56.174230 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c4be3-11a7-4abb-a8e8-f187b07ed226 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:56.175642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 560/1120] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:35:56 2022] GET /identity/v3/roles/92567de587bf40dab488cc1eb666b221 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:56.182364 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144f4fb-0ac5-40f4-b623-ecac36794d99 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:56.280013 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144f4fb-0ac5-40f4-b623-ecac36794d99 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:56.313664 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfd266-73e1-490a-9ac0-dce1a3e4f9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:56.314530 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfd266-73e1-490a-9ac0-dce1a3e4f9ed None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:56.314813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfd266-73e1-490a-9ac0-dce1a3e4f9ed None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:56.315088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cfd266-73e1-490a-9ac0-dce1a3e4f9ed None admin] PATH_INFO: `/v3/users/f8e61a854e914e2a80c2f816f80e0649` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:56.316305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfd266-73e1-490a-9ac0-dce1a3e4f9ed None admin] RBAC: Authorizing `identity:get_user(user_id=f8e61a854e914e2a80c2f816f80e0649)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:56.317724 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cfd266-73e1-490a-9ac0-dce1a3e4f9ed None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:56.319922 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 561/1121] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:35:56 2022] GET /identity/v3/users/f8e61a854e914e2a80c2f816f80e0649 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:56.325796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c4be3-11a7-4abb-a8e8-f187b07ed226 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:56.448397 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c4be3-11a7-4abb-a8e8-f187b07ed226 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:56.462142 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:56.483226 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c28598-8255-4d40-b70d-4613cc9d274e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:56.484120 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c28598-8255-4d40-b70d-4613cc9d274e None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:56.484409 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c28598-8255-4d40-b70d-4613cc9d274e None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:56.484683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c28598-8255-4d40-b70d-4613cc9d274e None admin] PATH_INFO: `/v3/projects/57998d612a404f0abed72d2e59b14298` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:56.485862 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c28598-8255-4d40-b70d-4613cc9d274e None admin] RBAC: Authorizing `identity:get_project(project_id=57998d612a404f0abed72d2e59b14298)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:56.487311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c28598-8255-4d40-b70d-4613cc9d274e None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:56.489028 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 561/1122] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:35:56 2022] GET /identity/v3/projects/57998d612a404f0abed72d2e59b14298 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:56.495697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfd266-73e1-490a-9ac0-dce1a3e4f9ed None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:56.504665 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:56.596363 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cfd266-73e1-490a-9ac0-dce1a3e4f9ed None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:56.630741 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdc71e-6e14-4c99-a256-3025b7c60849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:56.631654 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdc71e-6e14-4c99-a256-3025b7c60849 None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:56.631934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdc71e-6e14-4c99-a256-3025b7c60849 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:56.632204 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdc71e-6e14-4c99-a256-3025b7c60849 None admin] PATH_INFO: `/v3/projects/57998d612a404f0abed72d2e59b14298/users/f8e61a854e914e2a80c2f816f80e0649/roles/92567de587bf40dab488cc1eb666b221` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:56.634396 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdc71e-6e14-4c99-a256-3025b7c60849 None admin] RBAC: Authorizing `identity:create_grant(project_id=57998d612a404f0abed72d2e59b14298, user_id=f8e61a854e914e2a80c2f816f80e0649, role_id=92567de587bf40dab488cc1eb666b221)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:56.635856 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdc71e-6e14-4c99-a256-3025b7c60849 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:56.650107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 562/1123] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:35:56 2022] PUT /identity/v3/projects/57998d612a404f0abed72d2e59b14298/users/f8e61a854e914e2a80c2f816f80e0649/roles/92567de587bf40dab488cc1eb666b221 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:35:58.681776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ee619-88a4-44d8-99a4-21f6c207c15f None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:58.682336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ee619-88a4-44d8-99a4-21f6c207c15f None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:58.682336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ee619-88a4-44d8-99a4-21f6c207c15f None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:58.683735 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 562/1124] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:35:58.689175 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e66422-228b-49fc-9918-35bee7d65d77 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:58.689647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e66422-228b-49fc-9918-35bee7d65d77 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:58.689747 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e66422-228b-49fc-9918-35bee7d65d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:58.706149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-b7e66422-228b-49fc-9918-35bee7d65d77 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:35:58.707350 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b7e66422-228b-49fc-9918-35bee7d65d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:35:58.767492 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:58.776543 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 563/1125] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:35:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:35:58.800626 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ee619-88a4-44d8-99a4-21f6c207c15f None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:58.903681 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ee619-88a4-44d8-99a4-21f6c207c15f None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:58.937856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f45dd2-cb18-4b61-b224-16bd798fc455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:58.938638 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f45dd2-cb18-4b61-b224-16bd798fc455 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:58.938926 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f45dd2-cb18-4b61-b224-16bd798fc455 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:58.939203 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f45dd2-cb18-4b61-b224-16bd798fc455 None admin] PATH_INFO: `/v3/roles/92567de587bf40dab488cc1eb666b221` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:58.940813 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f45dd2-cb18-4b61-b224-16bd798fc455 None admin] RBAC: Authorizing `identity:get_role(role_id=92567de587bf40dab488cc1eb666b221)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:58.942175 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f45dd2-cb18-4b61-b224-16bd798fc455 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:58.943634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 563/1126] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:35:58 2022] GET /identity/v3/roles/92567de587bf40dab488cc1eb666b221 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:58.949552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e66422-228b-49fc-9918-35bee7d65d77 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:59.048992 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e66422-228b-49fc-9918-35bee7d65d77 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:59.083695 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1684a-94aa-4d8e-87aa-b287b6b932e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:59.084563 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1684a-94aa-4d8e-87aa-b287b6b932e2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:59.084844 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1684a-94aa-4d8e-87aa-b287b6b932e2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:59.085112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1684a-94aa-4d8e-87aa-b287b6b932e2 None admin] PATH_INFO: `/v3/users/f8e61a854e914e2a80c2f816f80e0649` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:59.086301 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1684a-94aa-4d8e-87aa-b287b6b932e2 None admin] RBAC: Authorizing `identity:get_user(user_id=f8e61a854e914e2a80c2f816f80e0649)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:59.087760 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1684a-94aa-4d8e-87aa-b287b6b932e2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:59.089383 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 564/1127] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:35:58 2022] GET /identity/v3/users/f8e61a854e914e2a80c2f816f80e0649 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:59.095378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f45dd2-cb18-4b61-b224-16bd798fc455 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:59.144359 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:59.197192 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f45dd2-cb18-4b61-b224-16bd798fc455 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:59.231046 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46567e33-2ce8-48ee-867e-704c18b2029f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:59.231726 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46567e33-2ce8-48ee-867e-704c18b2029f None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:59.232016 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46567e33-2ce8-48ee-867e-704c18b2029f None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:59.232298 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46567e33-2ce8-48ee-867e-704c18b2029f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:59.297798 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46567e33-2ce8-48ee-867e-704c18b2029f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:59.299234 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46567e33-2ce8-48ee-867e-704c18b2029f None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:59.344722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:59.395602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 564/1128] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:35:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 20:35:59.401997 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1684a-94aa-4d8e-87aa-b287b6b932e2 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:59.463752 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:35:59.500190 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1684a-94aa-4d8e-87aa-b287b6b932e2 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:59.533457 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc03ce6-e74e-4d5c-bd28-189f0690c858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:59.534300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc03ce6-e74e-4d5c-bd28-189f0690c858 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:59.534582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc03ce6-e74e-4d5c-bd28-189f0690c858 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:59.534856 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc03ce6-e74e-4d5c-bd28-189f0690c858 None admin] PATH_INFO: `/v3/projects/57998d612a404f0abed72d2e59b14298` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:59.536078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc03ce6-e74e-4d5c-bd28-189f0690c858 None admin] RBAC: Authorizing `identity:get_project(project_id=57998d612a404f0abed72d2e59b14298)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:59.537770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc03ce6-e74e-4d5c-bd28-189f0690c858 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:59.539513 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 565/1129] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:35:59 2022] GET /identity/v3/projects/57998d612a404f0abed72d2e59b14298 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:35:59.545839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46567e33-2ce8-48ee-867e-704c18b2029f None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:35:59.643507 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46567e33-2ce8-48ee-867e-704c18b2029f None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:35:59.676422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175597a3-f97e-418d-b87c-b75a8f6f915a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:35:59.677071 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175597a3-f97e-418d-b87c-b75a8f6f915a None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:35:59.677881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175597a3-f97e-418d-b87c-b75a8f6f915a None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:35:59.678161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175597a3-f97e-418d-b87c-b75a8f6f915a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:35:59.678991 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175597a3-f97e-418d-b87c-b75a8f6f915a None admin] RBAC: Adding query filter params (role.id=92567de587bf40dab488cc1eb666b221, scope.project.id=57998d612a404f0abed72d2e59b14298, user.id=f8e61a854e914e2a80c2f816f80e0649) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:35:59.679330 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175597a3-f97e-418d-b87c-b75a8f6f915a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:35:59.680753 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175597a3-f97e-418d-b87c-b75a8f6f915a None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:35:59.686567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 565/1130] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:35:59 2022] GET /identity/v3/role_assignments?user.id=f8e61a854e914e2a80c2f816f80e0649&scope.project.id=57998d612a404f0abed72d2e59b14298&role.id=92567de587bf40dab488cc1eb666b221 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:01.757804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be993677-c346-4501-81d8-01f53260c4e6 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:01.758368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be993677-c346-4501-81d8-01f53260c4e6 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:01.758368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be993677-c346-4501-81d8-01f53260c4e6 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:01.759775 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 566/1131] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:36:01.765031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01224b5b-f7f4-488f-a7dd-2ad93a79e0bb None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:01.765447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01224b5b-f7f4-488f-a7dd-2ad93a79e0bb None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:01.765621 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01224b5b-f7f4-488f-a7dd-2ad93a79e0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:01.782136 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-01224b5b-f7f4-488f-a7dd-2ad93a79e0bb None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:36:01.783357 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-01224b5b-f7f4-488f-a7dd-2ad93a79e0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:36:01.790875 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:01.849077 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 566/1132] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:36:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:36:01.872072 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be993677-c346-4501-81d8-01f53260c4e6 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:01.975131 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be993677-c346-4501-81d8-01f53260c4e6 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:02.011622 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:02.017822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08c7bf-493c-4205-aeff-8ad5a1f12a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:02.018616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08c7bf-493c-4205-aeff-8ad5a1f12a46 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:02.018903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08c7bf-493c-4205-aeff-8ad5a1f12a46 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:02.019176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08c7bf-493c-4205-aeff-8ad5a1f12a46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:02.020381 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08c7bf-493c-4205-aeff-8ad5a1f12a46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:02.021854 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08c7bf-493c-4205-aeff-8ad5a1f12a46 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:02.023503 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 567/1133] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:36:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:02.029469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01224b5b-f7f4-488f-a7dd-2ad93a79e0bb None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:02.126634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01224b5b-f7f4-488f-a7dd-2ad93a79e0bb None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:02.160732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39df2a7-3ce7-45b5-839c-bb2400ef0262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:02.161392 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39df2a7-3ce7-45b5-839c-bb2400ef0262 None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:02.162212 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39df2a7-3ce7-45b5-839c-bb2400ef0262 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:02.162813 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39df2a7-3ce7-45b5-839c-bb2400ef0262 None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:02.163570 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39df2a7-3ce7-45b5-839c-bb2400ef0262 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:02.164995 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39df2a7-3ce7-45b5-839c-bb2400ef0262 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:02.178325 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:02.190978 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 567/1134] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jul 19 20:36:02 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:36:04.262148 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdcacb-9a1c-4e92-990a-af96a09bb117 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:04.262684 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdcacb-9a1c-4e92-990a-af96a09bb117 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:04.262805 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdcacb-9a1c-4e92-990a-af96a09bb117 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:04.264194 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 568/1135] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:36:04.270207 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31e076-8ef6-447e-9251-30f506f32ab2 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:04.270663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31e076-8ef6-447e-9251-30f506f32ab2 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:04.270795 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31e076-8ef6-447e-9251-30f506f32ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:04.287861 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-0f31e076-8ef6-447e-9251-30f506f32ab2 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:36:04.289034 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-0f31e076-8ef6-447e-9251-30f506f32ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:36:04.355842 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 568/1136] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:36:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:36:04.381350 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdcacb-9a1c-4e92-990a-af96a09bb117 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:04.482141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdcacb-9a1c-4e92-990a-af96a09bb117 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:04.515351 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392194e0-abbb-4111-a81b-b97260910a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:04.516061 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392194e0-abbb-4111-a81b-b97260910a75 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:04.516339 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392194e0-abbb-4111-a81b-b97260910a75 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:04.516610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392194e0-abbb-4111-a81b-b97260910a75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:04.517783 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392194e0-abbb-4111-a81b-b97260910a75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:04.519198 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392194e0-abbb-4111-a81b-b97260910a75 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:04.520961 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 569/1137] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:36:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:04.527418 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31e076-8ef6-447e-9251-30f506f32ab2 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:04.626215 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31e076-8ef6-447e-9251-30f506f32ab2 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:04.649931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:04.661944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b20b93e-3ef5-4570-abf1-5f8e3488036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:04.662878 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20b93e-3ef5-4570-abf1-5f8e3488036b None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:04.663160 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20b93e-3ef5-4570-abf1-5f8e3488036b None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:04.663468 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b20b93e-3ef5-4570-abf1-5f8e3488036b None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:04.664182 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20b93e-3ef5-4570-abf1-5f8e3488036b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:04.665728 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b20b93e-3ef5-4570-abf1-5f8e3488036b None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:04.685600 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 569/1138] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jul 19 20:36:04 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:36:06.795601 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a50afe-30a1-4ba3-8425-a41523be377b None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:06.796164 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a50afe-30a1-4ba3-8425-a41523be377b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:06.796164 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a50afe-30a1-4ba3-8425-a41523be377b None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:06.797530 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 570/1139] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:36:06.803034 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e3254-5544-4e63-8f81-090d706e045b None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:06.803476 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e3254-5544-4e63-8f81-090d706e045b None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:06.803710 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e3254-5544-4e63-8f81-090d706e045b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:06.821156 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-8c7e3254-5544-4e63-8f81-090d706e045b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:36:06.822354 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-8c7e3254-5544-4e63-8f81-090d706e045b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:36:06.892342 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 570/1140] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:36:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:36:06.918123 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a50afe-30a1-4ba3-8425-a41523be377b None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:06.987017 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:07.021913 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a50afe-30a1-4ba3-8425-a41523be377b None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:07.056858 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c54a8-c8a0-4aaa-b62e-1ebc4fc44317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:07.057641 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c54a8-c8a0-4aaa-b62e-1ebc4fc44317 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:07.057929 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c54a8-c8a0-4aaa-b62e-1ebc4fc44317 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:07.058205 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c54a8-c8a0-4aaa-b62e-1ebc4fc44317 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:07.069126 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c54a8-c8a0-4aaa-b62e-1ebc4fc44317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:36:07.076930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-974c54a8-c8a0-4aaa-b62e-1ebc4fc44317 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:36:07.076930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:36:07.076930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:36:07.076930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:36:07.076930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:36:07.076930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:36:07.076930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:36:07.076930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:36:07.076930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:36:07.076930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:36:07.076930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:36:07.076930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:36:07.076930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:36:07.076930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:36:07.076930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:36:07.076930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:36:07.078771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:36:07.078771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:36:07.078771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:36:07.078771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:36:07.078771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:36:07.078771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:36:07.078771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:36:07.078771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:36:07.078771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:36:07.078771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:36:07.078771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:36:07.078771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:36:07.078771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:36:07.078771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:36:07.078771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:36:07.078771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:36:07.080518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:36:07.080518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:36:07.080518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:36:07.080518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:36:07.080518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:36:07.080518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:36:07.080518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:36:07.080518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:36:07.080518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:36:07.080518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:36:07.080518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:36:07.080518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:36:07.080518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 571/1141] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:36:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:36:07.084274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e3254-5544-4e63-8f81-090d706e045b None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:07.182771 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e3254-5544-4e63-8f81-090d706e045b None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:07.193950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:07.217425 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed742232-a4d0-4f98-baa5-460108eaf80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:07.218120 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed742232-a4d0-4f98-baa5-460108eaf80b None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:07.218399 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed742232-a4d0-4f98-baa5-460108eaf80b None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:07.218668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed742232-a4d0-4f98-baa5-460108eaf80b None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:07.219433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed742232-a4d0-4f98-baa5-460108eaf80b None admin] RBAC: Adding query filter params (name=admin) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:36:07.219734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed742232-a4d0-4f98-baa5-460108eaf80b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:07.221093 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed742232-a4d0-4f98-baa5-460108eaf80b None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:07.229344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 571/1142] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:36:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:07.235323 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c54a8-c8a0-4aaa-b62e-1ebc4fc44317 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:07.336736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c54a8-c8a0-4aaa-b62e-1ebc4fc44317 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:07.361717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:07.370095 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1dda2c-8d36-436e-add2-abcf47c52027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:07.370967 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1dda2c-8d36-436e-add2-abcf47c52027 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:07.371247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1dda2c-8d36-436e-add2-abcf47c52027 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:07.371550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1dda2c-8d36-436e-add2-abcf47c52027 None admin] PATH_INFO: `/v3/users/7994304debcc42cbbf953afa5655ce0c` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:07.385244 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1dda2c-8d36-436e-add2-abcf47c52027 None admin] RBAC: Authorizing `identity:get_user(user_id=7994304debcc42cbbf953afa5655ce0c)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:07.386672 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1dda2c-8d36-436e-add2-abcf47c52027 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:07.388381 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 572/1143] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:36:07 2022] GET /identity/v3/users/7994304debcc42cbbf953afa5655ce0c => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:07.394552 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed742232-a4d0-4f98-baa5-460108eaf80b None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:07.492745 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed742232-a4d0-4f98-baa5-460108eaf80b None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:07.525531 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8224d-604e-4f83-8dab-cc7119ac81cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:07.526176 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8224d-604e-4f83-8dab-cc7119ac81cf None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:07.526459 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8224d-604e-4f83-8dab-cc7119ac81cf None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:07.526734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8224d-604e-4f83-8dab-cc7119ac81cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:07.570186 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:07.596996 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d8224d-604e-4f83-8dab-cc7119ac81cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:07.598361 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d8224d-604e-4f83-8dab-cc7119ac81cf None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:07.698752 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 572/1144] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:36:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 20:36:07.704791 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1dda2c-8d36-436e-add2-abcf47c52027 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:07.805308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1dda2c-8d36-436e-add2-abcf47c52027 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:07.838836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f8b0f-1012-474a-a6fd-75677abe0634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:07.839724 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f8b0f-1012-474a-a6fd-75677abe0634 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:07.840008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f8b0f-1012-474a-a6fd-75677abe0634 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:07.840282 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f8b0f-1012-474a-a6fd-75677abe0634 None admin] PATH_INFO: `/v3/projects/284a4c4dfa634e55a8c5cc8ef4ad9bf9` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:07.841449 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f8b0f-1012-474a-a6fd-75677abe0634 None admin] RBAC: Authorizing `identity:get_project(project_id=284a4c4dfa634e55a8c5cc8ef4ad9bf9)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:07.842865 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f8b0f-1012-474a-a6fd-75677abe0634 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:07.844581 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 573/1145] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:36:07 2022] GET /identity/v3/projects/284a4c4dfa634e55a8c5cc8ef4ad9bf9 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:07.850896 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8224d-604e-4f83-8dab-cc7119ac81cf None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:07.922610 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:07.953010 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8224d-604e-4f83-8dab-cc7119ac81cf None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:07.986543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45470f2e-cadb-4453-9d16-86fe6a8763e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:07.987301 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45470f2e-cadb-4453-9d16-86fe6a8763e5 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:07.987650 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45470f2e-cadb-4453-9d16-86fe6a8763e5 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:07.987924 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45470f2e-cadb-4453-9d16-86fe6a8763e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:07.988799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45470f2e-cadb-4453-9d16-86fe6a8763e5 None admin] RBAC: Adding query filter params (role.id=b30f01ef95004a1b84fc029830bdf053, scope.project.id=284a4c4dfa634e55a8c5cc8ef4ad9bf9, user.id=7994304debcc42cbbf953afa5655ce0c) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:36:07.989107 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45470f2e-cadb-4453-9d16-86fe6a8763e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:07.991152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45470f2e-cadb-4453-9d16-86fe6a8763e5 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:07.997290 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 573/1146] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:36:07 2022] GET /identity/v3/role_assignments?user.id=7994304debcc42cbbf953afa5655ce0c&scope.project.id=284a4c4dfa634e55a8c5cc8ef4ad9bf9&role.id=b30f01ef95004a1b84fc029830bdf053 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:10.049825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb374531-f29e-4557-ba4e-88d4bb02abc5 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:10.050350 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb374531-f29e-4557-ba4e-88d4bb02abc5 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:10.050350 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb374531-f29e-4557-ba4e-88d4bb02abc5 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:10.051760 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 574/1147] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:36:10.057636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3c67a-aea0-428c-9715-d320aef4f5e8 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:10.058049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3c67a-aea0-428c-9715-d320aef4f5e8 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:10.058182 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3c67a-aea0-428c-9715-d320aef4f5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:10.075287 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-a8b3c67a-aea0-428c-9715-d320aef4f5e8 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:36:10.076540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-a8b3c67a-aea0-428c-9715-d320aef4f5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:36:10.141785 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 574/1148] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:36:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:36:10.164253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb374531-f29e-4557-ba4e-88d4bb02abc5 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:10.221644 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:10.279196 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb374531-f29e-4557-ba4e-88d4bb02abc5 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:10.312892 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c2bb6-d7c2-49e5-842b-2c80016416c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:10.313686 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c2bb6-d7c2-49e5-842b-2c80016416c9 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:10.313966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c2bb6-d7c2-49e5-842b-2c80016416c9 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:10.314236 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c2bb6-d7c2-49e5-842b-2c80016416c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:10.324847 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c2bb6-d7c2-49e5-842b-2c80016416c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:36:10.332633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-ff7c2bb6-d7c2-49e5-842b-2c80016416c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:36:10.332633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:36:10.332633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:36:10.332633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:36:10.332633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:36:10.332633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:36:10.332633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:36:10.332633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:36:10.332633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:36:10.332633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:36:10.332633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:36:10.332633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:36:10.332633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:36:10.332633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:36:10.332633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:36:10.332633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:36:10.333781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:36:10.333781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:36:10.333781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:36:10.333781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:36:10.333781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:36:10.333781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:36:10.333781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:36:10.333781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:36:10.333781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:36:10.333781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:36:10.333781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:36:10.333781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:36:10.333781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:36:10.333781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:36:10.333781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:36:10.333781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:36:10.334744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:36:10.334744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:36:10.334744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:36:10.334744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:36:10.334744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:36:10.334744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:36:10.334744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:36:10.334744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:36:10.334744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:36:10.334744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:36:10.334744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:36:10.334744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:36:10.334744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 575/1149] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:36:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:36:10.340225 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3c67a-aea0-428c-9715-d320aef4f5e8 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:10.403163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:10.438197 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3c67a-aea0-428c-9715-d320aef4f5e8 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:10.471479 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78a4bb-2989-4e97-9ee2-7b423f11d10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:10.472147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78a4bb-2989-4e97-9ee2-7b423f11d10c None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:10.472428 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78a4bb-2989-4e97-9ee2-7b423f11d10c None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:10.472698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78a4bb-2989-4e97-9ee2-7b423f11d10c None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:10.473441 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78a4bb-2989-4e97-9ee2-7b423f11d10c None admin] RBAC: Adding query filter params (name=admin) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:36:10.473742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78a4bb-2989-4e97-9ee2-7b423f11d10c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:10.475649 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78a4bb-2989-4e97-9ee2-7b423f11d10c None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:10.483975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 575/1150] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:36:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:10.490718 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c2bb6-d7c2-49e5-842b-2c80016416c9 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:10.590680 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c2bb6-d7c2-49e5-842b-2c80016416c9 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:10.604982 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:10.626394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ad03a-77c7-4d27-a26b-b7fab682c3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:10.627334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ad03a-77c7-4d27-a26b-b7fab682c3e7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:10.627627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ad03a-77c7-4d27-a26b-b7fab682c3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:10.627900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ad03a-77c7-4d27-a26b-b7fab682c3e7 None admin] PATH_INFO: `/v3/users/7994304debcc42cbbf953afa5655ce0c` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:10.629100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ad03a-77c7-4d27-a26b-b7fab682c3e7 None admin] RBAC: Authorizing `identity:get_user(user_id=7994304debcc42cbbf953afa5655ce0c)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:10.630594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ad03a-77c7-4d27-a26b-b7fab682c3e7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:10.632274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 576/1151] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:36:10 2022] GET /identity/v3/users/7994304debcc42cbbf953afa5655ce0c => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:10.638371 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78a4bb-2989-4e97-9ee2-7b423f11d10c None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:10.738853 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78a4bb-2989-4e97-9ee2-7b423f11d10c None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:10.765389 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:10.773873 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1e92b-4c8c-41b1-b724-5b218dd972aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:10.774739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1e92b-4c8c-41b1-b724-5b218dd972aa None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:10.775020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1e92b-4c8c-41b1-b724-5b218dd972aa None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:10.775316 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1e92b-4c8c-41b1-b724-5b218dd972aa None admin] PATH_INFO: `/v3/projects/284a4c4dfa634e55a8c5cc8ef4ad9bf9` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:10.776495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1e92b-4c8c-41b1-b724-5b218dd972aa None admin] RBAC: Authorizing `identity:get_project(project_id=284a4c4dfa634e55a8c5cc8ef4ad9bf9)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:10.777911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1e92b-4c8c-41b1-b724-5b218dd972aa None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:10.779644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 576/1152] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:36:10 2022] GET /identity/v3/projects/284a4c4dfa634e55a8c5cc8ef4ad9bf9 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:10.786070 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ad03a-77c7-4d27-a26b-b7fab682c3e7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:10.886170 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ad03a-77c7-4d27-a26b-b7fab682c3e7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:10.921331 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b9dbf-f350-4f0f-bf69-18d08b551c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:10.922237 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b9dbf-f350-4f0f-bf69-18d08b551c9b None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:10.922518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b9dbf-f350-4f0f-bf69-18d08b551c9b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:10.922795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b9dbf-f350-4f0f-bf69-18d08b551c9b None admin] PATH_INFO: `/v3/projects/284a4c4dfa634e55a8c5cc8ef4ad9bf9/users/7994304debcc42cbbf953afa5655ce0c/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:10.924794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b9dbf-f350-4f0f-bf69-18d08b551c9b None admin] RBAC: Authorizing `identity:create_grant(project_id=284a4c4dfa634e55a8c5cc8ef4ad9bf9, user_id=7994304debcc42cbbf953afa5655ce0c, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:10.926232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b9dbf-f350-4f0f-bf69-18d08b551c9b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:10.940194 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 577/1153] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:36:10 2022] PUT /identity/v3/projects/284a4c4dfa634e55a8c5cc8ef4ad9bf9/users/7994304debcc42cbbf953afa5655ce0c/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:36:13.040522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d398914-c483-4f4d-a389-9642f6f05461 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:13.041053 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d398914-c483-4f4d-a389-9642f6f05461 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:13.041174 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d398914-c483-4f4d-a389-9642f6f05461 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:13.042562 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 577/1154] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:36:13.048199 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa5ca9-0c9a-4c89-a9cc-ab2025da430b None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:13.048649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa5ca9-0c9a-4c89-a9cc-ab2025da430b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:13.048831 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa5ca9-0c9a-4c89-a9cc-ab2025da430b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:13.065475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-7afa5ca9-0c9a-4c89-a9cc-ab2025da430b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:36:13.066663 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7afa5ca9-0c9a-4c89-a9cc-ab2025da430b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:36:13.102143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:13.134477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 578/1155] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:36:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:36:13.158168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d398914-c483-4f4d-a389-9642f6f05461 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:13.271565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d398914-c483-4f4d-a389-9642f6f05461 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:13.305070 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75521613-9b04-441a-84d9-fce601e4983c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:13.305862 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75521613-9b04-441a-84d9-fce601e4983c None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:13.306146 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75521613-9b04-441a-84d9-fce601e4983c None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:13.306418 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75521613-9b04-441a-84d9-fce601e4983c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:13.316463 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75521613-9b04-441a-84d9-fce601e4983c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:36:13.328548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-75521613-9b04-441a-84d9-fce601e4983c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:36:13.328548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:36:13.328548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:36:13.328548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:36:13.328548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:36:13.328548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:36:13.328548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:36:13.328548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:36:13.328548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:36:13.328548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:36:13.328548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:36:13.328548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:36:13.328548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:36:13.328548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:36:13.328548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:36:13.328548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:36:13.329693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:36:13.329693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:36:13.329693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:36:13.329693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:36:13.329693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:36:13.329693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:36:13.329693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:36:13.329693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:36:13.329693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:36:13.329693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:36:13.329693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:36:13.329693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:36:13.329693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:36:13.329693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:36:13.329693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:36:13.329693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:36:13.330999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:36:13.330999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:36:13.330999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:36:13.330999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:36:13.330999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:36:13.330999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:36:13.330999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:36:13.330999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:36:13.330999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:36:13.330999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:36:13.330999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:36:13.330999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:36:13.330999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 578/1156] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:36:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:36:13.336057 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa5ca9-0c9a-4c89-a9cc-ab2025da430b None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:13.433310 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa5ca9-0c9a-4c89-a9cc-ab2025da430b None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:13.467558 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd08921-55e6-4d8b-85f6-922dd07d7ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:13.468217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd08921-55e6-4d8b-85f6-922dd07d7ad7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:13.468496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd08921-55e6-4d8b-85f6-922dd07d7ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:13.468769 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd08921-55e6-4d8b-85f6-922dd07d7ad7 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:13.469510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd08921-55e6-4d8b-85f6-922dd07d7ad7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:36:13.469813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd08921-55e6-4d8b-85f6-922dd07d7ad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:13.471301 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd08921-55e6-4d8b-85f6-922dd07d7ad7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:13.480126 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 579/1157] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:36:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:13.485978 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75521613-9b04-441a-84d9-fce601e4983c None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:13.542244 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:13.586090 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75521613-9b04-441a-84d9-fce601e4983c None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:13.619833 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796f17f-6559-4616-8aa9-c3706ac007e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:13.620707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796f17f-6559-4616-8aa9-c3706ac007e3 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:13.620992 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796f17f-6559-4616-8aa9-c3706ac007e3 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:13.621266 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796f17f-6559-4616-8aa9-c3706ac007e3 None admin] PATH_INFO: `/v3/users/7994304debcc42cbbf953afa5655ce0c` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:13.622453 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796f17f-6559-4616-8aa9-c3706ac007e3 None admin] RBAC: Authorizing `identity:get_user(user_id=7994304debcc42cbbf953afa5655ce0c)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:13.623918 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796f17f-6559-4616-8aa9-c3706ac007e3 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:13.625556 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 579/1158] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:36:13 2022] GET /identity/v3/users/7994304debcc42cbbf953afa5655ce0c => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:13.631695 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd08921-55e6-4d8b-85f6-922dd07d7ad7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:13.666914 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:13.731791 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd08921-55e6-4d8b-85f6-922dd07d7ad7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:13.778364 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf70a8-9b1e-4add-bfbe-45e43cbb0e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:13.779370 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf70a8-9b1e-4add-bfbe-45e43cbb0e37 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:13.779810 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf70a8-9b1e-4add-bfbe-45e43cbb0e37 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:13.780242 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf70a8-9b1e-4add-bfbe-45e43cbb0e37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:13.857313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf70a8-9b1e-4add-bfbe-45e43cbb0e37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:13.858746 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf70a8-9b1e-4add-bfbe-45e43cbb0e37 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:13.890149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:13.955853 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 580/1159] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:36:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 20:36:13.962482 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796f17f-6559-4616-8aa9-c3706ac007e3 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:14.061411 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796f17f-6559-4616-8aa9-c3706ac007e3 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:14.084266 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:14.095427 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81d3c7-b7c8-444a-9c01-5f81f108e5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:14.096335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81d3c7-b7c8-444a-9c01-5f81f108e5f1 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:14.096662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81d3c7-b7c8-444a-9c01-5f81f108e5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:14.096980 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81d3c7-b7c8-444a-9c01-5f81f108e5f1 None admin] PATH_INFO: `/v3/projects/284a4c4dfa634e55a8c5cc8ef4ad9bf9` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:14.098213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81d3c7-b7c8-444a-9c01-5f81f108e5f1 None admin] RBAC: Authorizing `identity:get_project(project_id=284a4c4dfa634e55a8c5cc8ef4ad9bf9)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:14.099748 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81d3c7-b7c8-444a-9c01-5f81f108e5f1 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:14.101468 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 580/1160] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:36:13 2022] GET /identity/v3/projects/284a4c4dfa634e55a8c5cc8ef4ad9bf9 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:14.107760 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf70a8-9b1e-4add-bfbe-45e43cbb0e37 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:14.206722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf70a8-9b1e-4add-bfbe-45e43cbb0e37 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:14.239455 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa14d6-c99a-43bc-a966-59ad718b3ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:14.240148 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa14d6-c99a-43bc-a966-59ad718b3ba4 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:14.240428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa14d6-c99a-43bc-a966-59ad718b3ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:14.240699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa14d6-c99a-43bc-a966-59ad718b3ba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:14.241617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa14d6-c99a-43bc-a966-59ad718b3ba4 None admin] RBAC: Adding query filter params (role.id=b30f01ef95004a1b84fc029830bdf053, scope.project.id=284a4c4dfa634e55a8c5cc8ef4ad9bf9, user.id=7994304debcc42cbbf953afa5655ce0c) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:36:14.241927 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa14d6-c99a-43bc-a966-59ad718b3ba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:14.243361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa14d6-c99a-43bc-a966-59ad718b3ba4 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:14.245136 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:14.250168 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 581/1161] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:36:14 2022] GET /identity/v3/role_assignments?user.id=7994304debcc42cbbf953afa5655ce0c&scope.project.id=284a4c4dfa634e55a8c5cc8ef4ad9bf9&role.id=b30f01ef95004a1b84fc029830bdf053 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:16.325604 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7d150-dda3-4964-8a74-4b5d4e8668fd None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:16.326133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7d150-dda3-4964-8a74-4b5d4e8668fd None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:16.326133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7d150-dda3-4964-8a74-4b5d4e8668fd None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:16.327571 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 581/1162] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:36:16.332928 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f584b-606f-4d95-918a-737ce69fe285 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:16.333374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f584b-606f-4d95-918a-737ce69fe285 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:16.333499 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f584b-606f-4d95-918a-737ce69fe285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:16.351297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-e29f584b-606f-4d95-918a-737ce69fe285 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:36:16.352972 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e29f584b-606f-4d95-918a-737ce69fe285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:36:16.422149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 582/1163] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:36:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 20:36:16.445011 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7d150-dda3-4964-8a74-4b5d4e8668fd None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:16.547445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7d150-dda3-4964-8a74-4b5d4e8668fd None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:16.582440 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e12581-6317-44b7-a7f6-3bbf1a0f4bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:16.583024 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e12581-6317-44b7-a7f6-3bbf1a0f4bd8 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:16.583445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e12581-6317-44b7-a7f6-3bbf1a0f4bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:16.583630 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e12581-6317-44b7-a7f6-3bbf1a0f4bd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:16.640823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:16.651123 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e12581-6317-44b7-a7f6-3bbf1a0f4bd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:16.652607 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e12581-6317-44b7-a7f6-3bbf1a0f4bd8 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:16.748645 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 582/1164] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:36:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 20:36:16.754711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f584b-606f-4d95-918a-737ce69fe285 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:16.853883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f584b-606f-4d95-918a-737ce69fe285 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:16.879488 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:16.888582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394204f2-5d98-46b9-af50-a15fc4f40619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:16.889395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394204f2-5d98-46b9-af50-a15fc4f40619 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:16.889686 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394204f2-5d98-46b9-af50-a15fc4f40619 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:16.889960 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394204f2-5d98-46b9-af50-a15fc4f40619 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:16.897387 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394204f2-5d98-46b9-af50-a15fc4f40619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:16.898835 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394204f2-5d98-46b9-af50-a15fc4f40619 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:16.913973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-394204f2-5d98-46b9-af50-a15fc4f40619 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 19 20:36:16.913973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:36:16.913973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 20:36:16.913973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 20:36:16.913973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:36:16.913973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:36:16.913973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:36:16.913973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:36:16.913973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 19 20:36:16.913973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:36:16.913973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:36:16.913973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:36:16.913973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:36:16.913973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:36:16.913973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:36:16.913973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:36:16.913973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:36:16.915075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:36:16.915075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:36:16.915075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:36:16.915075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:36:16.915075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:36:16.915075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:36:16.915075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:36:16.915075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:36:16.915075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:36:16.915075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:36:16.915075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:36:16.915075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:36:16.915075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:36:16.915075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:36:16.915075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:36:16.915075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:36:16.916766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:36:16.916766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:36:16.916766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:36:16.916766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:36:16.916766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:36:16.916766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:36:16.916766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:36:16.916766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:36:16.916766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:36:16.916766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:36:16.916766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 20:36:16.916766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:36:16.916766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 19 20:36:16.916766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:36:16.916766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 583/1165] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Jul 19 20:36:16 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:36:16.922347 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e12581-6317-44b7-a7f6-3bbf1a0f4bd8 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:17.012909 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:17.022427 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e12581-6317-44b7-a7f6-3bbf1a0f4bd8 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:17.056365 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188b66d-9fb0-48d1-b137-a234fce68c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:17.057046 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188b66d-9fb0-48d1-b137-a234fce68c19 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:17.057361 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188b66d-9fb0-48d1-b137-a234fce68c19 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:17.057658 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188b66d-9fb0-48d1-b137-a234fce68c19 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:17.058370 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188b66d-9fb0-48d1-b137-a234fce68c19 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:36:17.058692 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188b66d-9fb0-48d1-b137-a234fce68c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:17.060234 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188b66d-9fb0-48d1-b137-a234fce68c19 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:17.067793 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 583/1166] 10.222.0.77 () {56 vars in 1115 bytes} [Tue Jul 19 20:36:16 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:19.115977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58b685-c041-4a82-b586-506c0af7b7db None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:19.116805 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58b685-c041-4a82-b586-506c0af7b7db None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:19.116962 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58b685-c041-4a82-b586-506c0af7b7db None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:19.118353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 584/1167] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:36:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:36:19.123792 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0f9ab-7b04-4dd0-81b6-685a95506e2e None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:19.124215 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0f9ab-7b04-4dd0-81b6-685a95506e2e None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:19.124350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0f9ab-7b04-4dd0-81b6-685a95506e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:19.141224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-62a0f9ab-7b04-4dd0-81b6-685a95506e2e None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:36:19.142351 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-62a0f9ab-7b04-4dd0-81b6-685a95506e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:36:19.209375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 584/1168] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:36:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:36:19.232958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58b685-c041-4a82-b586-506c0af7b7db None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:19.337056 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58b685-c041-4a82-b586-506c0af7b7db None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:19.369366 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca45a9-7557-4783-892c-3f18aa431a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:19.370015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca45a9-7557-4783-892c-3f18aa431a2d None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:19.370298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca45a9-7557-4783-892c-3f18aa431a2d None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:19.370571 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca45a9-7557-4783-892c-3f18aa431a2d None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:19.371335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca45a9-7557-4783-892c-3f18aa431a2d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:19.372696 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca45a9-7557-4783-892c-3f18aa431a2d None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:19.387122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 585/1169] 10.222.0.77 () {60 vars in 1138 bytes} [Tue Jul 19 20:36:19 2022] POST /identity/v3/domains => generated 267 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:36:21.452108 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0aa8fa-f654-4de6-a4ab-ac67c378aa5c None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:21.452647 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0aa8fa-f654-4de6-a4ab-ac67c378aa5c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:21.452763 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0aa8fa-f654-4de6-a4ab-ac67c378aa5c None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:21.454203 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 585/1170] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:36:21.459584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c410a6-f92d-4ceb-9d36-54a32f71beb3 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:21.460007 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c410a6-f92d-4ceb-9d36-54a32f71beb3 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:21.460135 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c410a6-f92d-4ceb-9d36-54a32f71beb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:21.477897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-18c410a6-f92d-4ceb-9d36-54a32f71beb3 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:36:21.479084 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-18c410a6-f92d-4ceb-9d36-54a32f71beb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:36:21.525059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:21.548996 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 586/1171] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:36:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:36:21.573222 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0aa8fa-f654-4de6-a4ab-ac67c378aa5c None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:21.670082 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:21.688519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0aa8fa-f654-4de6-a4ab-ac67c378aa5c None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:21.721107 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c6063-d87b-46fe-8a14-3a390698cb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:21.721965 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c6063-d87b-46fe-8a14-3a390698cb2a None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:21.722243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c6063-d87b-46fe-8a14-3a390698cb2a None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:21.722514 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c6063-d87b-46fe-8a14-3a390698cb2a None admin] PATH_INFO: `/v3/domains/85903f8a99b8467092afda1148b82de2` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:21.733111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c6063-d87b-46fe-8a14-3a390698cb2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=85903f8a99b8467092afda1148b82de2)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:21.734528 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c6063-d87b-46fe-8a14-3a390698cb2a None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:21.736228 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 586/1172] 10.222.0.77 () {56 vars in 1183 bytes} [Tue Jul 19 20:36:21 2022] GET /identity/v3/domains/85903f8a99b8467092afda1148b82de2 => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:21.743356 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c410a6-f92d-4ceb-9d36-54a32f71beb3 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:21.837740 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c410a6-f92d-4ceb-9d36-54a32f71beb3 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:21.871515 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21bcfa-df9d-48d0-9d1b-99682397afea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:21.872158 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21bcfa-df9d-48d0-9d1b-99682397afea None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:21.872437 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21bcfa-df9d-48d0-9d1b-99682397afea None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:21.872706 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21bcfa-df9d-48d0-9d1b-99682397afea None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:21.873396 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21bcfa-df9d-48d0-9d1b-99682397afea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:21.874811 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21bcfa-df9d-48d0-9d1b-99682397afea None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:21.899567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 587/1173] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jul 19 20:36:21 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:36:23.962780 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da569b5-1d61-46ea-a4a9-9d8fab275339 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:23.963361 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da569b5-1d61-46ea-a4a9-9d8fab275339 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:23.963361 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da569b5-1d61-46ea-a4a9-9d8fab275339 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:23.964732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 587/1174] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:36:23.969918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612bf8f-9973-4110-98d5-5e02baabf301 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:23.970339 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612bf8f-9973-4110-98d5-5e02baabf301 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:23.970475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612bf8f-9973-4110-98d5-5e02baabf301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:23.987355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-8612bf8f-9973-4110-98d5-5e02baabf301 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:36:23.988541 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-8612bf8f-9973-4110-98d5-5e02baabf301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:36:24.011948 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:24.058141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 588/1175] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:36:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:36:24.082023 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da569b5-1d61-46ea-a4a9-9d8fab275339 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:24.183685 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da569b5-1d61-46ea-a4a9-9d8fab275339 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:24.217403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde9378-cc22-4209-af90-1df967ce3aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:24.218251 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde9378-cc22-4209-af90-1df967ce3aad None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:24.218532 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde9378-cc22-4209-af90-1df967ce3aad None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:24.218802 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde9378-cc22-4209-af90-1df967ce3aad None admin] PATH_INFO: `/v3/domains/85903f8a99b8467092afda1148b82de2` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:24.220188 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde9378-cc22-4209-af90-1df967ce3aad None admin] RBAC: Authorizing `identity:get_domain(domain_id=85903f8a99b8467092afda1148b82de2)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:24.221606 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde9378-cc22-4209-af90-1df967ce3aad None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:24.223212 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 588/1176] 10.222.0.77 () {56 vars in 1183 bytes} [Tue Jul 19 20:36:24 2022] GET /identity/v3/domains/85903f8a99b8467092afda1148b82de2 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:24.229201 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612bf8f-9973-4110-98d5-5e02baabf301 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:24.325603 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612bf8f-9973-4110-98d5-5e02baabf301 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:24.358430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c5777-29ba-4288-8dd8-1ff40758d67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:24.359099 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c5777-29ba-4288-8dd8-1ff40758d67f None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:24.359413 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c5777-29ba-4288-8dd8-1ff40758d67f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:24.359690 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c5777-29ba-4288-8dd8-1ff40758d67f None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:24.360388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c5777-29ba-4288-8dd8-1ff40758d67f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:24.361801 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c5777-29ba-4288-8dd8-1ff40758d67f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:24.382073 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 589/1177] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jul 19 20:36:24 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:36:26.496963 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00736b1-b998-4653-bcab-cd9c6ec11d36 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:26.497524 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00736b1-b998-4653-bcab-cd9c6ec11d36 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:26.497524 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00736b1-b998-4653-bcab-cd9c6ec11d36 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:26.498862 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 589/1178] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:36:26.504104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec1844-0fa9-42a8-8c1b-ee4e87fa1caa None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:26.504502 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec1844-0fa9-42a8-8c1b-ee4e87fa1caa None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:26.504670 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec1844-0fa9-42a8-8c1b-ee4e87fa1caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:26.522286 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-f0ec1844-0fa9-42a8-8c1b-ee4e87fa1caa None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:36:26.523513 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-f0ec1844-0fa9-42a8-8c1b-ee4e87fa1caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:36:26.533984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:26.591202 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 590/1179] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:36:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 20:36:26.614197 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00736b1-b998-4653-bcab-cd9c6ec11d36 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:26.630108 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:26.715520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00736b1-b998-4653-bcab-cd9c6ec11d36 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:26.747779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d8eb0-4012-44a1-a5af-1c81fa2fc677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:26.748497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d8eb0-4012-44a1-a5af-1c81fa2fc677 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:26.748778 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d8eb0-4012-44a1-a5af-1c81fa2fc677 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:26.749051 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d8eb0-4012-44a1-a5af-1c81fa2fc677 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:26.759123 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d8eb0-4012-44a1-a5af-1c81fa2fc677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:36:26.767447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-2b5d8eb0-4012-44a1-a5af-1c81fa2fc677 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:36:26.767447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:36:26.767447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:36:26.767447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:36:26.767447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:36:26.767447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:36:26.767447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:36:26.767447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:36:26.767447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:36:26.767447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:36:26.767447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:36:26.767447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:36:26.767447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:36:26.767447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:36:26.767447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:36:26.767447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:36:26.768663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:36:26.768663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:36:26.768663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:36:26.768663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:36:26.768663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:36:26.768663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:36:26.768663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:36:26.768663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:36:26.768663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:36:26.768663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:36:26.768663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:36:26.768663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:36:26.768663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:36:26.768663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:36:26.768663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:36:26.768663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:36:26.769968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:36:26.769968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:36:26.769968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:36:26.769968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:36:26.769968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:36:26.769968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:36:26.769968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:36:26.769968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:36:26.769968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:36:26.769968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:36:26.769968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:36:26.769968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:36:26.769968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 590/1180] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:36:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:36:26.775464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec1844-0fa9-42a8-8c1b-ee4e87fa1caa None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:26.875846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec1844-0fa9-42a8-8c1b-ee4e87fa1caa None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:26.909948 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f707ee-b679-4f67-9bac-eee7c63261d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:26.910611 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f707ee-b679-4f67-9bac-eee7c63261d2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:26.910898 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f707ee-b679-4f67-9bac-eee7c63261d2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:26.911176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f707ee-b679-4f67-9bac-eee7c63261d2 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:26.912492 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f707ee-b679-4f67-9bac-eee7c63261d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:36:26.912801 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f707ee-b679-4f67-9bac-eee7c63261d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:26.914406 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f707ee-b679-4f67-9bac-eee7c63261d2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:26.922285 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 591/1181] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:36:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:26.928646 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d8eb0-4012-44a1-a5af-1c81fa2fc677 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:27.001898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:27.025855 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d8eb0-4012-44a1-a5af-1c81fa2fc677 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:27.059079 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5ffd2-442c-4d4f-ad7e-479e895c8fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:27.059971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5ffd2-442c-4d4f-ad7e-479e895c8fa3 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:27.060255 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5ffd2-442c-4d4f-ad7e-479e895c8fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:27.060527 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5ffd2-442c-4d4f-ad7e-479e895c8fa3 None admin] PATH_INFO: `/v3/users/cd34a89c707846f194cfd9246ad6ffe1` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:27.073345 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5ffd2-442c-4d4f-ad7e-479e895c8fa3 None admin] RBAC: Authorizing `identity:get_user(user_id=cd34a89c707846f194cfd9246ad6ffe1)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:27.074770 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5ffd2-442c-4d4f-ad7e-479e895c8fa3 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:27.076423 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 591/1182] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:36:26 2022] GET /identity/v3/users/cd34a89c707846f194cfd9246ad6ffe1 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:27.082114 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f707ee-b679-4f67-9bac-eee7c63261d2 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:27.093267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:27.185127 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f707ee-b679-4f67-9bac-eee7c63261d2 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:27.216885 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c667e05-bf7e-4a2d-a194-f25e390a3741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:27.217524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c667e05-bf7e-4a2d-a194-f25e390a3741 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:27.217806 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c667e05-bf7e-4a2d-a194-f25e390a3741 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:27.218137 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c667e05-bf7e-4a2d-a194-f25e390a3741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:27.283457 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c667e05-bf7e-4a2d-a194-f25e390a3741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:27.284820 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c667e05-bf7e-4a2d-a194-f25e390a3741 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:27.294786 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:27.382756 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 592/1183] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:36:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 20:36:27.388710 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5ffd2-442c-4d4f-ad7e-479e895c8fa3 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:27.491000 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5ffd2-442c-4d4f-ad7e-479e895c8fa3 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:27.521728 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:27.527402 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a8416-bfeb-4dad-9297-23ae385c9e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:27.528274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a8416-bfeb-4dad-9297-23ae385c9e5a None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:27.528561 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a8416-bfeb-4dad-9297-23ae385c9e5a None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:27.528836 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a8416-bfeb-4dad-9297-23ae385c9e5a None admin] PATH_INFO: `/v3/projects/9f998910be0d43a282050fddb9de39b5` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:27.530009 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a8416-bfeb-4dad-9297-23ae385c9e5a None admin] RBAC: Authorizing `identity:get_project(project_id=9f998910be0d43a282050fddb9de39b5)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:27.531466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a8416-bfeb-4dad-9297-23ae385c9e5a None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:27.533193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 592/1184] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:36:27 2022] GET /identity/v3/projects/9f998910be0d43a282050fddb9de39b5 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:27.540259 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c667e05-bf7e-4a2d-a194-f25e390a3741 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:27.636184 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c667e05-bf7e-4a2d-a194-f25e390a3741 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:27.645200 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:27.670048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce836c8-d298-4ff9-ad06-c53c39ba9f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:27.670690 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce836c8-d298-4ff9-ad06-c53c39ba9f27 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:27.670974 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce836c8-d298-4ff9-ad06-c53c39ba9f27 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:27.671251 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce836c8-d298-4ff9-ad06-c53c39ba9f27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:27.672095 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce836c8-d298-4ff9-ad06-c53c39ba9f27 None admin] RBAC: Adding query filter params (role.id=b30f01ef95004a1b84fc029830bdf053, scope.project.id=9f998910be0d43a282050fddb9de39b5, user.id=cd34a89c707846f194cfd9246ad6ffe1) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:36:27.672407 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce836c8-d298-4ff9-ad06-c53c39ba9f27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:27.673816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce836c8-d298-4ff9-ad06-c53c39ba9f27 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:27.679153 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 593/1185] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:36:27 2022] GET /identity/v3/role_assignments?user.id=cd34a89c707846f194cfd9246ad6ffe1&scope.project.id=9f998910be0d43a282050fddb9de39b5&role.id=b30f01ef95004a1b84fc029830bdf053 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:29.673641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d3e88-4d1c-4220-948b-82a7a41c3696 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:29.674195 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d3e88-4d1c-4220-948b-82a7a41c3696 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:29.674195 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d3e88-4d1c-4220-948b-82a7a41c3696 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:29.675597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 593/1186] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:36:29.681301 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645893db-d26f-45cb-b337-8155319a0aea None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:29.681715 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645893db-d26f-45cb-b337-8155319a0aea None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:29.681861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645893db-d26f-45cb-b337-8155319a0aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:29.699047 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-645893db-d26f-45cb-b337-8155319a0aea None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:36:29.700310 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-645893db-d26f-45cb-b337-8155319a0aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:36:29.764128 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 594/1187] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:36:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:36:29.787645 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d3e88-4d1c-4220-948b-82a7a41c3696 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:29.886363 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d3e88-4d1c-4220-948b-82a7a41c3696 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:29.919416 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311e103-f426-49b5-b755-c0636a7cab84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:29.920202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311e103-f426-49b5-b755-c0636a7cab84 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:29.920480 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311e103-f426-49b5-b755-c0636a7cab84 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:29.920751 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311e103-f426-49b5-b755-c0636a7cab84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:29.931083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311e103-f426-49b5-b755-c0636a7cab84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:36:29.938588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-4311e103-f426-49b5-b755-c0636a7cab84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:36:29.938588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:36:29.938588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:36:29.938588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:36:29.938588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:36:29.938588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:36:29.938588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:36:29.938588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:36:29.938588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:36:29.938588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:36:29.938588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:36:29.938588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:36:29.938588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:36:29.938588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:36:29.938588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:36:29.938588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:36:29.939717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:36:29.939717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:36:29.939717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:36:29.939717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:36:29.939717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:36:29.939717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:36:29.939717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:36:29.939717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:36:29.939717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:36:29.939717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:36:29.939717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:36:29.939717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:36:29.939717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:36:29.939717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:36:29.939717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:36:29.939717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:36:29.940668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:36:29.940668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:36:29.940668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:36:29.940668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:36:29.940668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:36:29.940668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:36:29.940668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:36:29.940668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:36:29.940668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:36:29.940668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:36:29.940668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:36:29.940668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:36:29.940668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 594/1188] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:36:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:36:29.945815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645893db-d26f-45cb-b337-8155319a0aea None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:30.041461 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645893db-d26f-45cb-b337-8155319a0aea None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:30.042902 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:30.074445 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e610c-dd3b-40aa-8dd3-2b06c871a76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:30.075092 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e610c-dd3b-40aa-8dd3-2b06c871a76a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:30.075400 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e610c-dd3b-40aa-8dd3-2b06c871a76a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:30.075673 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e610c-dd3b-40aa-8dd3-2b06c871a76a None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:30.076404 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e610c-dd3b-40aa-8dd3-2b06c871a76a None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:36:30.076706 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e610c-dd3b-40aa-8dd3-2b06c871a76a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:30.078047 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e610c-dd3b-40aa-8dd3-2b06c871a76a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:30.085948 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 595/1189] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:36:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:30.091799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311e103-f426-49b5-b755-c0636a7cab84 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:30.150752 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:30.192859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311e103-f426-49b5-b755-c0636a7cab84 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:30.225142 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b5e94-8f6a-4c3a-a1b2-b2f18a77ac24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:30.225979 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b5e94-8f6a-4c3a-a1b2-b2f18a77ac24 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:30.226258 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b5e94-8f6a-4c3a-a1b2-b2f18a77ac24 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:30.226527 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b5e94-8f6a-4c3a-a1b2-b2f18a77ac24 None admin] PATH_INFO: `/v3/users/cd34a89c707846f194cfd9246ad6ffe1` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:30.227732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b5e94-8f6a-4c3a-a1b2-b2f18a77ac24 None admin] RBAC: Authorizing `identity:get_user(user_id=cd34a89c707846f194cfd9246ad6ffe1)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:30.229151 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b5e94-8f6a-4c3a-a1b2-b2f18a77ac24 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:30.230757 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 595/1190] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:36:30 2022] GET /identity/v3/users/cd34a89c707846f194cfd9246ad6ffe1 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:30.236920 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e610c-dd3b-40aa-8dd3-2b06c871a76a None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:30.334641 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e610c-dd3b-40aa-8dd3-2b06c871a76a None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:30.366906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453280ad-8ad8-49c6-9332-b95f2a6f392f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:30.367779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453280ad-8ad8-49c6-9332-b95f2a6f392f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:30.368089 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453280ad-8ad8-49c6-9332-b95f2a6f392f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:30.368386 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453280ad-8ad8-49c6-9332-b95f2a6f392f None admin] PATH_INFO: `/v3/projects/9f998910be0d43a282050fddb9de39b5` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:30.369613 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453280ad-8ad8-49c6-9332-b95f2a6f392f None admin] RBAC: Authorizing `identity:get_project(project_id=9f998910be0d43a282050fddb9de39b5)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:30.371066 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453280ad-8ad8-49c6-9332-b95f2a6f392f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:30.372764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 596/1191] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:36:30 2022] GET /identity/v3/projects/9f998910be0d43a282050fddb9de39b5 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:30.378809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b5e94-8f6a-4c3a-a1b2-b2f18a77ac24 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:30.476236 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b5e94-8f6a-4c3a-a1b2-b2f18a77ac24 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:30.500748 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:30.508497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f706c8-874b-4eb2-97af-976f465c9c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:30.509373 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f706c8-874b-4eb2-97af-976f465c9c5e None admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:30.509651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f706c8-874b-4eb2-97af-976f465c9c5e None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:30.509922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f706c8-874b-4eb2-97af-976f465c9c5e None admin] PATH_INFO: `/v3/projects/9f998910be0d43a282050fddb9de39b5/users/cd34a89c707846f194cfd9246ad6ffe1/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:30.511890 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f706c8-874b-4eb2-97af-976f465c9c5e None admin] RBAC: Authorizing `identity:create_grant(project_id=9f998910be0d43a282050fddb9de39b5, user_id=cd34a89c707846f194cfd9246ad6ffe1, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:30.513305 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f706c8-874b-4eb2-97af-976f465c9c5e None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:30.525995 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 596/1192] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:36:30 2022] PUT /identity/v3/projects/9f998910be0d43a282050fddb9de39b5/users/cd34a89c707846f194cfd9246ad6ffe1/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:36:32.553767 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3099ff-c81d-4d5a-9a35-75c2423a2a72 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:32.554331 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3099ff-c81d-4d5a-9a35-75c2423a2a72 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:32.554331 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3099ff-c81d-4d5a-9a35-75c2423a2a72 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:32.555747 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 597/1193] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:36:32.561315 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425c713-ff0d-427f-a4d3-2369d4d8d0f3 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:32.561716 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425c713-ff0d-427f-a4d3-2369d4d8d0f3 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:32.561874 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3425c713-ff0d-427f-a4d3-2369d4d8d0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:32.578811 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-3425c713-ff0d-427f-a4d3-2369d4d8d0f3 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:36:32.580112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-3425c713-ff0d-427f-a4d3-2369d4d8d0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:36:32.645863 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 597/1194] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:36:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 20:36:32.670665 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3099ff-c81d-4d5a-9a35-75c2423a2a72 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:32.701024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:32.774692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3099ff-c81d-4d5a-9a35-75c2423a2a72 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:32.807755 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264a669-410e-44f7-bc0c-7fd31a7564be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:32.808473 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264a669-410e-44f7-bc0c-7fd31a7564be None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:32.808751 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264a669-410e-44f7-bc0c-7fd31a7564be None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:32.809019 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264a669-410e-44f7-bc0c-7fd31a7564be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:32.819042 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264a669-410e-44f7-bc0c-7fd31a7564be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:36:32.826590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-e264a669-410e-44f7-bc0c-7fd31a7564be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:36:32.826590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:36:32.826590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:36:32.826590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:36:32.826590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:36:32.826590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:36:32.826590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:36:32.826590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:36:32.826590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:36:32.826590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:36:32.826590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:36:32.826590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:36:32.826590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:36:32.826590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:36:32.826590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:36:32.826590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:36:32.827722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:36:32.827722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:36:32.827722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:36:32.827722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:36:32.827722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:36:32.827722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:36:32.827722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:36:32.827722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:36:32.827722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:36:32.827722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:36:32.827722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:36:32.827722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:36:32.827722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:36:32.827722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:36:32.827722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:36:32.827722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:36:32.828784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:36:32.828784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:36:32.828784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:36:32.828784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:36:32.828784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:36:32.828784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:36:32.828784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:36:32.828784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:36:32.828784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:36:32.828784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:36:32.828784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:36:32.828784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:36:32.828784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 598/1195] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:36:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:36:32.834614 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425c713-ff0d-427f-a4d3-2369d4d8d0f3 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:32.931820 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3425c713-ff0d-427f-a4d3-2369d4d8d0f3 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:32.948668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:32.966156 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3e87f-f2df-48cd-8309-65b2038caae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:32.966829 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3e87f-f2df-48cd-8309-65b2038caae5 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:32.967113 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3e87f-f2df-48cd-8309-65b2038caae5 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:32.967429 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3e87f-f2df-48cd-8309-65b2038caae5 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:32.968178 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3e87f-f2df-48cd-8309-65b2038caae5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:36:32.968486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3e87f-f2df-48cd-8309-65b2038caae5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:32.969849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3e87f-f2df-48cd-8309-65b2038caae5 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:32.978319 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 598/1196] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:36:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:32.984239 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264a669-410e-44f7-bc0c-7fd31a7564be None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:33.073157 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:33.081816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264a669-410e-44f7-bc0c-7fd31a7564be None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:33.114633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ecba4-8af5-4f8e-b009-a45ae62f5a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:33.116113 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ecba4-8af5-4f8e-b009-a45ae62f5a9c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:33.116396 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ecba4-8af5-4f8e-b009-a45ae62f5a9c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:33.116671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ecba4-8af5-4f8e-b009-a45ae62f5a9c None admin] PATH_INFO: `/v3/users/cd34a89c707846f194cfd9246ad6ffe1` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:33.117843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ecba4-8af5-4f8e-b009-a45ae62f5a9c None admin] RBAC: Authorizing `identity:get_user(user_id=cd34a89c707846f194cfd9246ad6ffe1)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:33.119279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ecba4-8af5-4f8e-b009-a45ae62f5a9c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:33.120890 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 599/1197] 10.222.0.77 () {56 vars in 1177 bytes} [Tue Jul 19 20:36:32 2022] GET /identity/v3/users/cd34a89c707846f194cfd9246ad6ffe1 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:33.126585 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3e87f-f2df-48cd-8309-65b2038caae5 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:33.223026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3e87f-f2df-48cd-8309-65b2038caae5 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:33.256403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276bdd6-d34e-4381-b2da-f4826eda4c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:33.257038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276bdd6-d34e-4381-b2da-f4826eda4c12 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:33.257321 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276bdd6-d34e-4381-b2da-f4826eda4c12 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:33.257597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276bdd6-d34e-4381-b2da-f4826eda4c12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:33.305210 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:33.324058 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276bdd6-d34e-4381-b2da-f4826eda4c12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:33.325418 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276bdd6-d34e-4381-b2da-f4826eda4c12 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:33.418507 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 599/1198] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:36:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 20:36:33.424413 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ecba4-8af5-4f8e-b009-a45ae62f5a9c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:33.519129 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ecba4-8af5-4f8e-b009-a45ae62f5a9c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:33.551880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f95038-1754-47d1-8be7-59a8180ff872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:33.553252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f95038-1754-47d1-8be7-59a8180ff872 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:33.553731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f95038-1754-47d1-8be7-59a8180ff872 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:33.554211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f95038-1754-47d1-8be7-59a8180ff872 None admin] PATH_INFO: `/v3/projects/9f998910be0d43a282050fddb9de39b5` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:33.556075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f95038-1754-47d1-8be7-59a8180ff872 None admin] RBAC: Authorizing `identity:get_project(project_id=9f998910be0d43a282050fddb9de39b5)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:33.557800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f95038-1754-47d1-8be7-59a8180ff872 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:33.560309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 600/1199] 10.222.0.77 () {56 vars in 1186 bytes} [Tue Jul 19 20:36:33 2022] GET /identity/v3/projects/9f998910be0d43a282050fddb9de39b5 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:33.566317 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276bdd6-d34e-4381-b2da-f4826eda4c12 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:36:33.642944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:33.661627 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276bdd6-d34e-4381-b2da-f4826eda4c12 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:36:33.695433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b54f5-cfaa-4f51-8dca-81166fc5ec87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:36:33.696075 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b54f5-cfaa-4f51-8dca-81166fc5ec87 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:36:33.696356 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b54f5-cfaa-4f51-8dca-81166fc5ec87 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:36:33.696627 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b54f5-cfaa-4f51-8dca-81166fc5ec87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:36:33.697446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b54f5-cfaa-4f51-8dca-81166fc5ec87 None admin] RBAC: Adding query filter params (role.id=b30f01ef95004a1b84fc029830bdf053, scope.project.id=9f998910be0d43a282050fddb9de39b5, user.id=cd34a89c707846f194cfd9246ad6ffe1) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:36:33.697755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b54f5-cfaa-4f51-8dca-81166fc5ec87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:36:33.699164 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b54f5-cfaa-4f51-8dca-81166fc5ec87 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:36:33.704884 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 600/1200] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:36:33 2022] GET /identity/v3/role_assignments?user.id=cd34a89c707846f194cfd9246ad6ffe1&scope.project.id=9f998910be0d43a282050fddb9de39b5&role.id=b30f01ef95004a1b84fc029830bdf053 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:36:43.547713 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=86 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:36:43.702286 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=28 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:29.597972 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4aeed-e8af-4d9a-962e-3ad5d3df406d None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:29.598870 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4aeed-e8af-4d9a-962e-3ad5d3df406d None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:29.598870 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4aeed-e8af-4d9a-962e-3ad5d3df406d None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:29.600826 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 601/1201] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:37:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:37:29.609278 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bafd87-4e66-4dbe-a696-1cc62037344d None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:29.610139 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bafd87-4e66-4dbe-a696-1cc62037344d None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:29.610139 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bafd87-4e66-4dbe-a696-1cc62037344d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:29.632583 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-11bafd87-4e66-4dbe-a696-1cc62037344d None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:37:29.634632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-11bafd87-4e66-4dbe-a696-1cc62037344d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:37:29.759620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 601/1202] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:37:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:37:29.780626 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4aeed-e8af-4d9a-962e-3ad5d3df406d None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:29.935907 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4aeed-e8af-4d9a-962e-3ad5d3df406d None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:29.980860 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47626e-87ce-4fa3-8372-5e5ac67f22f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:29.982059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47626e-87ce-4fa3-8372-5e5ac67f22f2 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:29.982559 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47626e-87ce-4fa3-8372-5e5ac67f22f2 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:29.983054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47626e-87ce-4fa3-8372-5e5ac67f22f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:29.999686 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47626e-87ce-4fa3-8372-5e5ac67f22f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:30.001676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47626e-87ce-4fa3-8372-5e5ac67f22f2 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:30.022481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-3a47626e-87ce-4fa3-8372-5e5ac67f22f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:30.022481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:30.022481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:30.022481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:30.022481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:30.022481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:30.022481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:30.022481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:30.022481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:30.022481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:30.022481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:30.022481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:30.022481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:37:30.022481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:37:30.022481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:37:30.023901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:37:30.023901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:30.023901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:30.023901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:30.023901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:30.023901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:30.023901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:30.023901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:30.023901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:30.023901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:30.023901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:30.023901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:30.023901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:30.023901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:30.023901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:30.023901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:30.023901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:30.024885 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:37:30.024885 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:37:30.024885 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:30.024885 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:37:30.024885 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 602/1203] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:37:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:37:30.029993 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bafd87-4e66-4dbe-a696-1cc62037344d None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:30.176752 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bafd87-4e66-4dbe-a696-1cc62037344d None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:30.215200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:30.228631 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08e298-6746-4cb8-a3cc-c8365b0aec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:30.229930 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08e298-6746-4cb8-a3cc-c8365b0aec0f None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:30.230658 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08e298-6746-4cb8-a3cc-c8365b0aec0f None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:30.231170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08e298-6746-4cb8-a3cc-c8365b0aec0f None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:30.232566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08e298-6746-4cb8-a3cc-c8365b0aec0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:30.235745 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08e298-6746-4cb8-a3cc-c8365b0aec0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:30.238759 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08e298-6746-4cb8-a3cc-c8365b0aec0f None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:30.275563 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 602/1204] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:30.283843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47626e-87ce-4fa3-8372-5e5ac67f22f2 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:30.386291 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:30.474507 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47626e-87ce-4fa3-8372-5e5ac67f22f2 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:30.542458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe43df-0914-4031-a8be-7483e79e7a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:30.543822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe43df-0914-4031-a8be-7483e79e7a69 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:30.544341 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe43df-0914-4031-a8be-7483e79e7a69 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:30.544975 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe43df-0914-4031-a8be-7483e79e7a69 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:30.546535 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe43df-0914-4031-a8be-7483e79e7a69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:30.549437 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe43df-0914-4031-a8be-7483e79e7a69 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:30.587788 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 603/1205] 10.222.0.77 () {60 vars in 1132 bytes} [Tue Jul 19 20:37:30 2022] POST /identity/v3/users => generated 251 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:37:33.302134 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84003d7-3fdf-4222-9eec-ebe70d06b6c3 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:33.302698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84003d7-3fdf-4222-9eec-ebe70d06b6c3 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:33.302875 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84003d7-3fdf-4222-9eec-ebe70d06b6c3 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:33.304878 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 603/1206] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:37:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:37:33.313845 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0e429-0118-435d-bfa2-435527bf1fcd None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:33.314434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0e429-0118-435d-bfa2-435527bf1fcd None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:33.314535 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0e429-0118-435d-bfa2-435527bf1fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:33.339377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-f8c0e429-0118-435d-bfa2-435527bf1fcd None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:37:33.340625 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-f8c0e429-0118-435d-bfa2-435527bf1fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:37:33.428920 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 604/1207] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:37:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:37:33.453527 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84003d7-3fdf-4222-9eec-ebe70d06b6c3 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:33.589754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84003d7-3fdf-4222-9eec-ebe70d06b6c3 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:33.647672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1495348-197a-477c-bcd5-3f231b47ca32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:33.649073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1495348-197a-477c-bcd5-3f231b47ca32 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:33.649593 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1495348-197a-477c-bcd5-3f231b47ca32 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:33.650073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1495348-197a-477c-bcd5-3f231b47ca32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:33.666336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1495348-197a-477c-bcd5-3f231b47ca32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:37:33.677580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-a1495348-197a-477c-bcd5-3f231b47ca32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:37:33.677580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:33.677580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:33.677580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:33.677580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:33.677580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:33.677580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:33.677580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:33.677580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:33.677580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:33.677580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:33.677580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:33.677580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:37:33.677580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:37:33.677580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:37:33.677580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:37:33.680998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:37:33.680998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:37:33.680998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:37:33.680998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:37:33.680998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:33.680998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:33.680998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:33.680998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:33.680998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:33.680998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:33.680998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:33.680998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:33.680998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:33.680998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:33.680998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:33.680998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:33.681852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:33.681852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:33.681852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:33.681852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:33.681852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:37:33.681852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:37:33.681852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:37:33.681852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:37:33.681852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:37:33.681852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:37:33.681852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:37:33.681852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:37:33.681852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 604/1208] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:37:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:37:33.685020 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0e429-0118-435d-bfa2-435527bf1fcd None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:33.729368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:33.807908 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0e429-0118-435d-bfa2-435527bf1fcd None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:33.852775 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37919472-cfb0-448f-91d3-a16d60f216ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:33.854061 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37919472-cfb0-448f-91d3-a16d60f216ca None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:33.854556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37919472-cfb0-448f-91d3-a16d60f216ca None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:33.855064 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37919472-cfb0-448f-91d3-a16d60f216ca None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:33.856080 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37919472-cfb0-448f-91d3-a16d60f216ca None admin] RBAC: Adding query filter params (name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:33.856562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37919472-cfb0-448f-91d3-a16d60f216ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:33.858094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37919472-cfb0-448f-91d3-a16d60f216ca None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:33.867622 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 605/1209] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jul 19 20:37:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:33.874534 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1495348-197a-477c-bcd5-3f231b47ca32 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:33.957276 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:34.038322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1495348-197a-477c-bcd5-3f231b47ca32 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:34.086949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5806df2-283a-48fd-b78b-cf03e75bf6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:34.087909 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5806df2-283a-48fd-b78b-cf03e75bf6ee None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:34.088193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5806df2-283a-48fd-b78b-cf03e75bf6ee None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:34.088488 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5806df2-283a-48fd-b78b-cf03e75bf6ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:34.106296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5806df2-283a-48fd-b78b-cf03e75bf6ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:34.108679 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5806df2-283a-48fd-b78b-cf03e75bf6ee None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:34.138161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-b5806df2-283a-48fd-b78b-cf03e75bf6ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:34.138161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:34.138161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:34.138161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:34.138161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:34.138161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:34.138161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:34.138161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:34.138161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:34.138161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:34.138161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:34.138161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:34.138161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:37:34.138161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:37:34.138161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:37:34.139360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:37:34.139360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:34.139360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:34.139360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:34.139360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:34.139360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:34.139360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:34.139360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:34.139360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:34.139360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:34.139360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:34.139360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:34.139360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:34.139360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:34.139360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:34.139360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:34.139360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:34.145239 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:37:34.145239 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:37:34.145239 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:34.145239 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:37:34.145239 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 605/1210] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:37:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:37:34.147426 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37919472-cfb0-448f-91d3-a16d60f216ca None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:34.308135 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:34.312227 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37919472-cfb0-448f-91d3-a16d60f216ca None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:34.362936 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409ac82-2b69-4f73-a15c-f86ef78a18b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:34.363972 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409ac82-2b69-4f73-a15c-f86ef78a18b1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:34.364488 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409ac82-2b69-4f73-a15c-f86ef78a18b1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:34.365478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409ac82-2b69-4f73-a15c-f86ef78a18b1 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:34.366813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409ac82-2b69-4f73-a15c-f86ef78a18b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:34.367365 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409ac82-2b69-4f73-a15c-f86ef78a18b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:34.369545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409ac82-2b69-4f73-a15c-f86ef78a18b1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:34.394802 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 606/1211] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:37:34.396887 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5806df2-283a-48fd-b78b-cf03e75bf6ee None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:34.545885 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5806df2-283a-48fd-b78b-cf03e75bf6ee None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:34.548269 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:34.605469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247d0ae-c5d1-4dbd-a91f-546f9d1517bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:34.606580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247d0ae-c5d1-4dbd-a91f-546f9d1517bd None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:34.609696 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247d0ae-c5d1-4dbd-a91f-546f9d1517bd None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:34.610128 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247d0ae-c5d1-4dbd-a91f-546f9d1517bd None admin] PATH_INFO: `/v3/users/placement` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:34.624612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247d0ae-c5d1-4dbd-a91f-546f9d1517bd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:34.627407 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247d0ae-c5d1-4dbd-a91f-546f9d1517bd None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:34.647168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-1247d0ae-c5d1-4dbd-a91f-546f9d1517bd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 20:37:34.647168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:34.647168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:34.647168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:34.647168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:34.647168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:34.647168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:34.647168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:34.647168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:34.647168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:34.647168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:34.647168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:34.647168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:37:34.647168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:37:34.647168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:37:34.647168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:37:34.648546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:34.648546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:34.648546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:37:34.648546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:37:34.648546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:37:34.648546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:37:34.648546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:34.648546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:34.648546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:34.648546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:34.648546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:34.648546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:34.648546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:34.648546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:34.648546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:34.648546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:34.648546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:34.648546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:34.649784 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:34.649784 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:34.649784 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:37:34.649784 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:37:34.649784 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:37:34.649784 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:37:34.649784 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:37:34.649784 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:37:34.649784 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 20:37:34.649784 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:37:34.651434 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 606/1212] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:37:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:37:34.654601 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409ac82-2b69-4f73-a15c-f86ef78a18b1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:34.814806 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409ac82-2b69-4f73-a15c-f86ef78a18b1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:34.862420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d84d9-7847-47ff-9fb9-4ff383d3c53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:34.863096 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d84d9-7847-47ff-9fb9-4ff383d3c53b None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:34.863444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d84d9-7847-47ff-9fb9-4ff383d3c53b None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:34.863782 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d84d9-7847-47ff-9fb9-4ff383d3c53b None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:34.864807 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d84d9-7847-47ff-9fb9-4ff383d3c53b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:34.865235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d84d9-7847-47ff-9fb9-4ff383d3c53b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:34.867000 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d84d9-7847-47ff-9fb9-4ff383d3c53b None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:34.892513 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 607/1213] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Jul 19 20:37:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:37:34.899495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247d0ae-c5d1-4dbd-a91f-546f9d1517bd None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:35.056064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247d0ae-c5d1-4dbd-a91f-546f9d1517bd None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:35.107336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d4e02-07e6-4811-a780-a7241d6a9cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:35.109243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d4e02-07e6-4811-a780-a7241d6a9cd6 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:35.109778 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d4e02-07e6-4811-a780-a7241d6a9cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:35.110356 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d4e02-07e6-4811-a780-a7241d6a9cd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:35.150450 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:35.220867 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d4e02-07e6-4811-a780-a7241d6a9cd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:35.223523 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d4e02-07e6-4811-a780-a7241d6a9cd6 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:35.358603 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 607/1214] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:37:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 20:37:35.365580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d84d9-7847-47ff-9fb9-4ff383d3c53b None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:35.389863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:35.507657 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d84d9-7847-47ff-9fb9-4ff383d3c53b None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:35.559213 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2241b-727b-44aa-b985-d7b663f01c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:35.560490 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2241b-727b-44aa-b985-d7b663f01c7c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:35.560866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2241b-727b-44aa-b985-d7b663f01c7c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:35.561250 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2241b-727b-44aa-b985-d7b663f01c7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:35.577394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2241b-727b-44aa-b985-d7b663f01c7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:35.579986 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2241b-727b-44aa-b985-d7b663f01c7c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:35.612025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-20d2241b-727b-44aa-b985-d7b663f01c7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:35.612025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:35.612025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:35.612025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:35.612025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:35.612025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:35.612025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:35.612025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:35.612025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:35.612025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:35.612025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:35.612025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:35.612025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:37:35.612025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:37:35.612025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:37:35.613671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:37:35.613671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:35.613671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:35.613671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:35.613671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:35.613671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:35.613671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:35.613671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:35.613671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:35.613671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:35.613671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:35.613671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:35.613671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:35.613671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:35.613671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:35.613671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:35.613671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:35.615668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:37:35.615668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:37:35.615668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:35.615668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:37:35.615668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 608/1215] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:37:35.620917 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d4e02-07e6-4811-a780-a7241d6a9cd6 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:35.733780 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:35.783588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d4e02-07e6-4811-a780-a7241d6a9cd6 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:35.842378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff5958-786f-4caa-b579-e7a389857da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:35.843053 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff5958-786f-4caa-b579-e7a389857da8 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:35.843372 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff5958-786f-4caa-b579-e7a389857da8 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:35.843641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff5958-786f-4caa-b579-e7a389857da8 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:35.844374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff5958-786f-4caa-b579-e7a389857da8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:35.844679 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff5958-786f-4caa-b579-e7a389857da8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:35.846047 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff5958-786f-4caa-b579-e7a389857da8 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:35.857692 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 608/1216] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:35.863857 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2241b-727b-44aa-b985-d7b663f01c7c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:35.979857 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:36.034981 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2241b-727b-44aa-b985-d7b663f01c7c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:36.091276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1e684-1963-4c30-a3f9-88c6cf16b50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:36.092478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1e684-1963-4c30-a3f9-88c6cf16b50f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:36.092727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1e684-1963-4c30-a3f9-88c6cf16b50f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:36.092983 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1e684-1963-4c30-a3f9-88c6cf16b50f None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:36.101849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1e684-1963-4c30-a3f9-88c6cf16b50f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:36.103552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1e684-1963-4c30-a3f9-88c6cf16b50f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:36.121816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-3cd1e684-1963-4c30-a3f9-88c6cf16b50f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:37:36.121816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:36.121816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:36.121816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:36.121816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:36.121816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:36.121816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:36.121816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:36.121816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:36.121816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:36.121816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:36.121816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:36.121816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:37:36.121816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:37:36.121816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:37:36.123918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:37:36.123918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:36.123918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:36.123918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:36.123918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:36.123918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:36.123918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:36.123918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:36.123918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:36.123918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:36.123918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:36.123918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:36.123918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:36.123918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:36.123918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:36.123918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:36.123918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:36.125952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:37:36.125952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:37:36.125952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:37:36.125952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:37:36.125952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:37:36.125952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:37:36.125952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:37:36.125952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:37:36.131311 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 609/1217] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:37:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:37:36.131963 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff5958-786f-4caa-b579-e7a389857da8 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:36.280316 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff5958-786f-4caa-b579-e7a389857da8 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:36.311594 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:36.330997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006270b-9f72-4a4e-bf0e-3c745312adec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:36.332006 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006270b-9f72-4a4e-bf0e-3c745312adec None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:36.332432 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006270b-9f72-4a4e-bf0e-3c745312adec None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:36.332837 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006270b-9f72-4a4e-bf0e-3c745312adec None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:36.334542 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006270b-9f72-4a4e-bf0e-3c745312adec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:36.335072 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006270b-9f72-4a4e-bf0e-3c745312adec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:36.336829 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006270b-9f72-4a4e-bf0e-3c745312adec None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:36.355026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 609/1218] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:37:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:36.364547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1e684-1963-4c30-a3f9-88c6cf16b50f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:36.543578 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1e684-1963-4c30-a3f9-88c6cf16b50f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:36.590729 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:36.601640 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca255b75-a4af-48a4-a898-c5f31909d184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:36.602777 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca255b75-a4af-48a4-a898-c5f31909d184 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:36.603323 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca255b75-a4af-48a4-a898-c5f31909d184 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:36.603831 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca255b75-a4af-48a4-a898-c5f31909d184 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:36.605482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca255b75-a4af-48a4-a898-c5f31909d184 None admin] RBAC: Adding query filter params (role.id=e5e7de76725748df9add27e3c837d8ef, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=04843ec31eb84585944c7a2b9cd1c0cb) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:36.606070 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca255b75-a4af-48a4-a898-c5f31909d184 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:36.608693 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca255b75-a4af-48a4-a898-c5f31909d184 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:36.631316 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 610/1219] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:37:36 2022] GET /identity/v3/role_assignments?user.id=04843ec31eb84585944c7a2b9cd1c0cb&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=e5e7de76725748df9add27e3c837d8ef => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:38.909348 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8907106-b1ac-4bd0-9a06-a7a958d7c2ae None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:38.910377 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8907106-b1ac-4bd0-9a06-a7a958d7c2ae None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:38.910791 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8907106-b1ac-4bd0-9a06-a7a958d7c2ae None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:38.913309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 610/1220] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:37:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:37:38.920309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c708b-dd46-48b2-8206-cf0f0739395e None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:38.920814 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c708b-dd46-48b2-8206-cf0f0739395e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:38.921140 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c708b-dd46-48b2-8206-cf0f0739395e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:38.941000 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-e05c708b-dd46-48b2-8206-cf0f0739395e None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:37:38.942190 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e05c708b-dd46-48b2-8206-cf0f0739395e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:37:39.020029 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 611/1221] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:37:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:37:39.044292 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8907106-b1ac-4bd0-9a06-a7a958d7c2ae None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:39.168477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8907106-b1ac-4bd0-9a06-a7a958d7c2ae None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:39.207779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23a746-dae7-4eaa-9089-b18781f36550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:39.210020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23a746-dae7-4eaa-9089-b18781f36550 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:39.210498 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23a746-dae7-4eaa-9089-b18781f36550 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:39.210903 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23a746-dae7-4eaa-9089-b18781f36550 None admin] PATH_INFO: `/v3/roles/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:39.223784 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23a746-dae7-4eaa-9089-b18781f36550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:37:39.232889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-5e23a746-dae7-4eaa-9089-b18781f36550 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:37:39.232889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:39.232889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:39.232889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:39.232889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:39.232889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:39.232889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:39.232889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:39.232889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:39.232889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:39.232889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:39.232889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:39.232889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:37:39.232889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:37:39.232889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:37:39.232889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:37:39.234323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:37:39.234323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:37:39.234323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:37:39.234323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:37:39.234323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:39.234323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:39.234323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:39.234323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:39.234323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:39.234323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:39.234323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:39.234323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:39.234323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:39.234323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:39.234323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:39.234323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:39.235396 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:39.235396 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:39.235396 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:39.235396 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:39.235396 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:37:39.235396 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:37:39.235396 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:37:39.235396 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:37:39.235396 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:37:39.235396 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:37:39.235396 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:37:39.235396 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:37:39.235396 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 611/1222] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:37:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:37:39.241635 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c708b-dd46-48b2-8206-cf0f0739395e None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:39.352574 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c708b-dd46-48b2-8206-cf0f0739395e None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:39.385762 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:39.398408 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecbc24-db5c-436e-b3c6-d55fa68784f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:39.399076 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecbc24-db5c-436e-b3c6-d55fa68784f8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:39.399380 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecbc24-db5c-436e-b3c6-d55fa68784f8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:39.399650 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecbc24-db5c-436e-b3c6-d55fa68784f8 None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:39.400388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecbc24-db5c-436e-b3c6-d55fa68784f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:39.400689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecbc24-db5c-436e-b3c6-d55fa68784f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:39.402035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecbc24-db5c-436e-b3c6-d55fa68784f8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:39.410937 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 612/1223] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jul 19 20:37:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:37:39.417249 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23a746-dae7-4eaa-9089-b18781f36550 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:39.476266 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:39.570248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23a746-dae7-4eaa-9089-b18781f36550 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:39.625165 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77dc09-ea80-4469-85a0-3e4b1a98ad1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:39.626123 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77dc09-ea80-4469-85a0-3e4b1a98ad1a None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:39.626423 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77dc09-ea80-4469-85a0-3e4b1a98ad1a None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:39.626970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77dc09-ea80-4469-85a0-3e4b1a98ad1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:39.643807 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77dc09-ea80-4469-85a0-3e4b1a98ad1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:39.645255 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77dc09-ea80-4469-85a0-3e4b1a98ad1a None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:39.665143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-2c77dc09-ea80-4469-85a0-3e4b1a98ad1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:39.665143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:39.665143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:39.665143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:39.665143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:39.665143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:39.665143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:39.665143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:39.665143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:39.665143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:39.665143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:39.665143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:39.665143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:37:39.665143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:37:39.665143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:37:39.667312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:37:39.667312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:39.667312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:39.667312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:39.667312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:39.667312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:39.667312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:39.667312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:39.667312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:39.667312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:39.667312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:39.667312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:39.667312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:39.667312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:39.667312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:39.667312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:39.667312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:39.669196 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:37:39.669196 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:37:39.669196 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:39.669196 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:37:39.669196 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 612/1224] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:37:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:37:39.675420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecbc24-db5c-436e-b3c6-d55fa68784f8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:39.805466 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecbc24-db5c-436e-b3c6-d55fa68784f8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:39.844472 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5df28f-30fd-42f8-b640-2c126de0b6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:39.845149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5df28f-30fd-42f8-b640-2c126de0b6d1 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:39.845434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5df28f-30fd-42f8-b640-2c126de0b6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:39.845710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5df28f-30fd-42f8-b640-2c126de0b6d1 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:39.846482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5df28f-30fd-42f8-b640-2c126de0b6d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:39.846815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5df28f-30fd-42f8-b640-2c126de0b6d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:39.848237 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5df28f-30fd-42f8-b640-2c126de0b6d1 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:39.860885 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 613/1225] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:39.868347 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77dc09-ea80-4469-85a0-3e4b1a98ad1a None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:40.002740 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:40.009193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77dc09-ea80-4469-85a0-3e4b1a98ad1a None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:40.062138 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea390954-cd4e-46b2-956a-0d2022388dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:40.063458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea390954-cd4e-46b2-956a-0d2022388dad None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:40.064031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea390954-cd4e-46b2-956a-0d2022388dad None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:40.064477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea390954-cd4e-46b2-956a-0d2022388dad None admin] PATH_INFO: `/v3/users/placement` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:40.073656 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea390954-cd4e-46b2-956a-0d2022388dad None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:40.075134 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea390954-cd4e-46b2-956a-0d2022388dad None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:40.090673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-ea390954-cd4e-46b2-956a-0d2022388dad None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 20:37:40.090673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:40.090673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:40.090673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:40.090673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:40.090673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:40.090673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:40.090673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:40.090673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:40.090673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:40.090673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:40.090673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:40.090673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:37:40.090673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:37:40.090673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:37:40.090673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:37:40.093103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:40.093103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:40.093103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:37:40.093103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:37:40.093103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:37:40.093103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:37:40.093103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:40.093103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:40.093103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:40.093103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:40.093103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:40.093103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:40.093103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:40.093103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:40.093103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:40.093103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:40.093103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:40.093103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:40.095233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:40.095233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:40.095233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:37:40.095233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:37:40.095233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:37:40.095233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:37:40.095233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:37:40.095233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:37:40.095233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 20:37:40.095233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:37:40.095233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 613/1226] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:37:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:37:40.098713 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5df28f-30fd-42f8-b640-2c126de0b6d1 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:40.162365 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:40.233627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5df28f-30fd-42f8-b640-2c126de0b6d1 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:40.273529 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d636c7-1df3-40a7-ade6-ee8762c271d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:40.274212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d636c7-1df3-40a7-ade6-ee8762c271d3 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:40.274527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d636c7-1df3-40a7-ade6-ee8762c271d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:40.274833 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d636c7-1df3-40a7-ade6-ee8762c271d3 None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:40.275649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d636c7-1df3-40a7-ade6-ee8762c271d3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:40.275958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d636c7-1df3-40a7-ade6-ee8762c271d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:40.277392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d636c7-1df3-40a7-ade6-ee8762c271d3 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:40.298016 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 614/1227] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Jul 19 20:37:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:37:40.308049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea390954-cd4e-46b2-956a-0d2022388dad None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:40.467612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea390954-cd4e-46b2-956a-0d2022388dad None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:40.514525 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a3d3f-de50-40b5-9159-bc3d9ddd10ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:40.515478 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a3d3f-de50-40b5-9159-bc3d9ddd10ed None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:40.515815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a3d3f-de50-40b5-9159-bc3d9ddd10ed None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:40.516165 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a3d3f-de50-40b5-9159-bc3d9ddd10ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:40.528889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a3d3f-de50-40b5-9159-bc3d9ddd10ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:40.530467 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a3d3f-de50-40b5-9159-bc3d9ddd10ed None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:40.555697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-9f8a3d3f-de50-40b5-9159-bc3d9ddd10ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:40.555697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:40.555697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:40.555697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:40.555697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:40.555697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:40.555697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:40.555697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:40.555697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:40.555697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:40.555697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:40.555697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:40.555697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:37:40.555697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:37:40.555697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:37:40.557064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:37:40.557064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:40.557064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:40.557064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:40.557064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:40.557064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:40.557064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:40.557064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:40.557064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:40.557064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:40.557064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:40.557064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:40.557064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:40.557064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:40.557064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:40.557064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:40.557064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:40.558122 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:37:40.558122 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:37:40.558122 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:40.558122 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:37:40.558122 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 614/1228] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:37:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:37:40.564933 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d636c7-1df3-40a7-ade6-ee8762c271d3 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:40.692021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d636c7-1df3-40a7-ade6-ee8762c271d3 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:40.694740 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:40.735369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0702e-b1d5-4230-b94c-cb1b3bfdc67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:40.736051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0702e-b1d5-4230-b94c-cb1b3bfdc67f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:40.736398 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0702e-b1d5-4230-b94c-cb1b3bfdc67f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:40.736694 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0702e-b1d5-4230-b94c-cb1b3bfdc67f None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:40.737601 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0702e-b1d5-4230-b94c-cb1b3bfdc67f None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:40.738019 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0702e-b1d5-4230-b94c-cb1b3bfdc67f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:40.740388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0702e-b1d5-4230-b94c-cb1b3bfdc67f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:40.754723 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 615/1229] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:37:40.762299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a3d3f-de50-40b5-9159-bc3d9ddd10ed None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:40.777212 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:40.892135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a3d3f-de50-40b5-9159-bc3d9ddd10ed None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:40.931976 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ad8b8-3d44-4be3-ac80-cd4da046db05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:40.932784 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ad8b8-3d44-4be3-ac80-cd4da046db05 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:40.933117 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ad8b8-3d44-4be3-ac80-cd4da046db05 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:40.933482 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ad8b8-3d44-4be3-ac80-cd4da046db05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:40.941259 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ad8b8-3d44-4be3-ac80-cd4da046db05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:40.942780 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ad8b8-3d44-4be3-ac80-cd4da046db05 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:40.958232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-9b6ad8b8-3d44-4be3-ac80-cd4da046db05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:37:40.958232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:40.958232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:40.958232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:40.958232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:40.958232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:40.958232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:40.958232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:40.958232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:40.958232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:40.958232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:40.958232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:40.958232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:37:40.958232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:37:40.958232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:37:40.960584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:37:40.960584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:40.960584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:40.960584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:40.960584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:40.960584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:40.960584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:40.960584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:40.960584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:40.960584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:40.960584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:40.960584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:40.960584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:40.960584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:40.960584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:40.960584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:40.960584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:40.962300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:37:40.962300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:37:40.962300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:37:40.962300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:37:40.962300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:37:40.962300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:37:40.962300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:37:40.962300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:37:40.962300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 615/1230] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:37:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:37:40.965989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0702e-b1d5-4230-b94c-cb1b3bfdc67f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:41.100209 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0702e-b1d5-4230-b94c-cb1b3bfdc67f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:41.138855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb73be-f7d0-4bbe-a4ea-903ccaef1981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:41.139557 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb73be-f7d0-4bbe-a4ea-903ccaef1981 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:41.139839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb73be-f7d0-4bbe-a4ea-903ccaef1981 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:41.140114 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb73be-f7d0-4bbe-a4ea-903ccaef1981 None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:41.140912 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb73be-f7d0-4bbe-a4ea-903ccaef1981 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:41.141225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb73be-f7d0-4bbe-a4ea-903ccaef1981 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:41.142747 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb73be-f7d0-4bbe-a4ea-903ccaef1981 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:41.157670 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 616/1231] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:37:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:41.165880 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ad8b8-3d44-4be3-ac80-cd4da046db05 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:41.254433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:41.300325 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ad8b8-3d44-4be3-ac80-cd4da046db05 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:41.354121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf2b1b-73ac-435c-acdd-492e3968ba2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:41.355083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf2b1b-73ac-435c-acdd-492e3968ba2e None admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:41.355485 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf2b1b-73ac-435c-acdd-492e3968ba2e None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:41.355863 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf2b1b-73ac-435c-acdd-492e3968ba2e None admin] PATH_INFO: `/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/04843ec31eb84585944c7a2b9cd1c0cb/roles/e5e7de76725748df9add27e3c837d8ef` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:41.379035 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf2b1b-73ac-435c-acdd-492e3968ba2e None admin] RBAC: Authorizing `identity:create_grant(project_id=327868f4f62e4e4a9c5bef4acd32fb29, user_id=04843ec31eb84585944c7a2b9cd1c0cb, role_id=e5e7de76725748df9add27e3c837d8ef)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:41.382231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf2b1b-73ac-435c-acdd-492e3968ba2e None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:41.398467 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 616/1232] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:37:41 2022] PUT /identity/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/04843ec31eb84585944c7a2b9cd1c0cb/roles/e5e7de76725748df9add27e3c837d8ef => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:37:43.627597 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ed9bd-deed-482c-87f2-411301fe3d8b None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:43.628194 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ed9bd-deed-482c-87f2-411301fe3d8b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:43.628194 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ed9bd-deed-482c-87f2-411301fe3d8b None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:43.629509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 617/1233] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:37:43.636510 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0830e36-c8b9-40cf-a1b5-7d8200eff015 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:43.637025 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0830e36-c8b9-40cf-a1b5-7d8200eff015 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:43.637119 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0830e36-c8b9-40cf-a1b5-7d8200eff015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:43.654698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-e0830e36-c8b9-40cf-a1b5-7d8200eff015 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:37:43.655968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e0830e36-c8b9-40cf-a1b5-7d8200eff015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:37:43.729518 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 617/1234] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:37:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:37:43.754631 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ed9bd-deed-482c-87f2-411301fe3d8b None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:43.783833 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:43.872286 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ed9bd-deed-482c-87f2-411301fe3d8b None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:43.909260 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a12bc-9a2a-4870-94e1-ff0eb211cf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:43.910073 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a12bc-9a2a-4870-94e1-ff0eb211cf0e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:43.910372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a12bc-9a2a-4870-94e1-ff0eb211cf0e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:43.910630 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a12bc-9a2a-4870-94e1-ff0eb211cf0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:43.921388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a12bc-9a2a-4870-94e1-ff0eb211cf0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:37:43.929925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-5e3a12bc-9a2a-4870-94e1-ff0eb211cf0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:37:43.929925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:43.929925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:43.929925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:43.929925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:43.929925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:43.929925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:43.929925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:43.929925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:43.929925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:43.929925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:43.929925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:43.929925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:37:43.929925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:37:43.929925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:37:43.929925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:37:43.930924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:37:43.930924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:37:43.930924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:37:43.930924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:37:43.930924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:43.930924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:43.930924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:43.930924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:43.930924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:43.930924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:43.930924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:43.930924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:43.930924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:43.930924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:43.930924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:43.930924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:43.932008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:43.932008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:43.932008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:43.932008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:43.932008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:37:43.932008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:37:43.932008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:37:43.932008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:37:43.932008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:37:43.932008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:37:43.932008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 20:37:43.932008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:37:43.932008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 618/1235] 10.222.0.77 () {56 vars in 1102 bytes} [Tue Jul 19 20:37:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:37:43.937327 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0830e36-c8b9-40cf-a1b5-7d8200eff015 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:43.985864 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:44.056758 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0830e36-c8b9-40cf-a1b5-7d8200eff015 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:44.104818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93101ef2-4e3b-4793-9b62-53e91f49ebaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:44.105751 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93101ef2-4e3b-4793-9b62-53e91f49ebaa None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:44.106204 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93101ef2-4e3b-4793-9b62-53e91f49ebaa None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:44.106698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93101ef2-4e3b-4793-9b62-53e91f49ebaa None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:44.107931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93101ef2-4e3b-4793-9b62-53e91f49ebaa None admin] RBAC: Adding query filter params (name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:44.108436 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93101ef2-4e3b-4793-9b62-53e91f49ebaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:44.110385 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93101ef2-4e3b-4793-9b62-53e91f49ebaa None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:44.120584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 618/1236] 10.222.0.77 () {56 vars in 1103 bytes} [Tue Jul 19 20:37:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:44.126974 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a12bc-9a2a-4870-94e1-ff0eb211cf0e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:44.232639 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:44.252168 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a12bc-9a2a-4870-94e1-ff0eb211cf0e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:44.290545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e1ade-2241-453b-9e95-f74a76932cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:44.291380 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e1ade-2241-453b-9e95-f74a76932cac None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:44.291660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e1ade-2241-453b-9e95-f74a76932cac None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:44.291930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e1ade-2241-453b-9e95-f74a76932cac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:44.304765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e1ade-2241-453b-9e95-f74a76932cac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:44.306576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e1ade-2241-453b-9e95-f74a76932cac None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:44.326444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-d54e1ade-2241-453b-9e95-f74a76932cac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:44.326444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:44.326444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:44.326444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:44.326444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:44.326444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:44.326444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:44.326444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:44.326444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:44.326444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:44.326444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:44.326444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:44.326444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:37:44.326444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:37:44.326444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:37:44.327883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:37:44.327883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:44.327883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:44.327883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:44.327883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:44.327883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:44.327883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:44.327883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:44.327883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:44.327883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:44.327883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:44.327883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:44.327883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:44.327883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:44.327883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:44.327883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:44.327883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:44.329868 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:37:44.329868 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:37:44.329868 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:44.329868 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:37:44.329868 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 619/1237] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:37:44.336238 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93101ef2-4e3b-4793-9b62-53e91f49ebaa None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:44.450970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93101ef2-4e3b-4793-9b62-53e91f49ebaa None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:44.461450 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:44.490417 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73751c64-db40-4ae5-81e9-2c11aac3555b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:44.491161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73751c64-db40-4ae5-81e9-2c11aac3555b None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:44.491564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73751c64-db40-4ae5-81e9-2c11aac3555b None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:44.491843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73751c64-db40-4ae5-81e9-2c11aac3555b None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:44.493915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73751c64-db40-4ae5-81e9-2c11aac3555b None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:44.494256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73751c64-db40-4ae5-81e9-2c11aac3555b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:44.495768 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73751c64-db40-4ae5-81e9-2c11aac3555b None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:44.510934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 619/1238] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:44.516687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e1ade-2241-453b-9e95-f74a76932cac None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:44.646598 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e1ade-2241-453b-9e95-f74a76932cac None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:44.701578 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02192a50-2a77-417d-9578-65df95437b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:44.703058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02192a50-2a77-417d-9578-65df95437b76 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:44.703576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02192a50-2a77-417d-9578-65df95437b76 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:44.703910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02192a50-2a77-417d-9578-65df95437b76 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:44.707641 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:44.714756 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02192a50-2a77-417d-9578-65df95437b76 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:44.716689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02192a50-2a77-417d-9578-65df95437b76 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:44.735832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-02192a50-2a77-417d-9578-65df95437b76 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 20:37:44.735832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:44.735832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:44.735832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:44.735832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:44.735832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:44.735832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:44.735832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:44.735832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:44.735832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:44.735832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:44.735832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:44.735832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:37:44.735832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:37:44.735832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:37:44.735832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:37:44.737077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:44.737077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:44.737077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:37:44.737077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:37:44.737077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:37:44.737077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:37:44.737077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:44.737077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:44.737077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:44.737077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:44.737077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:44.737077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:44.737077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:44.737077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:44.737077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:44.737077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:44.737077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:44.737077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:44.738222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:44.738222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:44.738222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:37:44.738222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:37:44.738222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:37:44.738222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:37:44.738222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:37:44.738222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:37:44.738222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 20:37:44.738222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:37:44.738222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 620/1239] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:37:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:37:44.743973 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73751c64-db40-4ae5-81e9-2c11aac3555b None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:44.871862 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73751c64-db40-4ae5-81e9-2c11aac3555b None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:44.910763 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea892d-d81c-4f81-a265-06af6ed116d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:44.911467 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea892d-d81c-4f81-a265-06af6ed116d3 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:44.912277 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea892d-d81c-4f81-a265-06af6ed116d3 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:44.912558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea892d-d81c-4f81-a265-06af6ed116d3 None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:44.913390 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea892d-d81c-4f81-a265-06af6ed116d3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:44.913732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea892d-d81c-4f81-a265-06af6ed116d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:44.915476 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea892d-d81c-4f81-a265-06af6ed116d3 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:44.935138 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 620/1240] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Jul 19 20:37:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:44.941152 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02192a50-2a77-417d-9578-65df95437b76 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:45.049656 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02192a50-2a77-417d-9578-65df95437b76 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:45.086754 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddb7b7-b63c-44fb-8055-11403ce4558c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:45.087507 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddb7b7-b63c-44fb-8055-11403ce4558c None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:45.087795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddb7b7-b63c-44fb-8055-11403ce4558c None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:45.088078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddb7b7-b63c-44fb-8055-11403ce4558c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:45.153786 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:45.162947 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ddb7b7-b63c-44fb-8055-11403ce4558c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:45.164797 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ddb7b7-b63c-44fb-8055-11403ce4558c None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:45.281212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 621/1241] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:37:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 20:37:45.287879 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea892d-d81c-4f81-a265-06af6ed116d3 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:45.316491 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:45.394433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea892d-d81c-4f81-a265-06af6ed116d3 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:45.436954 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f2172-cb27-410e-a5ff-b92111fc619b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:45.437868 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f2172-cb27-410e-a5ff-b92111fc619b None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:45.438149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f2172-cb27-410e-a5ff-b92111fc619b None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:45.438427 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f2172-cb27-410e-a5ff-b92111fc619b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:45.450712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f2172-cb27-410e-a5ff-b92111fc619b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:45.452230 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f2172-cb27-410e-a5ff-b92111fc619b None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:45.471172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-e99f2172-cb27-410e-a5ff-b92111fc619b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:45.471172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:45.471172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:45.471172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:45.471172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:45.471172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:45.471172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:45.471172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:45.471172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:45.471172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:45.471172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:45.471172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:45.471172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:37:45.471172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:37:45.471172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:37:45.472584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:37:45.472584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:45.472584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:45.472584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:45.472584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:45.472584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:45.472584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:45.472584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:45.472584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:45.472584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:45.472584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:45.472584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:45.472584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:45.472584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:45.472584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:45.472584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:45.472584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:45.473905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:37:45.473905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:37:45.473905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:45.473905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:37:45.473905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 621/1242] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:37:45.478714 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddb7b7-b63c-44fb-8055-11403ce4558c None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:45.584596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:45.593696 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddb7b7-b63c-44fb-8055-11403ce4558c None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:45.635953 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4c4b8-08fa-498f-bc71-63e734685b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:45.637449 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4c4b8-08fa-498f-bc71-63e734685b69 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:45.638383 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4c4b8-08fa-498f-bc71-63e734685b69 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:45.638864 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed4c4b8-08fa-498f-bc71-63e734685b69 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:45.641017 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4c4b8-08fa-498f-bc71-63e734685b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:45.642007 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4c4b8-08fa-498f-bc71-63e734685b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:45.644207 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed4c4b8-08fa-498f-bc71-63e734685b69 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:45.656378 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 622/1243] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:45.662832 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f2172-cb27-410e-a5ff-b92111fc619b None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:45.752199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:45.779536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f2172-cb27-410e-a5ff-b92111fc619b None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:45.823427 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45ccfa-a7c1-46d2-abc4-ddd3e9d0f30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:45.824378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45ccfa-a7c1-46d2-abc4-ddd3e9d0f30f None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:45.824666 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45ccfa-a7c1-46d2-abc4-ddd3e9d0f30f None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:45.825093 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45ccfa-a7c1-46d2-abc4-ddd3e9d0f30f None admin] PATH_INFO: `/v3/projects/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:45.834123 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45ccfa-a7c1-46d2-abc4-ddd3e9d0f30f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:45.836466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f45ccfa-a7c1-46d2-abc4-ddd3e9d0f30f None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:45.853444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-9f45ccfa-a7c1-46d2-abc4-ddd3e9d0f30f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:37:45.853444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:45.853444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:45.853444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:45.853444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:45.853444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:45.853444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:45.853444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:45.853444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:45.853444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:45.853444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:45.853444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:45.853444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:37:45.853444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:37:45.853444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:37:45.854676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:37:45.854676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:45.854676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:45.854676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:45.854676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:45.854676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:45.854676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:45.854676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:45.854676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:45.854676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:45.854676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:45.854676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:45.854676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:45.854676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:45.854676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:45.854676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:45.854676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:45.855821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:37:45.855821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:37:45.855821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:37:45.855821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:37:45.855821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:37:45.855821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:37:45.855821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:37:45.855821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:37:45.855821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 622/1244] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:37:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:37:45.861235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4c4b8-08fa-498f-bc71-63e734685b69 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:45.996996 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed4c4b8-08fa-498f-bc71-63e734685b69 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:46.035059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6bfa3-a5a3-420b-99d5-10edd5d08cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:46.035829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6bfa3-a5a3-420b-99d5-10edd5d08cbb None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:46.036105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6bfa3-a5a3-420b-99d5-10edd5d08cbb None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:46.036385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6bfa3-a5a3-420b-99d5-10edd5d08cbb None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:46.037347 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6bfa3-a5a3-420b-99d5-10edd5d08cbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:46.037702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6bfa3-a5a3-420b-99d5-10edd5d08cbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:46.039483 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6bfa3-a5a3-420b-99d5-10edd5d08cbb None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:46.054045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 623/1245] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:37:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:46.060527 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45ccfa-a7c1-46d2-abc4-ddd3e9d0f30f None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:46.180937 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f45ccfa-a7c1-46d2-abc4-ddd3e9d0f30f None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:46.220070 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5d725-38b6-4674-ac54-36b9465b67c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:46.220730 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5d725-38b6-4674-ac54-36b9465b67c4 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:46.221007 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5d725-38b6-4674-ac54-36b9465b67c4 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:46.221279 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5d725-38b6-4674-ac54-36b9465b67c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:46.222112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5d725-38b6-4674-ac54-36b9465b67c4 None admin] RBAC: Adding query filter params (role.id=e5e7de76725748df9add27e3c837d8ef, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=04843ec31eb84585944c7a2b9cd1c0cb) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:46.222420 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5d725-38b6-4674-ac54-36b9465b67c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:46.224019 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5d725-38b6-4674-ac54-36b9465b67c4 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:46.230972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 623/1246] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:37:46 2022] GET /identity/v3/role_assignments?user.id=04843ec31eb84585944c7a2b9cd1c0cb&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=e5e7de76725748df9add27e3c837d8ef => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:37:48.407584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8bb41-c0b1-4c80-a43c-0470cf76c934 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:48.408148 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8bb41-c0b1-4c80-a43c-0470cf76c934 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:48.408148 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8bb41-c0b1-4c80-a43c-0470cf76c934 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:48.409798 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 624/1247] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:37:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:37:48.421098 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36496228-726c-4fa6-823b-13913b3242a9 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:48.421709 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36496228-726c-4fa6-823b-13913b3242a9 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:48.421709 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36496228-726c-4fa6-823b-13913b3242a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:48.426738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:48.441134 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-36496228-726c-4fa6-823b-13913b3242a9 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:37:48.442537 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-36496228-726c-4fa6-823b-13913b3242a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:37:48.544000 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 624/1248] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:37:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:37:48.573106 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8bb41-c0b1-4c80-a43c-0470cf76c934 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:48.601479 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:48.705512 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8bb41-c0b1-4c80-a43c-0470cf76c934 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:48.746998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de05d9d-7038-42af-89ba-df6095dd20c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:48.747836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de05d9d-7038-42af-89ba-df6095dd20c5 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:48.748111 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de05d9d-7038-42af-89ba-df6095dd20c5 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:48.748380 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de05d9d-7038-42af-89ba-df6095dd20c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:48.760054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de05d9d-7038-42af-89ba-df6095dd20c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:37:48.767871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-6de05d9d-7038-42af-89ba-df6095dd20c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:37:48.767871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:48.767871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:48.767871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:48.767871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:48.767871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:48.767871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:48.767871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:48.767871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:48.767871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:48.767871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:48.767871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:48.767871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:37:48.767871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:37:48.767871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:37:48.767871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:37:48.775550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:37:48.775550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:37:48.775550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:37:48.775550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:37:48.775550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:48.775550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:48.775550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:48.775550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:48.775550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:48.775550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:48.775550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:48.775550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:48.775550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:48.775550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:48.775550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:48.775550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:48.777099 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:48.777099 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:48.777099 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:48.777099 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:48.777099 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:37:48.777099 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:37:48.777099 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:37:48.777099 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:37:48.777099 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:37:48.777099 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:37:48.777099 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:37:48.777099 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:37:48.777099 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 625/1249] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:37:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:37:48.778288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36496228-726c-4fa6-823b-13913b3242a9 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:48.898347 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36496228-726c-4fa6-823b-13913b3242a9 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:48.935732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:48.942299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae175b8-261e-478a-9ff3-38db6793ead9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:48.943008 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae175b8-261e-478a-9ff3-38db6793ead9 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:48.943320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae175b8-261e-478a-9ff3-38db6793ead9 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:48.943595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae175b8-261e-478a-9ff3-38db6793ead9 None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:48.944372 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae175b8-261e-478a-9ff3-38db6793ead9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:48.944654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae175b8-261e-478a-9ff3-38db6793ead9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:48.946082 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae175b8-261e-478a-9ff3-38db6793ead9 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:48.957680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 625/1250] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:37:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:37:48.963547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de05d9d-7038-42af-89ba-df6095dd20c5 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:49.050553 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:49.074972 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de05d9d-7038-42af-89ba-df6095dd20c5 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:49.110750 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc75f7-d8dc-41be-ab51-7c861f511b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:49.111649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc75f7-d8dc-41be-ab51-7c861f511b65 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:49.111949 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc75f7-d8dc-41be-ab51-7c861f511b65 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:49.112264 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc75f7-d8dc-41be-ab51-7c861f511b65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:49.124820 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc75f7-d8dc-41be-ab51-7c861f511b65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:49.126526 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc75f7-d8dc-41be-ab51-7c861f511b65 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:49.145627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-9fbc75f7-d8dc-41be-ab51-7c861f511b65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:49.145627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:49.145627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:49.145627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:49.145627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:49.145627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:49.145627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:49.145627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:49.145627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:49.145627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:49.145627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:49.145627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:49.145627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:37:49.145627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:37:49.145627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:37:49.146819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:37:49.146819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:49.146819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:49.146819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:49.146819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:49.146819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:49.146819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:49.146819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:49.146819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:49.146819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:49.146819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:49.146819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:49.146819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:49.146819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:49.146819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:49.146819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:49.146819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:49.147987 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:37:49.147987 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:37:49.147987 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:49.147987 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:37:49.147987 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 626/1251] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:37:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:37:49.152781 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae175b8-261e-478a-9ff3-38db6793ead9 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:49.260217 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae175b8-261e-478a-9ff3-38db6793ead9 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:49.298437 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e76e7c-6969-4812-b106-97b7949ff620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:49.299115 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e76e7c-6969-4812-b106-97b7949ff620 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:49.299435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e76e7c-6969-4812-b106-97b7949ff620 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:49.299718 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e76e7c-6969-4812-b106-97b7949ff620 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:49.300443 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e76e7c-6969-4812-b106-97b7949ff620 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:49.300753 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e76e7c-6969-4812-b106-97b7949ff620 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:49.302781 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e76e7c-6969-4812-b106-97b7949ff620 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:49.315150 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 626/1252] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:49.322087 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc75f7-d8dc-41be-ab51-7c861f511b65 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:49.442931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc75f7-d8dc-41be-ab51-7c861f511b65 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:49.470561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:49.479058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1801b58-7d3f-4725-9f2e-93c958b000a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:49.479931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1801b58-7d3f-4725-9f2e-93c958b000a0 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:49.480215 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1801b58-7d3f-4725-9f2e-93c958b000a0 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:49.480494 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1801b58-7d3f-4725-9f2e-93c958b000a0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:49.488010 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1801b58-7d3f-4725-9f2e-93c958b000a0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:49.489565 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1801b58-7d3f-4725-9f2e-93c958b000a0 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:49.505779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-a1801b58-7d3f-4725-9f2e-93c958b000a0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 20:37:49.505779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:49.505779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:49.505779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:49.505779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:49.505779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:49.505779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:49.505779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:49.505779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:49.505779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:49.505779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:49.505779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:49.505779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:37:49.505779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:37:49.505779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:37:49.505779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:37:49.507038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:49.507038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:49.507038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:37:49.507038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:37:49.507038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:37:49.507038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:37:49.507038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:49.507038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:49.507038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:49.507038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:49.507038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:49.507038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:49.507038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:49.507038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:49.507038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:49.507038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:49.507038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:49.507038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:49.508276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:49.508276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:49.508276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:37:49.508276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:37:49.508276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:37:49.508276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:37:49.508276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:37:49.508276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:37:49.508276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 20:37:49.508276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:37:49.508276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 627/1253] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:37:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:37:49.512945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e76e7c-6969-4812-b106-97b7949ff620 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:49.587559 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:49.647762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e76e7c-6969-4812-b106-97b7949ff620 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:49.687090 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c49d57-1124-4b99-854d-86c65aedc2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:49.687806 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c49d57-1124-4b99-854d-86c65aedc2e7 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:49.688180 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c49d57-1124-4b99-854d-86c65aedc2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:49.688458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c49d57-1124-4b99-854d-86c65aedc2e7 None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:49.689414 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c49d57-1124-4b99-854d-86c65aedc2e7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:49.689699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c49d57-1124-4b99-854d-86c65aedc2e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:49.691461 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c49d57-1124-4b99-854d-86c65aedc2e7 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:49.717018 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 627/1254] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Jul 19 20:37:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:49.718610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1801b58-7d3f-4725-9f2e-93c958b000a0 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:49.838751 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1801b58-7d3f-4725-9f2e-93c958b000a0 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:49.879923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc4c87-9693-4f54-8dbb-685b9db84def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:49.880745 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc4c87-9693-4f54-8dbb-685b9db84def None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:49.881060 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc4c87-9693-4f54-8dbb-685b9db84def None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:49.881340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc4c87-9693-4f54-8dbb-685b9db84def None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:49.952036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:49.966339 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc4c87-9693-4f54-8dbb-685b9db84def None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:49.967830 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc4c87-9693-4f54-8dbb-685b9db84def None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:50.076601 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 628/1255] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:37:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 20:37:50.083174 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c49d57-1124-4b99-854d-86c65aedc2e7 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:50.197954 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c49d57-1124-4b99-854d-86c65aedc2e7 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:50.212068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:50.235639 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d12e0-c0ad-456e-af53-658254a4223e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:50.236435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d12e0-c0ad-456e-af53-658254a4223e None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:50.236721 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d12e0-c0ad-456e-af53-658254a4223e None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:50.237010 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d12e0-c0ad-456e-af53-658254a4223e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:50.247829 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d12e0-c0ad-456e-af53-658254a4223e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:50.249339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d12e0-c0ad-456e-af53-658254a4223e None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:50.269130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-f28d12e0-c0ad-456e-af53-658254a4223e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:50.269130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:50.269130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:50.269130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:50.269130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:50.269130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:50.269130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:50.269130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:50.269130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:50.269130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:50.269130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:50.269130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:50.269130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:37:50.269130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:37:50.269130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:37:50.270154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:37:50.270154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:50.270154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:50.270154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:50.270154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:50.270154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:50.270154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:50.270154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:50.270154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:50.270154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:50.270154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:50.270154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:50.270154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:50.270154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:50.270154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:50.270154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:50.270154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:50.271964 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:37:50.271964 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:37:50.271964 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:50.271964 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:37:50.278668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 628/1256] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:37:50.278805 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc4c87-9693-4f54-8dbb-685b9db84def None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:50.371826 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:50.385639 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc4c87-9693-4f54-8dbb-685b9db84def None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:50.424205 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8483d-531b-4438-bb18-f0e7fbeea9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:50.424872 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8483d-531b-4438-bb18-f0e7fbeea9d8 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:50.425171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8483d-531b-4438-bb18-f0e7fbeea9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:50.425426 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8483d-531b-4438-bb18-f0e7fbeea9d8 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:50.426141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8483d-531b-4438-bb18-f0e7fbeea9d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:50.426448 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8483d-531b-4438-bb18-f0e7fbeea9d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:50.427847 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8483d-531b-4438-bb18-f0e7fbeea9d8 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:50.439681 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 629/1257] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:37:50.446319 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d12e0-c0ad-456e-af53-658254a4223e None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:50.564089 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d12e0-c0ad-456e-af53-658254a4223e None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:50.609411 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5308e98-6add-430c-a0eb-6364431dbf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:50.610500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5308e98-6add-430c-a0eb-6364431dbf32 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:50.610808 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5308e98-6add-430c-a0eb-6364431dbf32 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:50.611235 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5308e98-6add-430c-a0eb-6364431dbf32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:50.620735 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5308e98-6add-430c-a0eb-6364431dbf32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:50.622913 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5308e98-6add-430c-a0eb-6364431dbf32 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:50.639158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-b5308e98-6add-430c-a0eb-6364431dbf32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:37:50.639158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:50.639158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:50.639158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:50.639158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:50.639158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:50.639158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:50.639158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:50.639158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:50.639158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:50.639158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:50.639158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:50.639158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:37:50.639158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:37:50.639158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:37:50.640303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:37:50.640303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:50.640303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:50.640303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:50.640303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:50.640303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:50.640303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:50.640303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:50.640303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:50.640303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:50.640303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:50.640303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:50.640303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:50.640303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:50.640303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:50.640303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:50.640303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:50.641624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:37:50.641624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:37:50.641624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:37:50.641624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:37:50.641624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:37:50.641624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:37:50.641624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:37:50.641624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:37:50.641624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 629/1258] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:37:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:37:50.647222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8483d-531b-4438-bb18-f0e7fbeea9d8 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:50.772632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8483d-531b-4438-bb18-f0e7fbeea9d8 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:50.810850 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38259747-2f61-42a0-afc2-9f586d2bd94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:50.811566 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38259747-2f61-42a0-afc2-9f586d2bd94a None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:50.811858 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38259747-2f61-42a0-afc2-9f586d2bd94a None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:50.812134 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38259747-2f61-42a0-afc2-9f586d2bd94a None admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:50.813508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38259747-2f61-42a0-afc2-9f586d2bd94a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:50.813824 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38259747-2f61-42a0-afc2-9f586d2bd94a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:50.815894 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38259747-2f61-42a0-afc2-9f586d2bd94a None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:50.835071 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 630/1259] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:37:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:37:50.836601 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5308e98-6add-430c-a0eb-6364431dbf32 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:50.864813 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:50.944462 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5308e98-6add-430c-a0eb-6364431dbf32 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:50.979815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54c1d2-d226-4a4c-8332-b47e1d57fa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:50.980481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54c1d2-d226-4a4c-8332-b47e1d57fa13 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:50.980762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54c1d2-d226-4a4c-8332-b47e1d57fa13 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:50.981035 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54c1d2-d226-4a4c-8332-b47e1d57fa13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:50.981873 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54c1d2-d226-4a4c-8332-b47e1d57fa13 None admin] RBAC: Adding query filter params (role.id=b30f01ef95004a1b84fc029830bdf053, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=04843ec31eb84585944c7a2b9cd1c0cb) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:50.982180 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54c1d2-d226-4a4c-8332-b47e1d57fa13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:50.983634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54c1d2-d226-4a4c-8332-b47e1d57fa13 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:50.989624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 630/1260] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:37:50 2022] GET /identity/v3/role_assignments?user.id=04843ec31eb84585944c7a2b9cd1c0cb&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=b30f01ef95004a1b84fc029830bdf053 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:53.027867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2cd0d-b369-415b-aaeb-b42620206d13 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:53.028394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2cd0d-b369-415b-aaeb-b42620206d13 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:53.028394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2cd0d-b369-415b-aaeb-b42620206d13 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:53.029777 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 631/1261] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:37:53.034987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c547a3-9a53-431a-a2d0-cae4b4110ddb None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:53.035414 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c547a3-9a53-431a-a2d0-cae4b4110ddb None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:53.035584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c547a3-9a53-431a-a2d0-cae4b4110ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:53.052984 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-64c547a3-9a53-431a-a2d0-cae4b4110ddb None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:37:53.054170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-64c547a3-9a53-431a-a2d0-cae4b4110ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:37:53.119281 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 631/1262] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:37:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:37:53.141897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2cd0d-b369-415b-aaeb-b42620206d13 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:53.152667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:53.244471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2cd0d-b369-415b-aaeb-b42620206d13 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:53.276715 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbbf7d-099c-4823-aa16-193b9ce11041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:53.277496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbbf7d-099c-4823-aa16-193b9ce11041 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:53.277780 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbbf7d-099c-4823-aa16-193b9ce11041 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:53.278057 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbbf7d-099c-4823-aa16-193b9ce11041 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:53.288373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbbf7d-099c-4823-aa16-193b9ce11041 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:37:53.296373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-c0fbbf7d-099c-4823-aa16-193b9ce11041 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:37:53.296373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:53.296373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:53.296373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:53.296373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:53.296373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:53.296373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:53.296373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:53.296373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:53.296373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:53.296373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:53.296373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:53.296373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:37:53.296373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:37:53.296373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:37:53.296373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:37:53.297573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:37:53.297573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:37:53.297573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:37:53.297573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:37:53.297573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:53.297573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:53.297573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:53.297573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:53.297573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:53.297573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:53.297573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:53.297573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:53.297573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:53.297573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:53.297573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:53.297573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:53.298584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:53.298584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:53.298584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:53.298584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:53.298584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:37:53.298584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:37:53.298584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:37:53.298584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:37:53.298584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:37:53.298584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:37:53.298584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:37:53.298584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:37:53.298584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 632/1263] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:37:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:37:53.304294 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c547a3-9a53-431a-a2d0-cae4b4110ddb None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:53.322814 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:53.399334 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c547a3-9a53-431a-a2d0-cae4b4110ddb None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:53.432545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451973df-1076-4607-8d64-ef7b3aec100a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:53.433199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451973df-1076-4607-8d64-ef7b3aec100a None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:53.433477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451973df-1076-4607-8d64-ef7b3aec100a None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:53.433752 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451973df-1076-4607-8d64-ef7b3aec100a None admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:53.434487 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451973df-1076-4607-8d64-ef7b3aec100a None admin] RBAC: Adding query filter params (name=admin) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:53.434789 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451973df-1076-4607-8d64-ef7b3aec100a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:53.436171 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451973df-1076-4607-8d64-ef7b3aec100a None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:53.443955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 632/1264] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:37:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:53.449708 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbbf7d-099c-4823-aa16-193b9ce11041 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:53.514012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:53.547212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbbf7d-099c-4823-aa16-193b9ce11041 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:53.585032 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f028e60-af8f-40af-b763-7539d66782c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:53.586003 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f028e60-af8f-40af-b763-7539d66782c7 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:53.586349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f028e60-af8f-40af-b763-7539d66782c7 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:53.586697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f028e60-af8f-40af-b763-7539d66782c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:53.600357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f028e60-af8f-40af-b763-7539d66782c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:53.602200 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f028e60-af8f-40af-b763-7539d66782c7 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:53.624368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-5f028e60-af8f-40af-b763-7539d66782c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:53.624368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:53.624368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:53.624368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:53.624368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:53.624368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:53.624368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:53.624368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:53.624368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:53.624368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:53.624368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:53.624368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:53.624368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:37:53.624368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:37:53.624368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:37:53.625436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:37:53.625436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:53.625436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:53.625436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:53.625436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:53.625436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:53.625436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:53.625436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:53.625436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:53.625436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:53.625436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:53.625436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:53.625436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:53.625436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:53.625436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:53.625436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:53.625436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:53.626437 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:37:53.626437 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:37:53.626437 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:53.626437 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:37:53.626437 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 633/1265] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:37:53.634171 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451973df-1076-4607-8d64-ef7b3aec100a None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:53.714932 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:53.733859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451973df-1076-4607-8d64-ef7b3aec100a None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:53.766561 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbad69-20e1-49a0-afe1-e38e650fd832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:53.767219 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbad69-20e1-49a0-afe1-e38e650fd832 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:53.767533 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbad69-20e1-49a0-afe1-e38e650fd832 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:53.767940 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbad69-20e1-49a0-afe1-e38e650fd832 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:53.768650 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbad69-20e1-49a0-afe1-e38e650fd832 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:53.768951 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbad69-20e1-49a0-afe1-e38e650fd832 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:53.770294 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddbad69-20e1-49a0-afe1-e38e650fd832 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:53.781669 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 633/1266] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:53.787786 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f028e60-af8f-40af-b763-7539d66782c7 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:53.886091 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f028e60-af8f-40af-b763-7539d66782c7 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:53.905407 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:53.920074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106b8e0-b4ba-4569-93e2-167394dc55cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:53.920868 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106b8e0-b4ba-4569-93e2-167394dc55cc None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:53.921152 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106b8e0-b4ba-4569-93e2-167394dc55cc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:53.921426 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106b8e0-b4ba-4569-93e2-167394dc55cc None admin] PATH_INFO: `/v3/users/placement` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:53.929371 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106b8e0-b4ba-4569-93e2-167394dc55cc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:53.930791 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106b8e0-b4ba-4569-93e2-167394dc55cc None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:53.944867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-3106b8e0-b4ba-4569-93e2-167394dc55cc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 20:37:53.944867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:53.944867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:53.944867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:53.944867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:53.944867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:53.944867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:53.944867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:53.944867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:53.944867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:53.944867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:53.944867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:53.944867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:37:53.944867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:37:53.944867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:37:53.944867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:37:53.946065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:53.946065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:53.946065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:37:53.946065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:37:53.946065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:37:53.946065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:37:53.946065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:53.946065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:53.946065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:53.946065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:53.946065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:53.946065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:53.946065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:53.946065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:53.946065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:53.946065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:53.946065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:53.946065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:53.947522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:53.947522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:53.947522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:37:53.947522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:37:53.947522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:37:53.947522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:37:53.947522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:37:53.947522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:37:53.947522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 20:37:53.947522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:37:53.947522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 634/1267] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:37:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:37:53.952323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbad69-20e1-49a0-afe1-e38e650fd832 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:54.048438 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddbad69-20e1-49a0-afe1-e38e650fd832 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:54.081045 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73b6d2-d5ad-4972-8a1d-1d8686135d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:54.081701 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73b6d2-d5ad-4972-8a1d-1d8686135d82 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:54.081981 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73b6d2-d5ad-4972-8a1d-1d8686135d82 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:54.082250 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73b6d2-d5ad-4972-8a1d-1d8686135d82 None admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:54.083110 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73b6d2-d5ad-4972-8a1d-1d8686135d82 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:54.083492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73b6d2-d5ad-4972-8a1d-1d8686135d82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:54.084904 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73b6d2-d5ad-4972-8a1d-1d8686135d82 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:54.093162 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:54.102383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 634/1268] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Jul 19 20:37:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:37:54.108250 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106b8e0-b4ba-4569-93e2-167394dc55cc None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:54.209478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106b8e0-b4ba-4569-93e2-167394dc55cc None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:54.245684 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64257097-f515-4a63-8e8c-d041fa57409e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:54.246578 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64257097-f515-4a63-8e8c-d041fa57409e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:54.246861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64257097-f515-4a63-8e8c-d041fa57409e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:54.247135 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64257097-f515-4a63-8e8c-d041fa57409e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:54.260896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64257097-f515-4a63-8e8c-d041fa57409e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:54.262443 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64257097-f515-4a63-8e8c-d041fa57409e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:54.280471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-64257097-f515-4a63-8e8c-d041fa57409e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:54.280471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:54.280471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:54.280471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:54.280471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:54.280471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:54.280471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:54.280471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:54.280471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:54.280471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:54.280471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:54.280471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:54.280471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:37:54.280471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:37:54.280471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:37:54.281593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:37:54.281593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:54.281593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:54.281593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:54.281593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:54.281593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:54.281593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:54.281593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:54.281593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:54.281593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:54.281593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:54.281593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:54.281593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:54.281593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:54.281593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:54.281593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:54.281593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:54.282748 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:37:54.282748 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:37:54.282748 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:54.282748 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:37:54.282748 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 635/1269] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:37:54.287603 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73b6d2-d5ad-4972-8a1d-1d8686135d82 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:54.385794 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73b6d2-d5ad-4972-8a1d-1d8686135d82 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:54.418614 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf83b0-61b4-4042-a480-af696a925196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:54.419296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf83b0-61b4-4042-a480-af696a925196 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:54.419575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf83b0-61b4-4042-a480-af696a925196 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:54.419847 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf83b0-61b4-4042-a480-af696a925196 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:54.420652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf83b0-61b4-4042-a480-af696a925196 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:54.420960 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf83b0-61b4-4042-a480-af696a925196 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:54.422306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf83b0-61b4-4042-a480-af696a925196 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:54.433597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 635/1270] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:54.439248 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64257097-f515-4a63-8e8c-d041fa57409e None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:54.470420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:54.537191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64257097-f515-4a63-8e8c-d041fa57409e None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:54.572302 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6857a37-82fd-4db4-a856-68242f2261cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:54.573432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6857a37-82fd-4db4-a856-68242f2261cc None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:54.573871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6857a37-82fd-4db4-a856-68242f2261cc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:54.574241 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6857a37-82fd-4db4-a856-68242f2261cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:54.583990 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6857a37-82fd-4db4-a856-68242f2261cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:54.585466 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6857a37-82fd-4db4-a856-68242f2261cc None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:54.602711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-c6857a37-82fd-4db4-a856-68242f2261cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:37:54.602711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:54.602711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:54.602711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:54.602711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:54.602711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:54.602711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:54.602711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:54.602711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:54.602711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:54.602711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:54.602711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:54.602711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:37:54.602711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:37:54.602711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:37:54.603934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:37:54.603934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:54.603934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:54.603934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:54.603934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:54.603934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:54.603934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:54.603934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:54.603934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:54.603934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:54.603934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:54.603934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:54.603934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:54.603934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:54.603934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:54.603934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:54.603934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:54.605008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:37:54.605008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:37:54.605008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:37:54.605008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:37:54.605008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:37:54.605008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:37:54.605008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:37:54.605008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:37:54.605008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 636/1271] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:37:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 20:37:54.609819 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf83b0-61b4-4042-a480-af696a925196 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:54.667945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:54.708433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf83b0-61b4-4042-a480-af696a925196 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:54.741893 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f43937-7be9-468c-8fe2-a8f04f91b632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:54.742550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f43937-7be9-468c-8fe2-a8f04f91b632 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:54.742836 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f43937-7be9-468c-8fe2-a8f04f91b632 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:54.743114 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f43937-7be9-468c-8fe2-a8f04f91b632 None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:54.743935 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f43937-7be9-468c-8fe2-a8f04f91b632 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:54.744252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f43937-7be9-468c-8fe2-a8f04f91b632 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:54.745676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f43937-7be9-468c-8fe2-a8f04f91b632 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:54.758654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 636/1272] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:37:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:54.764708 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6857a37-82fd-4db4-a856-68242f2261cc None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:54.853715 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:54.862610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6857a37-82fd-4db4-a856-68242f2261cc None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:54.895567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c4a1f-47a7-4ec2-8bcb-bf54206fd753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:54.896453 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c4a1f-47a7-4ec2-8bcb-bf54206fd753 None admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:54.896730 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c4a1f-47a7-4ec2-8bcb-bf54206fd753 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:54.897001 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c4a1f-47a7-4ec2-8bcb-bf54206fd753 None admin] PATH_INFO: `/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/04843ec31eb84585944c7a2b9cd1c0cb/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:54.898931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c4a1f-47a7-4ec2-8bcb-bf54206fd753 None admin] RBAC: Authorizing `identity:create_grant(project_id=327868f4f62e4e4a9c5bef4acd32fb29, user_id=04843ec31eb84585944c7a2b9cd1c0cb, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:54.900388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c4a1f-47a7-4ec2-8bcb-bf54206fd753 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:54.913225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 637/1273] 10.222.0.77 () {58 vars in 1439 bytes} [Tue Jul 19 20:37:54 2022] PUT /identity/v3/projects/327868f4f62e4e4a9c5bef4acd32fb29/users/04843ec31eb84585944c7a2b9cd1c0cb/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:37:56.918992 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af8ee8-c0aa-4c09-acb3-c91390518e99 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:56.919502 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af8ee8-c0aa-4c09-acb3-c91390518e99 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:56.919606 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af8ee8-c0aa-4c09-acb3-c91390518e99 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:56.920938 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 637/1274] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:37:56.926015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437406ed-bec1-426f-ba2e-cb9fd3fed892 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:56.926432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437406ed-bec1-426f-ba2e-cb9fd3fed892 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:56.926567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437406ed-bec1-426f-ba2e-cb9fd3fed892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:56.943473 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-437406ed-bec1-426f-ba2e-cb9fd3fed892 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:37:56.944646 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-437406ed-bec1-426f-ba2e-cb9fd3fed892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:37:57.009128 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 638/1275] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:37:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:37:57.031765 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af8ee8-c0aa-4c09-acb3-c91390518e99 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:57.132469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af8ee8-c0aa-4c09-acb3-c91390518e99 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:57.149842 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:57.166718 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23218235-b906-48fb-9531-0a83cd7eb815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:57.167533 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23218235-b906-48fb-9531-0a83cd7eb815 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:57.167820 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23218235-b906-48fb-9531-0a83cd7eb815 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:57.168100 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23218235-b906-48fb-9531-0a83cd7eb815 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:57.178087 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23218235-b906-48fb-9531-0a83cd7eb815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 20:37:57.185818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-23218235-b906-48fb-9531-0a83cd7eb815 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:37:57.185818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:57.185818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:57.185818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:57.185818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:57.185818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:57.185818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:57.185818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:57.185818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:57.185818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:57.185818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:57.185818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:57.185818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 20:37:57.185818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 20:37:57.185818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 20:37:57.185818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 20:37:57.186920 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 20:37:57.186920 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 20:37:57.186920 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 20:37:57.186920 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 20:37:57.186920 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:57.186920 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:57.186920 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:57.186920 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:57.186920 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:57.186920 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:57.186920 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:57.186920 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:57.186920 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:57.186920 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:57.186920 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:57.186920 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:57.187949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:57.187949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:57.187949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:57.187949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:57.187949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 20:37:57.187949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 20:37:57.187949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 20:37:57.187949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 20:37:57.187949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 20:37:57.187949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 20:37:57.187949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 20:37:57.187949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:37:57.187949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 638/1276] 10.222.0.77 () {56 vars in 1096 bytes} [Tue Jul 19 20:37:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:37:57.193619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437406ed-bec1-426f-ba2e-cb9fd3fed892 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:57.271787 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:57.289924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437406ed-bec1-426f-ba2e-cb9fd3fed892 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:57.323386 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cf9e9-800d-47cc-b793-c5c8cb71252f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:57.324042 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cf9e9-800d-47cc-b793-c5c8cb71252f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:57.324321 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cf9e9-800d-47cc-b793-c5c8cb71252f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:57.324594 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210cf9e9-800d-47cc-b793-c5c8cb71252f None admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:57.325337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cf9e9-800d-47cc-b793-c5c8cb71252f None admin] RBAC: Adding query filter params (name=admin) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:57.325642 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cf9e9-800d-47cc-b793-c5c8cb71252f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:57.326993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210cf9e9-800d-47cc-b793-c5c8cb71252f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:57.334929 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 639/1277] 10.222.0.77 () {56 vars in 1099 bytes} [Tue Jul 19 20:37:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:57.340506 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23218235-b906-48fb-9531-0a83cd7eb815 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:57.460181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23218235-b906-48fb-9531-0a83cd7eb815 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:57.491938 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c390ad-0fcd-42b9-9e97-c3ee378c333e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:57.492717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c390ad-0fcd-42b9-9e97-c3ee378c333e None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:57.492994 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c390ad-0fcd-42b9-9e97-c3ee378c333e None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:57.493262 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c390ad-0fcd-42b9-9e97-c3ee378c333e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:57.503462 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c390ad-0fcd-42b9-9e97-c3ee378c333e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:57.504885 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c390ad-0fcd-42b9-9e97-c3ee378c333e None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:57.521883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-53c390ad-0fcd-42b9-9e97-c3ee378c333e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:57.521883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:57.521883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:57.521883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:57.521883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:57.521883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:57.521883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:57.521883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:57.521883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:57.521883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:57.521883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:57.521883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:57.521883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:37:57.521883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:37:57.521883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:37:57.522950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:37:57.522950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:57.522950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:57.522950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:57.522950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:57.522950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:57.522950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:57.522950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:57.522950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:57.522950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:57.522950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:57.522950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:57.522950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:57.522950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:57.522950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:57.522950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:57.522950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:57.524170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:37:57.524170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:37:57.524170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:57.524170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:37:57.524170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 639/1278] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:37:57.528857 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cf9e9-800d-47cc-b793-c5c8cb71252f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:57.639894 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210cf9e9-800d-47cc-b793-c5c8cb71252f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:57.672766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c0008-1360-44bc-a84d-0ca0a6bc5630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:57.673412 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c0008-1360-44bc-a84d-0ca0a6bc5630 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:57.673691 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c0008-1360-44bc-a84d-0ca0a6bc5630 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:57.673965 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c0008-1360-44bc-a84d-0ca0a6bc5630 None admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:57.674676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c0008-1360-44bc-a84d-0ca0a6bc5630 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:57.674981 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c0008-1360-44bc-a84d-0ca0a6bc5630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:57.676362 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c0008-1360-44bc-a84d-0ca0a6bc5630 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:57.689584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 640/1279] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:57.695404 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c390ad-0fcd-42b9-9e97-c3ee378c333e None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:57.727344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:57.794393 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c390ad-0fcd-42b9-9e97-c3ee378c333e None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:57.826368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e6ca4-4380-43ac-aaf9-24260a532904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:57.827157 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e6ca4-4380-43ac-aaf9-24260a532904 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:57.827469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e6ca4-4380-43ac-aaf9-24260a532904 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:57.827745 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e6ca4-4380-43ac-aaf9-24260a532904 None admin] PATH_INFO: `/v3/users/placement` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:57.834867 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e6ca4-4380-43ac-aaf9-24260a532904 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:57.836312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e6ca4-4380-43ac-aaf9-24260a532904 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:57.850712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-031e6ca4-4380-43ac-aaf9-24260a532904 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 20:37:57.850712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:57.850712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:57.850712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:57.850712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:57.850712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:57.850712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:57.850712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:57.850712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:57.850712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:57.850712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:57.850712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:57.850712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 20:37:57.850712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 20:37:57.850712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 20:37:57.850712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 20:37:57.851882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:57.851882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:57.851882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 20:37:57.851882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:37:57.851882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 20:37:57.851882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 20:37:57.851882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:57.851882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:57.851882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:57.851882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:57.851882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:57.851882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:57.851882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:57.851882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:57.851882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:57.851882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:57.851882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:57.851882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:57.853073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:57.853073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:57.853073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 20:37:57.853073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 20:37:57.853073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 20:37:57.853073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 20:37:57.853073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 20:37:57.853073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 20:37:57.853073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 20:37:57.853073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:37:57.853073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 640/1280] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:37:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:37:57.857760 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c0008-1360-44bc-a84d-0ca0a6bc5630 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:57.861567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:57.955431 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c0008-1360-44bc-a84d-0ca0a6bc5630 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:57.988916 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b52cd-23ff-43c1-b481-559046e73c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:57.989576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b52cd-23ff-43c1-b481-559046e73c3f None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:57.990443 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b52cd-23ff-43c1-b481-559046e73c3f None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:57.990757 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b52cd-23ff-43c1-b481-559046e73c3f None admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:57.991711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b52cd-23ff-43c1-b481-559046e73c3f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:57.992059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b52cd-23ff-43c1-b481-559046e73c3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:57.993563 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b52cd-23ff-43c1-b481-559046e73c3f None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:58.010105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 641/1281] 10.222.0.77 () {56 vars in 1143 bytes} [Tue Jul 19 20:37:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:58.015787 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e6ca4-4380-43ac-aaf9-24260a532904 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:58.103734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:58.113233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e6ca4-4380-43ac-aaf9-24260a532904 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:58.148728 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818d719-eeaf-4527-be6c-34b7bf27e673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:58.149373 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818d719-eeaf-4527-be6c-34b7bf27e673 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:58.149657 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818d719-eeaf-4527-be6c-34b7bf27e673 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:58.149933 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818d719-eeaf-4527-be6c-34b7bf27e673 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:58.215559 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818d719-eeaf-4527-be6c-34b7bf27e673 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:58.216995 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818d719-eeaf-4527-be6c-34b7bf27e673 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:58.301859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:58.312094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 641/1282] 10.222.0.77 () {58 vars in 1282 bytes} [Tue Jul 19 20:37:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 20:37:58.317709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b52cd-23ff-43c1-b481-559046e73c3f None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:58.377327 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:58.415142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b52cd-23ff-43c1-b481-559046e73c3f None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:58.447410 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c89ae5-6a39-4719-913e-59640b09a378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:58.448186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c89ae5-6a39-4719-913e-59640b09a378 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:58.448462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c89ae5-6a39-4719-913e-59640b09a378 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:58.448731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c89ae5-6a39-4719-913e-59640b09a378 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:58.458341 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c89ae5-6a39-4719-913e-59640b09a378 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:58.460384 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c89ae5-6a39-4719-913e-59640b09a378 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:58.477197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-52c89ae5-6a39-4719-913e-59640b09a378 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:58.477197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:58.477197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:58.477197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:58.477197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:58.477197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:58.477197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:58.477197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:58.477197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:58.477197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:58.477197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:58.477197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:58.477197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 20:37:58.477197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 20:37:58.477197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 20:37:58.478275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 20:37:58.478275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:58.478275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:58.478275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:58.478275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:58.478275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:58.478275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:58.478275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:58.478275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:58.478275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:58.478275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:58.478275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:58.478275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:58.478275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:58.478275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:58.478275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:58.478275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:58.479217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 20:37:58.479217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 20:37:58.479217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 20:37:58.479217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:37:58.479217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 642/1283] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:37:58.484142 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818d719-eeaf-4527-be6c-34b7bf27e673 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:58.582079 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818d719-eeaf-4527-be6c-34b7bf27e673 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:58.616081 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ba0d2-5d9f-4961-a9fc-05dfa14b29a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:58.616735 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ba0d2-5d9f-4961-a9fc-05dfa14b29a3 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:58.617018 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ba0d2-5d9f-4961-a9fc-05dfa14b29a3 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:58.617292 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ba0d2-5d9f-4961-a9fc-05dfa14b29a3 None admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:58.618005 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ba0d2-5d9f-4961-a9fc-05dfa14b29a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:58.618308 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ba0d2-5d9f-4961-a9fc-05dfa14b29a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:58.619692 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ba0d2-5d9f-4961-a9fc-05dfa14b29a3 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:58.630984 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 642/1284] 10.222.0.77 () {56 vars in 1109 bytes} [Tue Jul 19 20:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:58.636547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c89ae5-6a39-4719-913e-59640b09a378 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:58.732101 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c89ae5-6a39-4719-913e-59640b09a378 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:58.746745 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:58.767508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8c2cb-25eb-4c2b-ba7c-c180e87fd365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:58.768309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8c2cb-25eb-4c2b-ba7c-c180e87fd365 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:58.768588 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8c2cb-25eb-4c2b-ba7c-c180e87fd365 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:58.768861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8c2cb-25eb-4c2b-ba7c-c180e87fd365 None admin] PATH_INFO: `/v3/projects/service` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:58.775880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8c2cb-25eb-4c2b-ba7c-c180e87fd365 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:58.777306 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8c2cb-25eb-4c2b-ba7c-c180e87fd365 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:58.791765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application [None req-f4b8c2cb-25eb-4c2b-ba7c-c180e87fd365 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:37:58.791765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:37:58.791765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:37:58.791765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:37:58.791765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:37:58.791765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:37:58.791765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:37:58.791765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:37:58.791765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:37:58.791765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:37:58.791765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:37:58.791765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:37:58.791765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 20:37:58.791765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 20:37:58.791765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 20:37:58.792903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 20:37:58.792903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:37:58.792903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:37:58.792903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:37:58.792903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:37:58.792903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:37:58.792903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:37:58.792903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:37:58.792903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application with Lock( Jul 19 20:37:58.792903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:37:58.792903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:37:58.792903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:37:58.792903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:37:58.792903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:37:58.792903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:37:58.792903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:37:58.792903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:37:58.794220 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 20:37:58.794220 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 20:37:58.794220 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 20:37:58.794220 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 20:37:58.794220 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 20:37:58.794220 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 20:37:58.794220 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 20:37:58.794220 dv-cinder-749155-8-smb devstack@keystone.service[92088]: ERROR keystone.server.flask.application Jul 19 20:37:58.794220 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 643/1285] 10.222.0.77 () {56 vars in 1111 bytes} [Tue Jul 19 20:37:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:37:58.798752 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ba0d2-5d9f-4961-a9fc-05dfa14b29a3 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:58.847814 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:37:58.898655 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ba0d2-5d9f-4961-a9fc-05dfa14b29a3 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:58.934091 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16faff8c-6278-4fe0-8dfb-c49d70a5aeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:58.934734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faff8c-6278-4fe0-8dfb-c49d70a5aeec None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:58.935012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faff8c-6278-4fe0-8dfb-c49d70a5aeec None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:58.935302 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16faff8c-6278-4fe0-8dfb-c49d70a5aeec None admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:58.936089 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16faff8c-6278-4fe0-8dfb-c49d70a5aeec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:58.936393 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16faff8c-6278-4fe0-8dfb-c49d70a5aeec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:58.937808 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16faff8c-6278-4fe0-8dfb-c49d70a5aeec None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:58.950209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 643/1286] 10.222.0.77 () {56 vars in 1148 bytes} [Tue Jul 19 20:37:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:37:58.956205 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8c2cb-25eb-4c2b-ba7c-c180e87fd365 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:37:59.051780 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8c2cb-25eb-4c2b-ba7c-c180e87fd365 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:37:59.084291 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5610a9-4a8b-45dc-a5ca-5302633ca8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:37:59.084919 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5610a9-4a8b-45dc-a5ca-5302633ca8e4 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:37:59.085198 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5610a9-4a8b-45dc-a5ca-5302633ca8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:37:59.085466 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5610a9-4a8b-45dc-a5ca-5302633ca8e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:37:59.086279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5610a9-4a8b-45dc-a5ca-5302633ca8e4 None admin] RBAC: Adding query filter params (role.id=b30f01ef95004a1b84fc029830bdf053, scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29, user.id=04843ec31eb84585944c7a2b9cd1c0cb) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:37:59.086584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5610a9-4a8b-45dc-a5ca-5302633ca8e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:37:59.087994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5610a9-4a8b-45dc-a5ca-5302633ca8e4 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:37:59.093556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 644/1287] 10.222.0.77 () {56 vars in 1374 bytes} [Tue Jul 19 20:37:58 2022] GET /identity/v3/role_assignments?user.id=04843ec31eb84585944c7a2b9cd1c0cb&scope.project.id=327868f4f62e4e4a9c5bef4acd32fb29&role.id=b30f01ef95004a1b84fc029830bdf053 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:38:01.191463 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e06aa-6691-450e-979d-872aaf712b58 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:38:01.191991 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e06aa-6691-450e-979d-872aaf712b58 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:38:01.191991 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e06aa-6691-450e-979d-872aaf712b58 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:38:01.193888 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 644/1288] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:38:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:38:01.199095 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af14bfc-0a74-408c-b0cc-c5901d0f4e24 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:38:01.199530 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af14bfc-0a74-408c-b0cc-c5901d0f4e24 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:38:01.199673 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af14bfc-0a74-408c-b0cc-c5901d0f4e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:38:01.216025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-5af14bfc-0a74-408c-b0cc-c5901d0f4e24 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:38:01.217214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-5af14bfc-0a74-408c-b0cc-c5901d0f4e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:38:01.246158 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:01.282398 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 645/1289] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:38:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 20:38:01.305112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e06aa-6691-450e-979d-872aaf712b58 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:38:01.403823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e06aa-6691-450e-979d-872aaf712b58 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:38:01.414859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:01.438975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f4fdb-fa00-4585-8f13-c2fbb135ebf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:38:01.439811 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f4fdb-fa00-4585-8f13-c2fbb135ebf1 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:38:01.440099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f4fdb-fa00-4585-8f13-c2fbb135ebf1 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:38:01.440377 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f4fdb-fa00-4585-8f13-c2fbb135ebf1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:38:01.441029 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f4fdb-fa00-4585-8f13-c2fbb135ebf1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:38:01.442514 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f4fdb-fa00-4585-8f13-c2fbb135ebf1 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:38:01.454245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-a10f4fdb-fa00-4585-8f13-c2fbb135ebf1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 20:38:01.454245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:38:01.454245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:38:01.454245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:38:01.454245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:38:01.454245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:38:01.454245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:38:01.454245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:38:01.454245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 20:38:01.454245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:38:01.454245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:38:01.454245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:38:01.454245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:38:01.454245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:38:01.454245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:38:01.454245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:38:01.454245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:38:01.455469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:38:01.455469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:38:01.455469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:38:01.455469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:38:01.455469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:38:01.455469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:38:01.455469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:38:01.455469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:38:01.455469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:38:01.455469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:38:01.455469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:38:01.455469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:38:01.455469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:38:01.455469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:38:01.455469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:38:01.455469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:38:01.456339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:38:01.456339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:38:01.456339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:38:01.456339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:38:01.456339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:38:01.456339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:38:01.456339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:38:01.456339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:38:01.456339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:38:01.456339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:38:01.456339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:38:01.456339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:38:01.456339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 20:38:01.456339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:38:01.456339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 645/1290] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Jul 19 20:38:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:38:01.461674 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af14bfc-0a74-408c-b0cc-c5901d0f4e24 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:38:01.561703 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af14bfc-0a74-408c-b0cc-c5901d0f4e24 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:38:01.600016 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58254c5-f218-4fd9-a177-453e478220dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:38:01.601098 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58254c5-f218-4fd9-a177-453e478220dc None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:38:01.601447 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58254c5-f218-4fd9-a177-453e478220dc None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:38:01.601859 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58254c5-f218-4fd9-a177-453e478220dc None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:38:01.602895 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58254c5-f218-4fd9-a177-453e478220dc None admin] RBAC: Adding query filter params (name=placement) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:38:01.603393 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58254c5-f218-4fd9-a177-453e478220dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:38:01.605766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58254c5-f218-4fd9-a177-453e478220dc None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:38:01.613152 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 646/1291] 10.222.0.77 () {56 vars in 1116 bytes} [Tue Jul 19 20:38:01 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:38:01.619933 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f4fdb-fa00-4585-8f13-c2fbb135ebf1 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:38:01.720227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f4fdb-fa00-4585-8f13-c2fbb135ebf1 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:38:01.754305 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392457a-07e2-437e-984b-9aa0cb3c85b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:38:01.754966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392457a-07e2-437e-984b-9aa0cb3c85b9 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:38:01.755421 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392457a-07e2-437e-984b-9aa0cb3c85b9 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:38:01.755902 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392457a-07e2-437e-984b-9aa0cb3c85b9 None admin] PATH_INFO: `/v3/services` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:38:01.756463 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392457a-07e2-437e-984b-9aa0cb3c85b9 None admin] RBAC: Adding query filter params (type=placement) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:38:01.756770 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392457a-07e2-437e-984b-9aa0cb3c85b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:38:01.758128 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392457a-07e2-437e-984b-9aa0cb3c85b9 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:38:01.762565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 646/1292] 10.222.0.77 () {56 vars in 1116 bytes} [Tue Jul 19 20:38:01 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:38:03.856862 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bce4ce-8786-4c06-a4e0-dafb39ed81d0 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:38:03.857422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bce4ce-8786-4c06-a4e0-dafb39ed81d0 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:38:03.857422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bce4ce-8786-4c06-a4e0-dafb39ed81d0 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:38:03.858775 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 647/1293] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:38:03.863825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbc53d-6c90-48c7-8c83-621c0093a56e None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:38:03.864248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbc53d-6c90-48c7-8c83-621c0093a56e None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:38:03.864368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbbc53d-6c90-48c7-8c83-621c0093a56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:38:03.884017 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-9bbbc53d-6c90-48c7-8c83-621c0093a56e None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:38:03.885212 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9bbbc53d-6c90-48c7-8c83-621c0093a56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:38:03.915544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:03.954019 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 647/1294] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:38:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:38:03.978622 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bce4ce-8786-4c06-a4e0-dafb39ed81d0 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:38:04.009381 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:04.076718 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bce4ce-8786-4c06-a4e0-dafb39ed81d0 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:38:04.110124 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a12eb3-f1cf-4e48-9f6b-8b1332828149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:38:04.110702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a12eb3-f1cf-4e48-9f6b-8b1332828149 None admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:38:04.110985 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a12eb3-f1cf-4e48-9f6b-8b1332828149 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:38:04.111250 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a12eb3-f1cf-4e48-9f6b-8b1332828149 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:38:04.111997 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a12eb3-f1cf-4e48-9f6b-8b1332828149 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:38:04.113343 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a12eb3-f1cf-4e48-9f6b-8b1332828149 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:38:04.127326 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 648/1295] 10.222.0.77 () {60 vars in 1141 bytes} [Tue Jul 19 20:38:03 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:38:06.160764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703cbde-e899-4ebb-a8ba-70c3d53aad86 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:38:06.161290 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703cbde-e899-4ebb-a8ba-70c3d53aad86 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:38:06.161290 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703cbde-e899-4ebb-a8ba-70c3d53aad86 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:38:06.162617 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 648/1296] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:38:06.168065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd3aa2-d9e1-40d0-aea1-1426e123f62f None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:38:06.168456 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd3aa2-d9e1-40d0-aea1-1426e123f62f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:38:06.168619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd3aa2-d9e1-40d0-aea1-1426e123f62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:38:06.184811 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-69dd3aa2-d9e1-40d0-aea1-1426e123f62f None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:38:06.185977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-69dd3aa2-d9e1-40d0-aea1-1426e123f62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:38:06.256289 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 649/1297] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:38:06 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:38:06.279389 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703cbde-e899-4ebb-a8ba-70c3d53aad86 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:38:06.377170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703cbde-e899-4ebb-a8ba-70c3d53aad86 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:38:06.409564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97079172-cd08-4864-a9b7-738714e55d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:38:06.410352 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97079172-cd08-4864-a9b7-738714e55d13 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:38:06.410630 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97079172-cd08-4864-a9b7-738714e55d13 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:38:06.410949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97079172-cd08-4864-a9b7-738714e55d13 None admin] PATH_INFO: `/v3/services/placement` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:38:06.411595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97079172-cd08-4864-a9b7-738714e55d13 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:38:06.412941 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97079172-cd08-4864-a9b7-738714e55d13 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:38:06.424854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-97079172-cd08-4864-a9b7-738714e55d13 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 20:38:06.424854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:38:06.424854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:38:06.424854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:38:06.424854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:38:06.424854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:38:06.424854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:38:06.424854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:38:06.424854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 20:38:06.424854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:38:06.424854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:38:06.424854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:38:06.424854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:38:06.424854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:38:06.424854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:38:06.424854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:38:06.424854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:38:06.426127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:38:06.426127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:38:06.426127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:38:06.426127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:38:06.426127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:38:06.426127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:38:06.426127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:38:06.426127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:38:06.426127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:38:06.426127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:38:06.426127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:38:06.426127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:38:06.426127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:38:06.426127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:38:06.426127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:38:06.426127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:38:06.427699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:38:06.427699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:38:06.427699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:38:06.427699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:38:06.427699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:38:06.427699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:38:06.427699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:38:06.427699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:38:06.427699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:38:06.427699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:38:06.427699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:38:06.427699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:38:06.427699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 20:38:06.427699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:38:06.427699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 649/1298] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Jul 19 20:38:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:38:06.432716 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd3aa2-d9e1-40d0-aea1-1426e123f62f None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:38:06.451012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:06.530088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd3aa2-d9e1-40d0-aea1-1426e123f62f None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:38:06.575795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e68f3e-84aa-4d07-8b07-b425ffef5155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:38:06.576530 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e68f3e-84aa-4d07-8b07-b425ffef5155 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:38:06.576847 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e68f3e-84aa-4d07-8b07-b425ffef5155 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:38:06.577155 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e68f3e-84aa-4d07-8b07-b425ffef5155 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:38:06.577919 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e68f3e-84aa-4d07-8b07-b425ffef5155 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:38:06.578237 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e68f3e-84aa-4d07-8b07-b425ffef5155 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:38:06.579910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e68f3e-84aa-4d07-8b07-b425ffef5155 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:38:06.586776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 650/1299] 10.222.0.77 () {56 vars in 1116 bytes} [Tue Jul 19 20:38:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:38:06.594165 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97079172-cd08-4864-a9b7-738714e55d13 None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:38:06.631272 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:06.699061 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97079172-cd08-4864-a9b7-738714e55d13 None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:38:06.731521 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6edba-9b3a-4118-9b03-e1bcc0bdcd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:38:06.732167 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6edba-9b3a-4118-9b03-e1bcc0bdcd19 None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:38:06.732471 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6edba-9b3a-4118-9b03-e1bcc0bdcd19 None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:38:06.732741 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6edba-9b3a-4118-9b03-e1bcc0bdcd19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:38:06.733511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6edba-9b3a-4118-9b03-e1bcc0bdcd19 None admin] RBAC: Adding query filter params (interface=public, service_id=c786ffbbbf2a473598e8e506c6978f09, region_id=RegionOne) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:38:06.733816 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6edba-9b3a-4118-9b03-e1bcc0bdcd19 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:38:06.735166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6edba-9b3a-4118-9b03-e1bcc0bdcd19 None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:38:06.740754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 650/1300] 10.222.0.77 () {56 vars in 1251 bytes} [Tue Jul 19 20:38:06 2022] GET /identity/v3/endpoints?service_id=c786ffbbbf2a473598e8e506c6978f09&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:38:06.746746 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e68f3e-84aa-4d07-8b07-b425ffef5155 None admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:38:06.827947 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:06.845755 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e68f3e-84aa-4d07-8b07-b425ffef5155 None admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:38:06.879692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49322714-a4da-460e-a850-6b25d020d36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:38:06.880406 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49322714-a4da-460e-a850-6b25d020d36e None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:38:06.880682 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49322714-a4da-460e-a850-6b25d020d36e None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:38:06.880951 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49322714-a4da-460e-a850-6b25d020d36e None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:38:06.881622 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49322714-a4da-460e-a850-6b25d020d36e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:38:06.882977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49322714-a4da-460e-a850-6b25d020d36e None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:38:06.889904 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 651/1301] 10.222.0.77 () {56 vars in 1087 bytes} [Tue Jul 19 20:38:06 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:38:08.899878 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb2aaf-7ddb-4d18-8cf0-7b88d5b4ca07 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:38:08.900410 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb2aaf-7ddb-4d18-8cf0-7b88d5b4ca07 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:38:08.900410 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb2aaf-7ddb-4d18-8cf0-7b88d5b4ca07 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:38:08.901772 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 651/1302] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:38:08.907092 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fec09-b877-4c15-b4a9-94e96fd7ab69 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:38:08.907558 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fec09-b877-4c15-b4a9-94e96fd7ab69 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:38:08.907769 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fec09-b877-4c15-b4a9-94e96fd7ab69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:38:08.925036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-575fec09-b877-4c15-b4a9-94e96fd7ab69 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:38:08.926213 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-575fec09-b877-4c15-b4a9-94e96fd7ab69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:38:08.993463 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 652/1303] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:38:08 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 20:38:09.017100 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb2aaf-7ddb-4d18-8cf0-7b88d5b4ca07 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:38:09.109791 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:09.117413 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb2aaf-7ddb-4d18-8cf0-7b88d5b4ca07 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:38:09.150032 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dfffd-88f0-4345-bfb2-1b301a694efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:38:09.150752 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dfffd-88f0-4345-bfb2-1b301a694efc None admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:38:09.151040 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dfffd-88f0-4345-bfb2-1b301a694efc None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:38:09.151332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616dfffd-88f0-4345-bfb2-1b301a694efc None admin] PATH_INFO: `/v3/services/placement` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:38:09.151977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dfffd-88f0-4345-bfb2-1b301a694efc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:38:09.153327 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616dfffd-88f0-4345-bfb2-1b301a694efc None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:38:09.165969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application [None req-616dfffd-88f0-4345-bfb2-1b301a694efc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 20:38:09.165969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:38:09.165969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 20:38:09.165969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 20:38:09.165969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 20:38:09.165969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 20:38:09.165969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 20:38:09.165969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:38:09.165969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 20:38:09.165969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:38:09.165969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 20:38:09.165969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:38:09.165969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 20:38:09.165969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 20:38:09.165969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 20:38:09.165969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 20:38:09.165969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 20:38:09.167209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 20:38:09.167209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 20:38:09.167209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 20:38:09.167209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 20:38:09.167209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 20:38:09.167209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 20:38:09.167209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 20:38:09.167209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 20:38:09.167209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 20:38:09.167209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 20:38:09.167209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 20:38:09.167209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 20:38:09.167209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 20:38:09.167209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 20:38:09.167209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 20:38:09.167209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 20:38:09.168127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 20:38:09.168127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application with Lock( Jul 19 20:38:09.168127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 20:38:09.168127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self._enter() Jul 19 20:38:09.168127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 20:38:09.168127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 20:38:09.168127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 20:38:09.168127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application return self.creator() Jul 19 20:38:09.168127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 20:38:09.168127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application created_value = creator( Jul 19 20:38:09.168127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 20:38:09.168127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 20:38:09.168127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 20:38:09.168127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: ERROR keystone.server.flask.application Jul 19 20:38:09.168127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 652/1304] 10.222.0.77 () {56 vars in 1117 bytes} [Tue Jul 19 20:38:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 20:38:09.173454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fec09-b877-4c15-b4a9-94e96fd7ab69 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:38:09.247193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:09.269796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fec09-b877-4c15-b4a9-94e96fd7ab69 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:38:09.303254 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f459d5b-f016-4cf1-a766-3e113a1d87f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:38:09.303935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f459d5b-f016-4cf1-a766-3e113a1d87f4 None admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:38:09.304213 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f459d5b-f016-4cf1-a766-3e113a1d87f4 None admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:38:09.304486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f459d5b-f016-4cf1-a766-3e113a1d87f4 None admin] PATH_INFO: `/v3/services` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:38:09.305182 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f459d5b-f016-4cf1-a766-3e113a1d87f4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:38:09.305484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f459d5b-f016-4cf1-a766-3e113a1d87f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:38:09.306825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f459d5b-f016-4cf1-a766-3e113a1d87f4 None admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:38:09.311896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 653/1305] 10.222.0.77 () {56 vars in 1116 bytes} [Tue Jul 19 20:38:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:38:09.317724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dfffd-88f0-4345-bfb2-1b301a694efc None admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:38:09.414814 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616dfffd-88f0-4345-bfb2-1b301a694efc None admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:38:09.446509 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf43ed-9d9f-4a90-a26d-90aeca19b9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:38:09.447154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf43ed-9d9f-4a90-a26d-90aeca19b9ef None admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:38:09.447465 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf43ed-9d9f-4a90-a26d-90aeca19b9ef None admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:38:09.447743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf43ed-9d9f-4a90-a26d-90aeca19b9ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:38:09.448492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf43ed-9d9f-4a90-a26d-90aeca19b9ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:38:09.449850 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf43ed-9d9f-4a90-a26d-90aeca19b9ef None admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:38:09.467474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 653/1306] 10.222.0.77 () {60 vars in 1144 bytes} [Tue Jul 19 20:38:09 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:38:19.308867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=30 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:38:19.463185 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:12.434508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efc404-f0d4-4fac-b65b-c7578555be30 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:12.435009 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efc404-f0d4-4fac-b65b-c7578555be30 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:12.435105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efc404-f0d4-4fac-b65b-c7578555be30 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:12.437895 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 654/1307] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:39:12.444145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2cb2d-937e-4473-bcfb-a5763e229b24 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:12.445366 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2cb2d-937e-4473-bcfb-a5763e229b24 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:12.446067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2cb2d-937e-4473-bcfb-a5763e229b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:12.555113 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-68f2cb2d-937e-4473-bcfb-a5763e229b24 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:39:12.556353 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-68f2cb2d-937e-4473-bcfb-a5763e229b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:12.671298 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 654/1308] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:39:12.718365 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb1426-5ab7-47e7-9da7-80648aad662d None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:12.718649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb1426-5ab7-47e7-9da7-80648aad662d None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:12.719107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb1426-5ab7-47e7-9da7-80648aad662d None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:12.721439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 655/1309] 10.222.0.77 () {54 vars in 965 bytes} [Tue Jul 19 20:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:39:12.730852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4a7f4-96d1-4526-802b-477e36023e38 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:12.731048 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4a7f4-96d1-4526-802b-477e36023e38 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:12.731518 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4a7f4-96d1-4526-802b-477e36023e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:12.823946 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-3da4a7f4-96d1-4526-802b-477e36023e38 None None] MFA Rules not processed for user `5b2c0f24d666462aa14ea4eee0592062`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:39:12.825445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-3da4a7f4-96d1-4526-802b-477e36023e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:12.851620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:12.922187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 655/1310] 10.222.0.77 () {58 vars in 1062 bytes} [Tue Jul 19 20:39:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:39:12.932395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb1426-5ab7-47e7-9da7-80648aad662d None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:39:12.934143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-fbfb1426-5ab7-47e7-9da7-80648aad662d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:13.055593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb1426-5ab7-47e7-9da7-80648aad662d None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:39:13.132712 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d88e39-b3cc-497b-9209-3c5d17be9131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:39:13.133368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d88e39-b3cc-497b-9209-3c5d17be9131 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:13.133655 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d88e39-b3cc-497b-9209-3c5d17be9131 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:13.133937 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d88e39-b3cc-497b-9209-3c5d17be9131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:13.135624 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e1d88e39-b3cc-497b-9209-3c5d17be9131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:13.195088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:13.261979 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d88e39-b3cc-497b-9209-3c5d17be9131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:39:13.263459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d88e39-b3cc-497b-9209-3c5d17be9131 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:39:13.285364 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 656/1311] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:39:15.604924 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e935a01-6757-47b6-895d-bcddd2929916 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:15.605507 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e935a01-6757-47b6-895d-bcddd2929916 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:15.605507 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e935a01-6757-47b6-895d-bcddd2929916 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:15.606836 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 656/1312] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:39:15.611990 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94074d0-bd8b-4ec0-8860-610ff31cdded None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:15.612439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94074d0-bd8b-4ec0-8860-610ff31cdded None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:15.612523 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94074d0-bd8b-4ec0-8860-610ff31cdded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:15.693218 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-a94074d0-bd8b-4ec0-8860-610ff31cdded None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:39:15.694412 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a94074d0-bd8b-4ec0-8860-610ff31cdded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:15.812609 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 657/1313] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:39:15.839229 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e935a01-6757-47b6-895d-bcddd2929916 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:39:15.840871 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-0e935a01-6757-47b6-895d-bcddd2929916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:15.986087 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e935a01-6757-47b6-895d-bcddd2929916 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:39:16.065289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:16.067653 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898e44cd-630f-488d-866d-78f448e70b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:39:16.068355 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e44cd-630f-488d-866d-78f448e70b99 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:16.068892 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e44cd-630f-488d-866d-78f448e70b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:16.069390 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898e44cd-630f-488d-866d-78f448e70b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:16.071436 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-898e44cd-630f-488d-866d-78f448e70b99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:16.179872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e44cd-630f-488d-866d-78f448e70b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:39:16.181284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898e44cd-630f-488d-866d-78f448e70b99 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:39:16.200343 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 657/1314] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:39:18.561915 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f7fc0-128c-4149-8f5d-74ec193928b0 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:18.562434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f7fc0-128c-4149-8f5d-74ec193928b0 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:18.562434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f7fc0-128c-4149-8f5d-74ec193928b0 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:18.563807 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 658/1315] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:39:18.569105 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c82db0-36d1-4272-a2d5-f96b84c96d68 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:18.569517 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c82db0-36d1-4272-a2d5-f96b84c96d68 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:18.569657 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c82db0-36d1-4272-a2d5-f96b84c96d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:18.636520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-e9c82db0-36d1-4272-a2d5-f96b84c96d68 None None] MFA Rules not processed for user `474d7a7ff49c4da4ad22b9479082adda`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:39:18.637840 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e9c82db0-36d1-4272-a2d5-f96b84c96d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:18.690867 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:18.736451 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 658/1316] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:39:18 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:39:18.779025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f7fc0-128c-4149-8f5d-74ec193928b0 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:39:18.780912 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-1a2f7fc0-128c-4149-8f5d-74ec193928b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:18.793870 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:18.891426 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f7fc0-128c-4149-8f5d-74ec193928b0 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:39:18.969494 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c35906-3306-4fa6-9e22-23cc77065c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:39:18.970262 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c35906-3306-4fa6-9e22-23cc77065c82 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:18.970537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c35906-3306-4fa6-9e22-23cc77065c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:18.970806 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c35906-3306-4fa6-9e22-23cc77065c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:18.972496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b3c35906-3306-4fa6-9e22-23cc77065c82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:19.033692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:19.080943 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c35906-3306-4fa6-9e22-23cc77065c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:39:19.082872 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c35906-3306-4fa6-9e22-23cc77065c82 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:39:19.101477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 659/1317] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:39:18 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:39:21.687918 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231d78a-f1a4-459e-bb5e-3e7759b25976 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:21.688462 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231d78a-f1a4-459e-bb5e-3e7759b25976 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:21.688462 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231d78a-f1a4-459e-bb5e-3e7759b25976 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:21.689851 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 659/1318] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:39:21.695378 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82099d7-705e-4f42-bc66-e494a4066d3c None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:21.695829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82099d7-705e-4f42-bc66-e494a4066d3c None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:21.695930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82099d7-705e-4f42-bc66-e494a4066d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:21.765867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-c82099d7-705e-4f42-bc66-e494a4066d3c None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:39:21.767096 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c82099d7-705e-4f42-bc66-e494a4066d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:21.868372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 660/1319] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:39:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:39:21.907215 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231d78a-f1a4-459e-bb5e-3e7759b25976 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:39:21.908893 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-0231d78a-f1a4-459e-bb5e-3e7759b25976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:22.015194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231d78a-f1a4-459e-bb5e-3e7759b25976 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:39:22.103494 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e94680-e63a-4e21-b8aa-098c6dc6d06c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:39:22.104534 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e94680-e63a-4e21-b8aa-098c6dc6d06c service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:22.104824 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e94680-e63a-4e21-b8aa-098c6dc6d06c service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:22.105108 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e94680-e63a-4e21-b8aa-098c6dc6d06c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:22.107229 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-50e94680-e63a-4e21-b8aa-098c6dc6d06c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:22.115021 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:22.217847 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e94680-e63a-4e21-b8aa-098c6dc6d06c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:39:22.219289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e94680-e63a-4e21-b8aa-098c6dc6d06c service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:39:22.236985 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 660/1320] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:39:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:39:24.977292 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cae98-1d8d-4c4d-b9d0-f31985311115 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:24.977825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cae98-1d8d-4c4d-b9d0-f31985311115 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:24.977825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cae98-1d8d-4c4d-b9d0-f31985311115 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:24.979205 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 661/1321] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:39:24.984654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731e58c-c812-4eda-ba98-3f09ce04e2da None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:24.985130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731e58c-c812-4eda-ba98-3f09ce04e2da None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:24.985226 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731e58c-c812-4eda-ba98-3f09ce04e2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:25.055886 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-d731e58c-c812-4eda-ba98-3f09ce04e2da None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:39:25.057110 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-d731e58c-c812-4eda-ba98-3f09ce04e2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:25.115771 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:25.163726 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 661/1322] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:39:25.217187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14ebbd-e948-4b1b-ba9b-34439430be5b None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:25.217469 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14ebbd-e948-4b1b-ba9b-34439430be5b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:25.217742 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14ebbd-e948-4b1b-ba9b-34439430be5b None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:25.219349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 662/1323] 10.222.0.77 () {54 vars in 965 bytes} [Tue Jul 19 20:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:39:25.225768 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c767ef-10c9-47c7-89a8-7b466bb96e7a None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:25.226056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c767ef-10c9-47c7-89a8-7b466bb96e7a None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:25.226334 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c767ef-10c9-47c7-89a8-7b466bb96e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:25.309869 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-a4c767ef-10c9-47c7-89a8-7b466bb96e7a None None] MFA Rules not processed for user `5b2c0f24d666462aa14ea4eee0592062`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:39:25.311106 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-a4c767ef-10c9-47c7-89a8-7b466bb96e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:25.391850 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 662/1324] 10.222.0.77 () {58 vars in 1062 bytes} [Tue Jul 19 20:39:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:39:25.401161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14ebbd-e948-4b1b-ba9b-34439430be5b None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:39:25.402724 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ab14ebbd-e948-4b1b-ba9b-34439430be5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:25.423143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:25.509349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14ebbd-e948-4b1b-ba9b-34439430be5b None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:39:25.590012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260841d5-00d8-4f76-ba5a-3d0ec1a0d8b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:39:25.590591 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260841d5-00d8-4f76-ba5a-3d0ec1a0d8b9 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:25.590911 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260841d5-00d8-4f76-ba5a-3d0ec1a0d8b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:25.591187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260841d5-00d8-4f76-ba5a-3d0ec1a0d8b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:25.592902 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-260841d5-00d8-4f76-ba5a-3d0ec1a0d8b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:25.667550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:25.708929 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260841d5-00d8-4f76-ba5a-3d0ec1a0d8b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:39:25.710290 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260841d5-00d8-4f76-ba5a-3d0ec1a0d8b9 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:39:25.731698 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 663/1325] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:39:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:39:28.070898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656078ca-fcb1-449e-a6f1-a54ee1f9ae57 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:28.071558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656078ca-fcb1-449e-a6f1-a54ee1f9ae57 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:28.071558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656078ca-fcb1-449e-a6f1-a54ee1f9ae57 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:28.073229 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 663/1326] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:39:28.079162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5a8a8-3926-4e0e-9501-f316d148fb24 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:28.079770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5a8a8-3926-4e0e-9501-f316d148fb24 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:28.079871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5a8a8-3926-4e0e-9501-f316d148fb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:28.148451 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-48e5a8a8-3926-4e0e-9501-f316d148fb24 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:39:28.149559 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-48e5a8a8-3926-4e0e-9501-f316d148fb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:28.245817 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 664/1327] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:39:28.282336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656078ca-fcb1-449e-a6f1-a54ee1f9ae57 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:39:28.284097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-656078ca-fcb1-449e-a6f1-a54ee1f9ae57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:28.346304 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:28.390302 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656078ca-fcb1-449e-a6f1-a54ee1f9ae57 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:39:28.463727 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20221202-e24b-4773-8df7-bd9760089439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:39:28.464391 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20221202-e24b-4773-8df7-bd9760089439 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:28.464672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20221202-e24b-4773-8df7-bd9760089439 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:28.464958 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20221202-e24b-4773-8df7-bd9760089439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:28.466600 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-20221202-e24b-4773-8df7-bd9760089439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:28.576297 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:28.579168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20221202-e24b-4773-8df7-bd9760089439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:39:28.581296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20221202-e24b-4773-8df7-bd9760089439 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:39:28.601032 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 664/1328] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:39:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:39:30.699018 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85afd32-237b-4f9c-862f-d057ca3de609 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:30.699589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85afd32-237b-4f9c-862f-d057ca3de609 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:30.699589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85afd32-237b-4f9c-862f-d057ca3de609 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:30.700882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 665/1329] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:39:30.706727 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf1cb5-a337-4506-81c9-3d818cd890eb None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:30.707142 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf1cb5-a337-4506-81c9-3d818cd890eb None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:30.707142 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf1cb5-a337-4506-81c9-3d818cd890eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:30.773406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-6ccf1cb5-a337-4506-81c9-3d818cd890eb None None] MFA Rules not processed for user `474d7a7ff49c4da4ad22b9479082adda`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:39:30.774615 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-6ccf1cb5-a337-4506-81c9-3d818cd890eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:30.881855 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 665/1330] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:39:30 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:39:30.923771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85afd32-237b-4f9c-862f-d057ca3de609 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:39:30.925963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e85afd32-237b-4f9c-862f-d057ca3de609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:30.959395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:31.037233 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85afd32-237b-4f9c-862f-d057ca3de609 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:39:31.110547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbbb87-411d-482e-aa33-aed265ab260e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:39:31.111198 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbbb87-411d-482e-aa33-aed265ab260e service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:31.111517 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbbb87-411d-482e-aa33-aed265ab260e service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:31.111796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbbb87-411d-482e-aa33-aed265ab260e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:31.113619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ebfbbb87-411d-482e-aa33-aed265ab260e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:31.192601 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:31.226105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfbbb87-411d-482e-aa33-aed265ab260e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:39:31.227592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfbbb87-411d-482e-aa33-aed265ab260e service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:39:31.246281 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 666/1331] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:39:30 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:39:33.722187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcaebc-06fb-4699-8028-a63e327c8a01 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:33.723214 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcaebc-06fb-4699-8028-a63e327c8a01 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:33.723404 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcaebc-06fb-4699-8028-a63e327c8a01 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:33.724661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 666/1332] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:39:33.730087 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b23e8-1af7-4189-8a95-3f185ad4d395 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:33.730508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b23e8-1af7-4189-8a95-3f185ad4d395 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:33.730630 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b23e8-1af7-4189-8a95-3f185ad4d395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:33.794902 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-e92b23e8-1af7-4189-8a95-3f185ad4d395 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:39:33.796140 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e92b23e8-1af7-4189-8a95-3f185ad4d395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:33.889660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 667/1333] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:39:33.925535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcaebc-06fb-4699-8028-a63e327c8a01 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:39:33.927725 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-21dcaebc-06fb-4699-8028-a63e327c8a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:33.996580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:34.030790 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcaebc-06fb-4699-8028-a63e327c8a01 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:39:34.126800 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e685f-5987-4011-b12a-4f2396f5a007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:39:34.127507 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e685f-5987-4011-b12a-4f2396f5a007 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:34.127799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e685f-5987-4011-b12a-4f2396f5a007 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:34.128092 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e685f-5987-4011-b12a-4f2396f5a007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:34.130167 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-499e685f-5987-4011-b12a-4f2396f5a007 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:34.238253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e685f-5987-4011-b12a-4f2396f5a007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:39:34.239729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e685f-5987-4011-b12a-4f2396f5a007 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:39:34.249680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:34.258116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 667/1334] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:39:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:39:36.345367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793a441-6226-4a57-a36c-769547fd1a35 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:36.345891 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793a441-6226-4a57-a36c-769547fd1a35 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:36.346006 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793a441-6226-4a57-a36c-769547fd1a35 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:36.347303 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 668/1335] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:39:36.353169 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623b413-1d1e-4445-996c-c927733420fe None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:36.353595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623b413-1d1e-4445-996c-c927733420fe None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:36.353721 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623b413-1d1e-4445-996c-c927733420fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:36.417493 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-4623b413-1d1e-4445-996c-c927733420fe None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:39:36.418681 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-4623b413-1d1e-4445-996c-c927733420fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:36.512891 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 668/1336] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:39:36.553135 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793a441-6226-4a57-a36c-769547fd1a35 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:39:36.554667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-8793a441-6226-4a57-a36c-769547fd1a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:36.594858 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:36.657900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793a441-6226-4a57-a36c-769547fd1a35 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:39:36.730238 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdaa3bc-92a0-4292-9ef0-cca0f4fab56f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:39:36.730893 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaa3bc-92a0-4292-9ef0-cca0f4fab56f service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:36.731171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaa3bc-92a0-4292-9ef0-cca0f4fab56f service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:36.731468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaa3bc-92a0-4292-9ef0-cca0f4fab56f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:36.733110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-8fdaa3bc-92a0-4292-9ef0-cca0f4fab56f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:36.815832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:36.841360 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdaa3bc-92a0-4292-9ef0-cca0f4fab56f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:39:36.842793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdaa3bc-92a0-4292-9ef0-cca0f4fab56f service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:39:36.861029 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 669/1337] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:39:39.376904 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2c7f7-23a6-4c4e-b119-a4052e73e0ed None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:39.377422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2c7f7-23a6-4c4e-b119-a4052e73e0ed None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:39.377525 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2c7f7-23a6-4c4e-b119-a4052e73e0ed None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:39.378846 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 669/1338] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:39:39.384614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2757ee-bbe8-470b-a374-224f2911031b None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:39.385070 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2757ee-bbe8-470b-a374-224f2911031b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:39.385178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2757ee-bbe8-470b-a374-224f2911031b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:39.453009 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-ad2757ee-bbe8-470b-a374-224f2911031b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:39:39.454217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ad2757ee-bbe8-470b-a374-224f2911031b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:39.549511 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 670/1339] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:39:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:39:39.587569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2c7f7-23a6-4c4e-b119-a4052e73e0ed None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:39:39.589439 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-1df2c7f7-23a6-4c4e-b119-a4052e73e0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:39.667224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:39.697898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2c7f7-23a6-4c4e-b119-a4052e73e0ed None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:39:39.775090 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303e291-6201-45b8-9bae-6499d0000eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:39:39.775775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303e291-6201-45b8-9bae-6499d0000eac service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:39.776062 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303e291-6201-45b8-9bae-6499d0000eac service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:39.776342 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303e291-6201-45b8-9bae-6499d0000eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:39.778003 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-d303e291-6201-45b8-9bae-6499d0000eac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:39.887816 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303e291-6201-45b8-9bae-6499d0000eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:39:39.889280 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d303e291-6201-45b8-9bae-6499d0000eac service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:39:39.911629 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 670/1340] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:39:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:39:44.048266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f170d48-2870-4c85-a641-64cb252bc9d8 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:44.048794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f170d48-2870-4c85-a641-64cb252bc9d8 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:44.048794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f170d48-2870-4c85-a641-64cb252bc9d8 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:44.050106 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 671/1341] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:39:44.055550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc8441-c453-42b3-845c-63afed441bd2 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:44.055993 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc8441-c453-42b3-845c-63afed441bd2 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:44.056107 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc8441-c453-42b3-845c-63afed441bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:44.060370 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:44.122704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-babc8441-c453-42b3-845c-63afed441bd2 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:39:44.124023 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-babc8441-c453-42b3-845c-63afed441bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:44.223060 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 671/1342] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:39:44.263930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f170d48-2870-4c85-a641-64cb252bc9d8 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:39:44.265471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-2f170d48-2870-4c85-a641-64cb252bc9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:44.315901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:44.370545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f170d48-2870-4c85-a641-64cb252bc9d8 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:39:44.444836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7361abc-d18d-442d-af1b-dfb43eb65d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:39:44.445544 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7361abc-d18d-442d-af1b-dfb43eb65d98 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:44.445833 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7361abc-d18d-442d-af1b-dfb43eb65d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:44.446104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7361abc-d18d-442d-af1b-dfb43eb65d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:44.447761 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d7361abc-d18d-442d-af1b-dfb43eb65d98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:44.541965 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:44.558905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7361abc-d18d-442d-af1b-dfb43eb65d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:39:44.560376 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7361abc-d18d-442d-af1b-dfb43eb65d98 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:39:44.583877 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 672/1343] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:39:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:39:47.298007 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e0c64-32cd-48eb-b90b-89c15842b3b0 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:47.298565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e0c64-32cd-48eb-b90b-89c15842b3b0 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:47.298565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e0c64-32cd-48eb-b90b-89c15842b3b0 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:47.299975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 672/1344] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:39:47.306274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7f29d-bd22-4f99-b21d-f2249064d7a4 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:47.306810 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7f29d-bd22-4f99-b21d-f2249064d7a4 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:47.306810 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7f29d-bd22-4f99-b21d-f2249064d7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:47.378695 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-c7f7f29d-bd22-4f99-b21d-f2249064d7a4 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:39:47.380476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c7f7f29d-bd22-4f99-b21d-f2249064d7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:47.479858 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 673/1345] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:39:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:39:47.517885 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e0c64-32cd-48eb-b90b-89c15842b3b0 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:39:47.519511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b77e0c64-32cd-48eb-b90b-89c15842b3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:47.616537 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:47.634446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e0c64-32cd-48eb-b90b-89c15842b3b0 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:39:47.707129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba4770-6acf-423d-bbca-1d2f49ffc422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:39:47.707807 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba4770-6acf-423d-bbca-1d2f49ffc422 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:47.708086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba4770-6acf-423d-bbca-1d2f49ffc422 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:47.708355 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba4770-6acf-423d-bbca-1d2f49ffc422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:47.709977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-67ba4770-6acf-423d-bbca-1d2f49ffc422 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:47.819011 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba4770-6acf-423d-bbca-1d2f49ffc422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:39:47.820472 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ba4770-6acf-423d-bbca-1d2f49ffc422 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:39:47.838180 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 673/1346] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:39:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:39:51.923948 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdf05c-2a41-4b25-bc63-3d522e8f9557 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:51.924519 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdf05c-2a41-4b25-bc63-3d522e8f9557 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:51.924519 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdf05c-2a41-4b25-bc63-3d522e8f9557 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:51.926401 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 674/1347] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:39:51.932067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c68811-f27d-4e29-a877-6b3550427702 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:51.932550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c68811-f27d-4e29-a877-6b3550427702 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:51.932659 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c68811-f27d-4e29-a877-6b3550427702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:51.947200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:52.000777 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-f7c68811-f27d-4e29-a877-6b3550427702 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:39:52.002000 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-f7c68811-f27d-4e29-a877-6b3550427702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:52.121813 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 674/1348] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:39:52.161033 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdf05c-2a41-4b25-bc63-3d522e8f9557 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:39:52.162589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-61fdf05c-2a41-4b25-bc63-3d522e8f9557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:52.228429 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:52.286384 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdf05c-2a41-4b25-bc63-3d522e8f9557 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:39:52.383369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04615d7-8afd-4505-a732-51209b9b6c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:39:52.383781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04615d7-8afd-4505-a732-51209b9b6c7c service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:52.384085 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04615d7-8afd-4505-a732-51209b9b6c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:52.384355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04615d7-8afd-4505-a732-51209b9b6c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:52.386033 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b04615d7-8afd-4505-a732-51209b9b6c7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:52.513348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:39:52.518468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04615d7-8afd-4505-a732-51209b9b6c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:39:52.519790 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04615d7-8afd-4505-a732-51209b9b6c7c service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:39:52.542690 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 675/1349] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:39:57.474105 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddd142-b9bf-4e27-902c-289fffa80e5b None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:57.474672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddd142-b9bf-4e27-902c-289fffa80e5b None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:57.474974 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddd142-b9bf-4e27-902c-289fffa80e5b None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:57.476620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 675/1350] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jul 19 20:39:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:39:57.481773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d2bf2-19a7-4e1d-a58d-85db4f093350 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:39:57.482195 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d2bf2-19a7-4e1d-a58d-85db4f093350 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:39:57.482395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d2bf2-19a7-4e1d-a58d-85db4f093350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:39:57.619559 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-bd9d2bf2-19a7-4e1d-a58d-85db4f093350 None None] MFA Rules not processed for user `04843ec31eb84585944c7a2b9cd1c0cb`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:39:57.621154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-bd9d2bf2-19a7-4e1d-a58d-85db4f093350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:39:57.742840 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 676/1351] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jul 19 20:39:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:40:01.881770 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4060d3-55a6-4552-b1e6-8fd1038c98c0 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:01.882825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4060d3-55a6-4552-b1e6-8fd1038c98c0 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:01.883498 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4060d3-55a6-4552-b1e6-8fd1038c98c0 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:01.885904 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 676/1352] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jul 19 20:40:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:01.892789 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df2be4-c427-41e1-b826-f6e45664cab6 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:01.893369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df2be4-c427-41e1-b826-f6e45664cab6 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:01.893601 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df2be4-c427-41e1-b826-f6e45664cab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:01.957815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:01.987779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-46df2be4-c427-41e1-b826-f6e45664cab6 None None] MFA Rules not processed for user `04843ec31eb84585944c7a2b9cd1c0cb`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:01.989540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-46df2be4-c427-41e1-b826-f6e45664cab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:02.104701 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 677/1353] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jul 19 20:40:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:40:02.120158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=59 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:03.474981 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70654b4f-c1ad-4046-8798-e318d6eab7b6 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:03.475695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70654b4f-c1ad-4046-8798-e318d6eab7b6 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:03.475695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70654b4f-c1ad-4046-8798-e318d6eab7b6 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:03.476948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 677/1354] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jul 19 20:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:03.481948 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a911ab2-747e-4d58-b362-831e54a844ef None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:03.482344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a911ab2-747e-4d58-b362-831e54a844ef None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:03.482520 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a911ab2-747e-4d58-b362-831e54a844ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:03.556492 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-5a911ab2-747e-4d58-b362-831e54a844ef None None] MFA Rules not processed for user `04843ec31eb84585944c7a2b9cd1c0cb`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:03.557681 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-5a911ab2-747e-4d58-b362-831e54a844ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:03.599527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:03.664982 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 678/1355] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jul 19 20:40:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:40:07.165516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7fccf-3e6e-4295-b0e7-1808104e649e None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:07.166378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7fccf-3e6e-4295-b0e7-1808104e649e None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:07.166834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e7fccf-3e6e-4295-b0e7-1808104e649e None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:07.172526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 678/1356] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:40:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:07.174705 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31384ad-aa1b-4038-a845-1a119c18d1ad None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:07.175626 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31384ad-aa1b-4038-a845-1a119c18d1ad None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:07.176063 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31384ad-aa1b-4038-a845-1a119c18d1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:07.260270 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-f31384ad-aa1b-4038-a845-1a119c18d1ad None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:07.262149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-f31384ad-aa1b-4038-a845-1a119c18d1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:07.367705 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 679/1357] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:40:07.433541 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49056a2e-86b3-4d23-b49d-42e7360431c1 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:07.434546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49056a2e-86b3-4d23-b49d-42e7360431c1 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:07.435847 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49056a2e-86b3-4d23-b49d-42e7360431c1 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:07.439048 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 679/1358] 10.222.0.77 () {54 vars in 962 bytes} [Tue Jul 19 20:40:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:07.445507 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88f0c4-f9ea-4d9c-bf72-738df99f6461 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:07.445803 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88f0c4-f9ea-4d9c-bf72-738df99f6461 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:07.446082 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88f0c4-f9ea-4d9c-bf72-738df99f6461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:07.464131 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:07.528528 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-fe88f0c4-f9ea-4d9c-bf72-738df99f6461 None None] MFA Rules not processed for user `6dbbb8f7b3f2449fb9c64ca3815b6c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:07.529883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-fe88f0c4-f9ea-4d9c-bf72-738df99f6461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:07.662491 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 680/1359] 10.222.0.77 () {58 vars in 1059 bytes} [Tue Jul 19 20:40:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:40:07.671046 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49056a2e-86b3-4d23-b49d-42e7360431c1 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:40:07.672629 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-49056a2e-86b3-4d23-b49d-42e7360431c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:07.837517 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49056a2e-86b3-4d23-b49d-42e7360431c1 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:40:07.964179 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:08.037469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4dd41-21e8-48c9-9e3e-eb0e9f4ccac8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:40:08.038433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4dd41-21e8-48c9-9e3e-eb0e9f4ccac8 service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:08.038894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4dd41-21e8-48c9-9e3e-eb0e9f4ccac8 service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:08.039651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4dd41-21e8-48c9-9e3e-eb0e9f4ccac8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:08.042721 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-f6e4dd41-21e8-48c9-9e3e-eb0e9f4ccac8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:08.198403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4dd41-21e8-48c9-9e3e-eb0e9f4ccac8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:40:08.200381 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4dd41-21e8-48c9-9e3e-eb0e9f4ccac8 service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:40:08.220711 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 680/1360] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:40:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:40:10.491828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254e88a-311e-4400-8fc7-ce3ef54ff097 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:10.492371 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254e88a-311e-4400-8fc7-ce3ef54ff097 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:10.492371 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254e88a-311e-4400-8fc7-ce3ef54ff097 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:10.493868 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 681/1361] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:10.498969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ee048-4eed-4cb1-8f29-17492cf1f769 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:10.499770 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ee048-4eed-4cb1-8f29-17492cf1f769 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:10.500049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ee048-4eed-4cb1-8f29-17492cf1f769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:10.570436 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-783ee048-4eed-4cb1-8f29-17492cf1f769 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:10.571575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-783ee048-4eed-4cb1-8f29-17492cf1f769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:10.615484 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:10.693004 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 681/1362] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:40:10.738568 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254e88a-311e-4400-8fc7-ce3ef54ff097 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:40:10.740140 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e254e88a-311e-4400-8fc7-ce3ef54ff097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:10.810198 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:10.922311 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254e88a-311e-4400-8fc7-ce3ef54ff097 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:40:11.049662 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3aaadf-8676-453e-b2f2-cdbae0ec5f8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:40:11.050338 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3aaadf-8676-453e-b2f2-cdbae0ec5f8b service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:11.050686 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3aaadf-8676-453e-b2f2-cdbae0ec5f8b service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:11.050964 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3aaadf-8676-453e-b2f2-cdbae0ec5f8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:11.052662 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-5e3aaadf-8676-453e-b2f2-cdbae0ec5f8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:11.082397 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:11.155357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3aaadf-8676-453e-b2f2-cdbae0ec5f8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:40:11.156953 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3aaadf-8676-453e-b2f2-cdbae0ec5f8b service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:40:11.176520 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 682/1363] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:40:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:40:13.601154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e16ac-51c7-4b76-918e-3a4aee41a460 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:13.601731 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e16ac-51c7-4b76-918e-3a4aee41a460 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:13.601731 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e16ac-51c7-4b76-918e-3a4aee41a460 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:13.603075 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 682/1364] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:13.608512 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81581e42-4fed-4ffd-97ea-92b488cd9e83 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:13.608954 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81581e42-4fed-4ffd-97ea-92b488cd9e83 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:13.609137 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81581e42-4fed-4ffd-97ea-92b488cd9e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:13.684181 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-81581e42-4fed-4ffd-97ea-92b488cd9e83 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:13.685420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-81581e42-4fed-4ffd-97ea-92b488cd9e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:13.786716 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:13.791322 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 683/1365] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:40:13.835608 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124db4f-f0b0-41bd-88c6-14ae6edd1ca7 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:13.836116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124db4f-f0b0-41bd-88c6-14ae6edd1ca7 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:13.836469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124db4f-f0b0-41bd-88c6-14ae6edd1ca7 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:13.837903 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 683/1366] 10.222.0.77 () {54 vars in 962 bytes} [Tue Jul 19 20:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:13.843460 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b3a15-789a-456c-95ad-446d4521c0f5 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:13.843750 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b3a15-789a-456c-95ad-446d4521c0f5 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:13.844023 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b3a15-789a-456c-95ad-446d4521c0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:13.934062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-eb5b3a15-789a-456c-95ad-446d4521c0f5 None None] MFA Rules not processed for user `6dbbb8f7b3f2449fb9c64ca3815b6c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:13.935285 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-eb5b3a15-789a-456c-95ad-446d4521c0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:14.078041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 684/1367] 10.222.0.77 () {58 vars in 1059 bytes} [Tue Jul 19 20:40:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:40:14.086652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124db4f-f0b0-41bd-88c6-14ae6edd1ca7 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:40:14.088210 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-0124db4f-f0b0-41bd-88c6-14ae6edd1ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:14.247567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124db4f-f0b0-41bd-88c6-14ae6edd1ca7 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:40:14.270428 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:14.381612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338a310-e849-437e-bb21-4f72bcbfceef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:40:14.382281 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338a310-e849-437e-bb21-4f72bcbfceef service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:14.382558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338a310-e849-437e-bb21-4f72bcbfceef service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:14.382825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338a310-e849-437e-bb21-4f72bcbfceef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:14.384625 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-0338a310-e849-437e-bb21-4f72bcbfceef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:14.493784 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338a310-e849-437e-bb21-4f72bcbfceef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:40:14.495374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338a310-e849-437e-bb21-4f72bcbfceef service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:40:14.515902 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 684/1368] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:40:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:40:15.402633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e887783-b0d5-4b26-8da4-375ef5f8ff73 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:15.403230 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e887783-b0d5-4b26-8da4-375ef5f8ff73 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:15.403230 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e887783-b0d5-4b26-8da4-375ef5f8ff73 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:15.404740 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 685/1369] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:15.410007 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ce96c-ba94-4666-9c74-dd8f7c183948 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:15.410446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ce96c-ba94-4666-9c74-dd8f7c183948 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:15.410541 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ce96c-ba94-4666-9c74-dd8f7c183948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:15.442913 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:15.480053 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-b70ce96c-ba94-4666-9c74-dd8f7c183948 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:15.481267 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b70ce96c-ba94-4666-9c74-dd8f7c183948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:15.587662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 685/1370] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:40:15.951184 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f702fd-07d1-4595-a7b3-e726a11a0917 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:15.951800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f702fd-07d1-4595-a7b3-e726a11a0917 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:15.952147 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f702fd-07d1-4595-a7b3-e726a11a0917 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:15.955096 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 686/1371] 10.222.0.77 () {54 vars in 964 bytes} [Tue Jul 19 20:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:15.960281 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15007a5c-b6e7-415a-a643-43507565b1dd None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:15.960641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15007a5c-b6e7-415a-a643-43507565b1dd None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:15.960986 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15007a5c-b6e7-415a-a643-43507565b1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:16.084326 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-15007a5c-b6e7-415a-a643-43507565b1dd None None] MFA Rules not processed for user `1ab64f417fe74fc585f32691aa7fb515`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:16.085748 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-15007a5c-b6e7-415a-a643-43507565b1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:16.140272 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:16.185518 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 686/1372] 10.222.0.77 () {58 vars in 1061 bytes} [Tue Jul 19 20:40:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:40:16.196075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f702fd-07d1-4595-a7b3-e726a11a0917 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:40:16.197899 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d1f702fd-07d1-4595-a7b3-e726a11a0917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:16.260489 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:16.352168 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f702fd-07d1-4595-a7b3-e726a11a0917 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:40:16.458434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f4f43-3c93-409b-bc6d-6ecaea1c053e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:40:16.460002 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f4f43-3c93-409b-bc6d-6ecaea1c053e service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:16.460297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f4f43-3c93-409b-bc6d-6ecaea1c053e service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:16.460576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f4f43-3c93-409b-bc6d-6ecaea1c053e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:16.462326 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e57f4f43-3c93-409b-bc6d-6ecaea1c053e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:16.577505 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:16.594480 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f4f43-3c93-409b-bc6d-6ecaea1c053e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:40:16.596256 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f4f43-3c93-409b-bc6d-6ecaea1c053e service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:40:16.621952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 687/1373] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:40:16.718501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8cd3b-2d3a-4d3e-abdb-bcfb146f220c None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:16.719123 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8cd3b-2d3a-4d3e-abdb-bcfb146f220c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:16.719123 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a8cd3b-2d3a-4d3e-abdb-bcfb146f220c None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:16.720778 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 687/1374] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:16.729381 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c93e0-76d0-408a-bacd-3682d364c7ba None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:16.729752 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c93e0-76d0-408a-bacd-3682d364c7ba None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:16.730147 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c93e0-76d0-408a-bacd-3682d364c7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:16.816142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-e18c93e0-76d0-408a-bacd-3682d364c7ba None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:16.817395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e18c93e0-76d0-408a-bacd-3682d364c7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:16.933356 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 688/1375] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:40:16.978979 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8cd3b-2d3a-4d3e-abdb-bcfb146f220c None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:40:16.980557 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-88a8cd3b-2d3a-4d3e-abdb-bcfb146f220c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:17.131715 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a8cd3b-2d3a-4d3e-abdb-bcfb146f220c None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:40:17.186214 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:17.250231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203b74b-5d1f-44d6-8ac7-494795088204 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:40:17.250833 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203b74b-5d1f-44d6-8ac7-494795088204 service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:17.251112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203b74b-5d1f-44d6-8ac7-494795088204 service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:17.251417 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203b74b-5d1f-44d6-8ac7-494795088204 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:17.253140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-c203b74b-5d1f-44d6-8ac7-494795088204 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:17.350319 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203b74b-5d1f-44d6-8ac7-494795088204 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:40:17.351935 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203b74b-5d1f-44d6-8ac7-494795088204 service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:40:17.370457 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 688/1376] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:40:19.567185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf1756-7679-4ced-b078-06a890fcd489 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:19.567709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf1756-7679-4ced-b078-06a890fcd489 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:19.567709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf1756-7679-4ced-b078-06a890fcd489 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:19.569246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 689/1377] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:40:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:19.574424 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa6209-c209-4584-8a4b-c6dd955fb4f1 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:19.574839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa6209-c209-4584-8a4b-c6dd955fb4f1 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:19.574983 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa6209-c209-4584-8a4b-c6dd955fb4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:19.649389 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-09aa6209-c209-4584-8a4b-c6dd955fb4f1 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:19.650610 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-09aa6209-c209-4584-8a4b-c6dd955fb4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:19.657327 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:19.769408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 689/1378] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:40:19.814599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf1756-7679-4ced-b078-06a890fcd489 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:40:19.816191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3abf1756-7679-4ced-b078-06a890fcd489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:19.877700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:19.975436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf1756-7679-4ced-b078-06a890fcd489 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:40:20.105296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b6fb7-9681-434d-82e6-eedec6b93af1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:40:20.105958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b6fb7-9681-434d-82e6-eedec6b93af1 service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:20.106241 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b6fb7-9681-434d-82e6-eedec6b93af1 service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:20.106517 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b6fb7-9681-434d-82e6-eedec6b93af1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:20.108222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-271b6fb7-9681-434d-82e6-eedec6b93af1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:20.134235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:20.243762 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b6fb7-9681-434d-82e6-eedec6b93af1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:40:20.246076 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b6fb7-9681-434d-82e6-eedec6b93af1 service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:40:20.270930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 690/1379] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:40:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:40:22.398995 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfac0b-557a-4efc-8724-3cae185d48d7 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:22.399672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfac0b-557a-4efc-8724-3cae185d48d7 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:22.399672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfac0b-557a-4efc-8724-3cae185d48d7 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:22.401247 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 690/1380] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:22.406688 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e07c3-6958-4961-96e0-3e0c5edfae08 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:22.407151 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e07c3-6958-4961-96e0-3e0c5edfae08 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:22.407246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e07c3-6958-4961-96e0-3e0c5edfae08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:22.479168 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-027e07c3-6958-4961-96e0-3e0c5edfae08 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:22.480391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-027e07c3-6958-4961-96e0-3e0c5edfae08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:22.579102 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:22.591362 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 691/1381] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:40:22.640586 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfac0b-557a-4efc-8724-3cae185d48d7 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:40:22.642187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-f2cfac0b-557a-4efc-8724-3cae185d48d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:22.795868 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:22.808555 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfac0b-557a-4efc-8724-3cae185d48d7 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:40:22.940481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbe4ec-9dc1-4304-8060-f149eafce389 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:40:22.941233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbe4ec-9dc1-4304-8060-f149eafce389 service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:22.941513 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbe4ec-9dc1-4304-8060-f149eafce389 service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:22.941782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbe4ec-9dc1-4304-8060-f149eafce389 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:22.943506 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-2adbe4ec-9dc1-4304-8060-f149eafce389 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:23.042842 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbe4ec-9dc1-4304-8060-f149eafce389 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:40:23.044735 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbe4ec-9dc1-4304-8060-f149eafce389 service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:40:23.055880 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:23.065610 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 691/1382] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:40:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:40:25.418891 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d972a-d3a2-43ff-825f-3bcde0e0a9c4 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:25.419554 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d972a-d3a2-43ff-825f-3bcde0e0a9c4 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:25.419666 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d972a-d3a2-43ff-825f-3bcde0e0a9c4 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:25.421007 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 692/1383] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:40:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:25.426357 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc4029-fc30-46c1-97ec-65df27345df9 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:25.426826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc4029-fc30-46c1-97ec-65df27345df9 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:25.426938 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc4029-fc30-46c1-97ec-65df27345df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:25.493566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-c5bc4029-fc30-46c1-97ec-65df27345df9 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:25.494816 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-c5bc4029-fc30-46c1-97ec-65df27345df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:25.594827 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 692/1384] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:40:25.638231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d972a-d3a2-43ff-825f-3bcde0e0a9c4 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:40:25.640455 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-0f8d972a-d3a2-43ff-825f-3bcde0e0a9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:25.804720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d972a-d3a2-43ff-825f-3bcde0e0a9c4 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:40:25.876892 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:25.930175 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac5ca6-17d9-41d9-bdc4-aefac8111bd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:40:25.930828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac5ca6-17d9-41d9-bdc4-aefac8111bd2 service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:25.931107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac5ca6-17d9-41d9-bdc4-aefac8111bd2 service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:25.931421 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac5ca6-17d9-41d9-bdc4-aefac8111bd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:25.933080 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b9ac5ca6-17d9-41d9-bdc4-aefac8111bd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:26.040655 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac5ca6-17d9-41d9-bdc4-aefac8111bd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:40:26.042797 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac5ca6-17d9-41d9-bdc4-aefac8111bd2 service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:40:26.068107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 693/1385] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:40:28.692743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28685045-c4c2-45cd-897d-4c18b7004a68 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:28.693354 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28685045-c4c2-45cd-897d-4c18b7004a68 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:28.693354 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28685045-c4c2-45cd-897d-4c18b7004a68 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:28.694646 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 693/1386] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:40:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:28.701278 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b4062-6f45-404c-aec5-c3e868ff615b None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:28.701871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b4062-6f45-404c-aec5-c3e868ff615b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:28.701871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b4062-6f45-404c-aec5-c3e868ff615b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:28.769428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-6c9b4062-6f45-404c-aec5-c3e868ff615b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:28.770643 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-6c9b4062-6f45-404c-aec5-c3e868ff615b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:28.805964 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:28.875747 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 694/1387] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:40:28.925470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28685045-c4c2-45cd-897d-4c18b7004a68 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:40:28.927431 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-28685045-c4c2-45cd-897d-4c18b7004a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:29.025065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:29.120880 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28685045-c4c2-45cd-897d-4c18b7004a68 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:40:29.240893 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf970172-132a-4d4f-8d0f-9914c2dd2eaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:40:29.241556 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf970172-132a-4d4f-8d0f-9914c2dd2eaf service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:29.241840 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf970172-132a-4d4f-8d0f-9914c2dd2eaf service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:29.242119 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf970172-132a-4d4f-8d0f-9914c2dd2eaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:29.243802 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-cf970172-132a-4d4f-8d0f-9914c2dd2eaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:29.285253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:29.340734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf970172-132a-4d4f-8d0f-9914c2dd2eaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:40:29.342337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf970172-132a-4d4f-8d0f-9914c2dd2eaf service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:40:29.364164 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 694/1388] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:40:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:40:31.645267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa13248-0392-46e4-8747-ff7e74156bcf None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:31.645846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa13248-0392-46e4-8747-ff7e74156bcf None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:31.645846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa13248-0392-46e4-8747-ff7e74156bcf None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:31.647178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 695/1389] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:40:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:31.653088 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae85fda-c3f4-4007-b039-e52ed4099c9b None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:31.653606 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae85fda-c3f4-4007-b039-e52ed4099c9b None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:31.653738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae85fda-c3f4-4007-b039-e52ed4099c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:31.722944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-bae85fda-c3f4-4007-b039-e52ed4099c9b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:31.724189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-bae85fda-c3f4-4007-b039-e52ed4099c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:31.824922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 695/1390] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:40:31.871219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa13248-0392-46e4-8747-ff7e74156bcf None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:40:31.872792 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-4fa13248-0392-46e4-8747-ff7e74156bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:32.032005 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa13248-0392-46e4-8747-ff7e74156bcf None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:40:32.049646 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:32.077951 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8491b-44ca-4d69-b3e3-a268575ee99d None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:32.078241 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8491b-44ca-4d69-b3e3-a268575ee99d None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:32.078524 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8491b-44ca-4d69-b3e3-a268575ee99d None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:32.079936 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 696/1391] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:32.085652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ad155-08b0-4c7e-91fe-fd0044c3549d None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:32.085943 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ad155-08b0-4c7e-91fe-fd0044c3549d None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:32.086226 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ad155-08b0-4c7e-91fe-fd0044c3549d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:32.102224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:32.156890 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf37fc-ad51-4024-b74f-5c2af8979fee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:40:32.157581 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf37fc-ad51-4024-b74f-5c2af8979fee service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:32.157836 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-913ad155-08b0-4c7e-91fe-fd0044c3549d None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:32.157969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf37fc-ad51-4024-b74f-5c2af8979fee service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:32.158141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf37fc-ad51-4024-b74f-5c2af8979fee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:32.159184 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-913ad155-08b0-4c7e-91fe-fd0044c3549d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:32.159877 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-bbaf37fc-ad51-4024-b74f-5c2af8979fee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:32.252205 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf37fc-ad51-4024-b74f-5c2af8979fee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:40:32.254337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf37fc-ad51-4024-b74f-5c2af8979fee service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:40:32.261220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 697/1392] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:40:32.273480 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 696/1393] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:40:32.319124 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def58a52-5a6d-4fbb-98c1-cb71c1947916 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:32.319450 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def58a52-5a6d-4fbb-98c1-cb71c1947916 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:32.319734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def58a52-5a6d-4fbb-98c1-cb71c1947916 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:32.321303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 698/1394] 10.222.0.77 () {54 vars in 966 bytes} [Tue Jul 19 20:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:32.326549 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf84e57-30d9-48d5-bc6c-1d0cbac487ae None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:32.326982 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf84e57-30d9-48d5-bc6c-1d0cbac487ae None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:32.327143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf84e57-30d9-48d5-bc6c-1d0cbac487ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:32.369694 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:32.431092 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-ebf84e57-30d9-48d5-bc6c-1d0cbac487ae None None] MFA Rules not processed for user `7d9a41e10cb64ee9972debaf856503d4`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:32.432454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ebf84e57-30d9-48d5-bc6c-1d0cbac487ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:32.517216 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 697/1395] 10.222.0.77 () {58 vars in 1063 bytes} [Tue Jul 19 20:40:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:40:32.527053 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def58a52-5a6d-4fbb-98c1-cb71c1947916 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:40:32.529001 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-def58a52-5a6d-4fbb-98c1-cb71c1947916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:32.636179 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:32.644665 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def58a52-5a6d-4fbb-98c1-cb71c1947916 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:40:32.722421 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1624fc-d4c0-4d9a-b40c-562e7c2ae4f9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d9a41e10cb64ee9972debaf856503d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:40:32.723124 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1624fc-d4c0-4d9a-b40c-562e7c2ae4f9 service glance] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:32.723411 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1624fc-d4c0-4d9a-b40c-562e7c2ae4f9 service glance] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:32.723691 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1624fc-d4c0-4d9a-b40c-562e7c2ae4f9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:32.725398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-4a1624fc-d4c0-4d9a-b40c-562e7c2ae4f9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:32.840337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1624fc-d4c0-4d9a-b40c-562e7c2ae4f9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:40:32.841782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1624fc-d4c0-4d9a-b40c-562e7c2ae4f9 service glance] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:40:32.860211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 699/1396] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:40:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:40:33.573794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b97dd4-6ba4-4c07-9323-8a34fc4cd9cd None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:33.574288 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b97dd4-6ba4-4c07-9323-8a34fc4cd9cd None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:33.574382 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b97dd4-6ba4-4c07-9323-8a34fc4cd9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:33.641097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-a5b97dd4-6ba4-4c07-9323-8a34fc4cd9cd None None] MFA Rules not processed for user `c8f314167aa94d81955ac761a5a28504`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:33.642307 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a5b97dd4-6ba4-4c07-9323-8a34fc4cd9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:33.702560 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:33.732291 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 698/1397] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jul 19 20:40:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:40:33.776044 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb472fb-4a22-49b2-9bf5-dc378dc89b0d None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:33.776551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb472fb-4a22-49b2-9bf5-dc378dc89b0d None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:33.776667 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb472fb-4a22-49b2-9bf5-dc378dc89b0d None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:33.777983 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 700/1398] 10.222.0.77 () {54 vars in 943 bytes} [Tue Jul 19 20:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:33.784436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571979d5-f8ce-4cda-a1ab-1e0fd65ecf4c None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:33.784728 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571979d5-f8ce-4cda-a1ab-1e0fd65ecf4c None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:33.785009 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571979d5-f8ce-4cda-a1ab-1e0fd65ecf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:33.864222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-571979d5-f8ce-4cda-a1ab-1e0fd65ecf4c None None] MFA Rules not processed for user `7987846276ad4ccd90899128ceb1354e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:33.865345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-571979d5-f8ce-4cda-a1ab-1e0fd65ecf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:33.974508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 699/1399] 10.222.0.77 () {58 vars in 1040 bytes} [Tue Jul 19 20:40:33 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:40:33.984004 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb472fb-4a22-49b2-9bf5-dc378dc89b0d None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:40:33.985524 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9fb472fb-4a22-49b2-9bf5-dc378dc89b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:34.010953 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:34.127701 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb472fb-4a22-49b2-9bf5-dc378dc89b0d None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:40:34.233029 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605b466-f641-4ba5-a0aa-a0a8dbad88e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7987846276ad4ccd90899128ceb1354e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:40:34.233684 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605b466-f641-4ba5-a0aa-a0a8dbad88e8 service swift] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:34.233969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605b466-f641-4ba5-a0aa-a0a8dbad88e8 service swift] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:34.234316 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605b466-f641-4ba5-a0aa-a0a8dbad88e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:34.235975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-d605b466-f641-4ba5-a0aa-a0a8dbad88e8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:34.243370 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:34.322795 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605b466-f641-4ba5-a0aa-a0a8dbad88e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:40:34.324416 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605b466-f641-4ba5-a0aa-a0a8dbad88e8 service swift] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:40:34.333571 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 701/1400] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jul 19 20:40:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 20:40:34.410136 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2226c29-5db6-4465-86f6-d3a2256a0b17 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:34.410429 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2226c29-5db6-4465-86f6-d3a2256a0b17 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:34.410713 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2226c29-5db6-4465-86f6-d3a2256a0b17 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:34.412426 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 700/1401] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:34.418454 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61737bd0-c876-4924-b435-5cdd0c3a7c76 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:34.418753 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61737bd0-c876-4924-b435-5cdd0c3a7c76 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:34.419036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61737bd0-c876-4924-b435-5cdd0c3a7c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:34.493883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-61737bd0-c876-4924-b435-5cdd0c3a7c76 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:34.495233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-61737bd0-c876-4924-b435-5cdd0c3a7c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:34.600435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:34.604718 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 702/1402] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:40:34.651041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2226c29-5db6-4465-86f6-d3a2256a0b17 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:40:34.652873 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e2226c29-5db6-4465-86f6-d3a2256a0b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:34.702023 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:34.824252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2226c29-5db6-4465-86f6-d3a2256a0b17 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:40:34.954221 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:34.957904 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd840fc-a5f7-402f-96fc-800741a5b127 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:40:34.959015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd840fc-a5f7-402f-96fc-800741a5b127 service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:34.959417 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd840fc-a5f7-402f-96fc-800741a5b127 service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:34.959949 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd840fc-a5f7-402f-96fc-800741a5b127 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:34.961704 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-8cd840fc-a5f7-402f-96fc-800741a5b127 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:35.063119 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd840fc-a5f7-402f-96fc-800741a5b127 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:40:35.064874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd840fc-a5f7-402f-96fc-800741a5b127 service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:40:35.087240 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 701/1403] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:40:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:40:37.205075 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3064b1-e746-43bd-ac2c-61b52e66fb99 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:37.205949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3064b1-e746-43bd-ac2c-61b52e66fb99 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:37.206234 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3064b1-e746-43bd-ac2c-61b52e66fb99 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:37.207961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 703/1404] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:40:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:37.213135 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2741d-3936-464d-8c94-1a570a551687 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:37.213663 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2741d-3936-464d-8c94-1a570a551687 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:37.213663 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2741d-3936-464d-8c94-1a570a551687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:37.291448 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-b1b2741d-3936-464d-8c94-1a570a551687 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:37.292787 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b1b2741d-3936-464d-8c94-1a570a551687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:37.379068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:37.416171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 702/1405] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:40:37.458342 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3064b1-e746-43bd-ac2c-61b52e66fb99 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:40:37.460113 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-bd3064b1-e746-43bd-ac2c-61b52e66fb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:37.682953 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3064b1-e746-43bd-ac2c-61b52e66fb99 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:40:37.768968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:37.817532 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6127fd0-aadb-4932-b35a-00e007248056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:40:37.818204 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6127fd0-aadb-4932-b35a-00e007248056 service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:37.818493 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6127fd0-aadb-4932-b35a-00e007248056 service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:37.818782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6127fd0-aadb-4932-b35a-00e007248056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:37.822568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e6127fd0-aadb-4932-b35a-00e007248056 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:37.931889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6127fd0-aadb-4932-b35a-00e007248056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:40:37.933647 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6127fd0-aadb-4932-b35a-00e007248056 service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:40:37.954611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 704/1406] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:40:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:40:40.075890 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e6c79-3d5d-4770-b959-019969d43c5e None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:40.076421 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e6c79-3d5d-4770-b959-019969d43c5e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:40.076421 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e6c79-3d5d-4770-b959-019969d43c5e None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:40.078370 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 703/1407] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:40:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:40.083949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902665d-ff16-4f8c-99d8-349982c1925d None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:40.084836 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902665d-ff16-4f8c-99d8-349982c1925d None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:40.085218 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902665d-ff16-4f8c-99d8-349982c1925d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:40.156846 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-6902665d-ff16-4f8c-99d8-349982c1925d None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:40.158034 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-6902665d-ff16-4f8c-99d8-349982c1925d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:40.205774 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:40.276863 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 705/1408] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:40:40.324829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e6c79-3d5d-4770-b959-019969d43c5e None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:40:40.326748 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-514e6c79-3d5d-4770-b959-019969d43c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:40.496790 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e6c79-3d5d-4770-b959-019969d43c5e None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:40:40.558024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:40.627746 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db27092-bf80-408c-a3a5-698e4bee5214 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:40:40.628436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db27092-bf80-408c-a3a5-698e4bee5214 service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:40.628722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db27092-bf80-408c-a3a5-698e4bee5214 service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:40.629011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db27092-bf80-408c-a3a5-698e4bee5214 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:40.631861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-2db27092-bf80-408c-a3a5-698e4bee5214 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:40.744295 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db27092-bf80-408c-a3a5-698e4bee5214 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:40:40.746391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db27092-bf80-408c-a3a5-698e4bee5214 service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:40:40.765954 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 704/1409] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:40:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:40:50.274568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=27 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:50.763250 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=73 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:56.574565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833f0c2-34a3-4bf7-861f-25ddf7591bd4 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:56.575125 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833f0c2-34a3-4bf7-861f-25ddf7591bd4 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:56.575125 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833f0c2-34a3-4bf7-861f-25ddf7591bd4 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:56.576806 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 706/1410] 10.222.0.77 () {54 vars in 918 bytes} [Tue Jul 19 20:40:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:56.582128 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a45192-1bf4-4dcc-b135-8d43242d3bb1 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:56.582541 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a45192-1bf4-4dcc-b135-8d43242d3bb1 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:56.582682 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a45192-1bf4-4dcc-b135-8d43242d3bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:56.667441 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-30a45192-1bf4-4dcc-b135-8d43242d3bb1 None None] MFA Rules not processed for user `04843ec31eb84585944c7a2b9cd1c0cb`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:56.668650 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-30a45192-1bf4-4dcc-b135-8d43242d3bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:56.776541 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 705/1411] 10.222.0.77 () {58 vars in 1015 bytes} [Tue Jul 19 20:40:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:40:56.791472 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c33de8-cc9d-4958-ba2d-90cfb110ed89 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:56.791761 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c33de8-cc9d-4958-ba2d-90cfb110ed89 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:56.792040 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c33de8-cc9d-4958-ba2d-90cfb110ed89 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:56.793428 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 707/1412] 10.222.0.77 () {54 vars in 918 bytes} [Tue Jul 19 20:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:56.798072 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd308f8-78b3-4cbe-96a6-c06f03552508 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:56.798362 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd308f8-78b3-4cbe-96a6-c06f03552508 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:56.798641 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd308f8-78b3-4cbe-96a6-c06f03552508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:56.869646 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:56.872692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-dfd308f8-78b3-4cbe-96a6-c06f03552508 None None] MFA Rules not processed for user `6dbbb8f7b3f2449fb9c64ca3815b6c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:56.874566 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-dfd308f8-78b3-4cbe-96a6-c06f03552508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:56.990625 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 706/1413] 10.222.0.77 () {58 vars in 1015 bytes} [Tue Jul 19 20:40:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:40:59.500123 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65310a45-4649-4d23-8f6a-76e3dfc20682 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:59.500701 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65310a45-4649-4d23-8f6a-76e3dfc20682 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:59.500701 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65310a45-4649-4d23-8f6a-76e3dfc20682 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:59.502043 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 20:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:40:59.507970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191d824-e959-4b46-9dfb-1b0937f180e6 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:40:59.508418 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191d824-e959-4b46-9dfb-1b0937f180e6 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:40:59.508522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191d824-e959-4b46-9dfb-1b0937f180e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:40:59.574278 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-f191d824-e959-4b46-9dfb-1b0937f180e6 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:40:59.575514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-f191d824-e959-4b46-9dfb-1b0937f180e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:59.636994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:40:59.699415 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 20:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:40:59.744209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65310a45-4649-4d23-8f6a-76e3dfc20682 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:40:59.745734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-65310a45-4649-4d23-8f6a-76e3dfc20682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:40:59.889172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65310a45-4649-4d23-8f6a-76e3dfc20682 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:40:59.961127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:00.001469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f17f9-c0f5-4752-bb40-f54ef44486be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:41:00.002116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f17f9-c0f5-4752-bb40-f54ef44486be service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:00.002395 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f17f9-c0f5-4752-bb40-f54ef44486be service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:00.002668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f17f9-c0f5-4752-bb40-f54ef44486be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:00.004337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-d46f17f9-c0f5-4752-bb40-f54ef44486be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:00.105560 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f17f9-c0f5-4752-bb40-f54ef44486be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:41:00.107280 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f17f9-c0f5-4752-bb40-f54ef44486be service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:41:00.125950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 709/1416] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:40:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:41:01.031480 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e65f25-f142-4bbe-997f-af076327a0dc None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:01.032021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e65f25-f142-4bbe-997f-af076327a0dc None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:01.032021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e65f25-f142-4bbe-997f-af076327a0dc None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:01.033405 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 20:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:41:01.039071 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c2181-b970-4290-a57b-df8748d4772e None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:01.039789 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c2181-b970-4290-a57b-df8748d4772e None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:01.039916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c2181-b970-4290-a57b-df8748d4772e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:01.116881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-e05c2181-b970-4290-a57b-df8748d4772e None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:41:01.118091 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e05c2181-b970-4290-a57b-df8748d4772e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:01.146974 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:01.219395 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 20:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:41:01.369784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e65f25-f142-4bbe-997f-af076327a0dc None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:41:01.371399 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d7e65f25-f142-4bbe-997f-af076327a0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:01.523783 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e65f25-f142-4bbe-997f-af076327a0dc None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:41:01.564895 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:01.639553 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13355b6b-2044-4727-9af7-d020ebdd476f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:41:01.640208 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13355b6b-2044-4727-9af7-d020ebdd476f service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:01.640491 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13355b6b-2044-4727-9af7-d020ebdd476f service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:01.640767 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13355b6b-2044-4727-9af7-d020ebdd476f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:01.642430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-13355b6b-2044-4727-9af7-d020ebdd476f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:01.741569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13355b6b-2044-4727-9af7-d020ebdd476f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:41:01.744074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13355b6b-2044-4727-9af7-d020ebdd476f service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:41:01.772367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 709/1419] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:41:02.680469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea59fb2-0740-4e23-9459-2775f405c7f9 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:02.680994 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea59fb2-0740-4e23-9459-2775f405c7f9 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:02.680994 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea59fb2-0740-4e23-9459-2775f405c7f9 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:02.682327 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 20:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:41:02.687304 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770bea0-dcb6-4789-9d0e-0f6dbe975a9a None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:02.687736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770bea0-dcb6-4789-9d0e-0f6dbe975a9a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:02.687887 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770bea0-dcb6-4789-9d0e-0f6dbe975a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:02.750759 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:02.773410 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-2770bea0-dcb6-4789-9d0e-0f6dbe975a9a None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:41:02.774629 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-2770bea0-dcb6-4789-9d0e-0f6dbe975a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:02.872763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 20:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:41:03.023677 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea59fb2-0740-4e23-9459-2775f405c7f9 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:41:03.025240 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-aea59fb2-0740-4e23-9459-2775f405c7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:03.171845 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea59fb2-0740-4e23-9459-2775f405c7f9 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:41:03.184988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:03.288222 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a084db1-662b-431f-9b4c-487597a434b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:41:03.288791 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a084db1-662b-431f-9b4c-487597a434b8 service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:03.289069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a084db1-662b-431f-9b4c-487597a434b8 service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:03.289599 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a084db1-662b-431f-9b4c-487597a434b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:03.291248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-3a084db1-662b-431f-9b4c-487597a434b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:03.387998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a084db1-662b-431f-9b4c-487597a434b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:41:03.389594 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a084db1-662b-431f-9b4c-487597a434b8 service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:41:03.407774 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 712/1422] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:41:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:41:04.285873 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa61a1-db66-4d90-a1b8-3bd09d91406e None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:04.286482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa61a1-db66-4d90-a1b8-3bd09d91406e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:04.286482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa61a1-db66-4d90-a1b8-3bd09d91406e None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:04.287838 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 20:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:41:04.293239 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409607b-6f39-42be-905e-a99468fc3529 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:04.293682 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409607b-6f39-42be-905e-a99468fc3529 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:04.293810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409607b-6f39-42be-905e-a99468fc3529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:04.313528 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:04.374904 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-f409607b-6f39-42be-905e-a99468fc3529 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:41:04.376137 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-f409607b-6f39-42be-905e-a99468fc3529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:04.478528 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 20:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:41:04.630313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa61a1-db66-4d90-a1b8-3bd09d91406e None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:41:04.631769 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-6dfa61a1-db66-4d90-a1b8-3bd09d91406e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:04.743727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:04.781880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa61a1-db66-4d90-a1b8-3bd09d91406e None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:41:04.902550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9dede-249d-479d-a86a-5cd815ba64e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:41:04.903204 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9dede-249d-479d-a86a-5cd815ba64e2 service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:04.903515 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9dede-249d-479d-a86a-5cd815ba64e2 service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:04.903792 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9dede-249d-479d-a86a-5cd815ba64e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:04.905442 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-dcc9dede-249d-479d-a86a-5cd815ba64e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:04.992420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:05.006332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9dede-249d-479d-a86a-5cd815ba64e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:41:05.007985 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9dede-249d-479d-a86a-5cd815ba64e2 service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:41:05.026529 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 712/1425] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:41:05.901221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af924538-98b0-4509-a6f6-48b9c9d524b0 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:05.901737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af924538-98b0-4509-a6f6-48b9c9d524b0 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:05.901737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af924538-98b0-4509-a6f6-48b9c9d524b0 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:05.903128 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 20:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:41:05.908074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf64f2-d46d-430c-bfdb-81ba7d718b74 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:05.908516 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf64f2-d46d-430c-bfdb-81ba7d718b74 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:05.909182 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf64f2-d46d-430c-bfdb-81ba7d718b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:05.984829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-12cf64f2-d46d-430c-bfdb-81ba7d718b74 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:41:05.986039 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-12cf64f2-d46d-430c-bfdb-81ba7d718b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:06.083952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 20:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:41:06.235209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af924538-98b0-4509-a6f6-48b9c9d524b0 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:41:06.237461 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-af924538-98b0-4509-a6f6-48b9c9d524b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:06.331255 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:06.395656 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af924538-98b0-4509-a6f6-48b9c9d524b0 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:41:06.509426 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fb65f-ec22-4149-ad84-6d3e3ad41511 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:41:06.510007 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fb65f-ec22-4149-ad84-6d3e3ad41511 service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:06.510292 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fb65f-ec22-4149-ad84-6d3e3ad41511 service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:06.510569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fb65f-ec22-4149-ad84-6d3e3ad41511 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:06.514007 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-da8fb65f-ec22-4149-ad84-6d3e3ad41511 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:06.574631 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:06.619462 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fb65f-ec22-4149-ad84-6d3e3ad41511 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:41:06.621059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fb65f-ec22-4149-ad84-6d3e3ad41511 service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:41:06.641964 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 715/1428] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:41:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:41:07.456611 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b5d70-bc66-47b5-a719-321035b8df63 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:07.457221 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b5d70-bc66-47b5-a719-321035b8df63 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:07.457221 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b5d70-bc66-47b5-a719-321035b8df63 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:07.458773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 20:41:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:41:07.463898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca4525-3140-4f4b-975c-77e4b2c406f0 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:07.464331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca4525-3140-4f4b-975c-77e4b2c406f0 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:07.464457 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca4525-3140-4f4b-975c-77e4b2c406f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:07.539577 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-3cca4525-3140-4f4b-975c-77e4b2c406f0 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:41:07.540785 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-3cca4525-3140-4f4b-975c-77e4b2c406f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:07.640654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 20:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:41:07.791834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b5d70-bc66-47b5-a719-321035b8df63 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:41:07.793378 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7e7b5d70-bc66-47b5-a719-321035b8df63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:07.845275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:07.948719 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b5d70-bc66-47b5-a719-321035b8df63 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:41:08.067708 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908dd2c-c38a-497f-9ff6-9027aeaf461a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:41:08.068285 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908dd2c-c38a-497f-9ff6-9027aeaf461a service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:08.068572 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908dd2c-c38a-497f-9ff6-9027aeaf461a service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:08.068849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908dd2c-c38a-497f-9ff6-9027aeaf461a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:08.070571 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d908dd2c-c38a-497f-9ff6-9027aeaf461a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:08.079232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:08.162851 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908dd2c-c38a-497f-9ff6-9027aeaf461a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:41:08.164747 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908dd2c-c38a-497f-9ff6-9027aeaf461a service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:41:08.183073 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 715/1431] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:41:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:41:08.990782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa3a9-9291-4342-97f6-6247815af3d6 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:08.991399 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa3a9-9291-4342-97f6-6247815af3d6 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:08.991500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa3a9-9291-4342-97f6-6247815af3d6 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:08.992803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 20:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:41:08.997922 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968667d2-cd43-47db-95d3-19c04c6a102e None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:08.998357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968667d2-cd43-47db-95d3-19c04c6a102e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:08.998480 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968667d2-cd43-47db-95d3-19c04c6a102e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:09.079719 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-968667d2-cd43-47db-95d3-19c04c6a102e None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:41:09.081579 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-968667d2-cd43-47db-95d3-19c04c6a102e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:09.153208 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:09.184000 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 20:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:41:09.344968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aa3a9-9291-4342-97f6-6247815af3d6 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:41:09.346489 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-939aa3a9-9291-4342-97f6-6247815af3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:09.365455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:09.499464 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aa3a9-9291-4342-97f6-6247815af3d6 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:41:09.588614 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:09.617940 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e564c06-87cb-4ee9-b234-effb572ad3e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:41:09.618596 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e564c06-87cb-4ee9-b234-effb572ad3e6 service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:09.618881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e564c06-87cb-4ee9-b234-effb572ad3e6 service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:09.619163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e564c06-87cb-4ee9-b234-effb572ad3e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:09.620885 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9e564c06-87cb-4ee9-b234-effb572ad3e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:09.717070 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e564c06-87cb-4ee9-b234-effb572ad3e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:41:09.717392 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e564c06-87cb-4ee9-b234-effb572ad3e6 service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:41:09.736378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 718/1434] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:41:10.560104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b16438-4212-490b-981c-b10117fb0f40 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:10.560666 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b16438-4212-490b-981c-b10117fb0f40 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:10.560666 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b16438-4212-490b-981c-b10117fb0f40 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:10.562112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 20:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:41:10.568001 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777990c-a255-4439-8a13-49abb7aa8847 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:10.568464 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777990c-a255-4439-8a13-49abb7aa8847 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:10.568632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777990c-a255-4439-8a13-49abb7aa8847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:10.650868 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-5777990c-a255-4439-8a13-49abb7aa8847 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:41:10.652024 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-5777990c-a255-4439-8a13-49abb7aa8847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:10.694787 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:10.753432 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 20:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:41:10.906189 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b16438-4212-490b-981c-b10117fb0f40 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:41:10.907651 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c0b16438-4212-490b-981c-b10117fb0f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:11.059539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b16438-4212-490b-981c-b10117fb0f40 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:41:11.114317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:11.177496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6fc11-f285-4ad4-b760-9ef39597c9f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:41:11.178075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6fc11-f285-4ad4-b760-9ef39597c9f5 service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:11.178340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6fc11-f285-4ad4-b760-9ef39597c9f5 service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:11.178608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6fc11-f285-4ad4-b760-9ef39597c9f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:11.180277 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-dce6fc11-f285-4ad4-b760-9ef39597c9f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:11.273776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6fc11-f285-4ad4-b760-9ef39597c9f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:41:11.275409 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6fc11-f285-4ad4-b760-9ef39597c9f5 service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:41:11.294395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 718/1437] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:41:12.121938 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801b966-46c9-48ee-a7ff-428a8282ca18 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:12.122621 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801b966-46c9-48ee-a7ff-428a8282ca18 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:12.122621 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801b966-46c9-48ee-a7ff-428a8282ca18 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:12.124092 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 20:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:41:12.130675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc09304-363e-4eb4-99d5-ac0d37803ff2 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:12.131312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc09304-363e-4eb4-99d5-ac0d37803ff2 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:12.131312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc09304-363e-4eb4-99d5-ac0d37803ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:12.214729 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-dbc09304-363e-4eb4-99d5-ac0d37803ff2 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:41:12.215991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-dbc09304-363e-4eb4-99d5-ac0d37803ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:12.218082 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:12.320089 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 20:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:41:12.474332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801b966-46c9-48ee-a7ff-428a8282ca18 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:41:12.476085 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b801b966-46c9-48ee-a7ff-428a8282ca18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:12.632136 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801b966-46c9-48ee-a7ff-428a8282ca18 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:41:12.660410 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:12.756143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6bd23-d5df-42d1-a741-57881547cdff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:41:12.757157 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6bd23-d5df-42d1-a741-57881547cdff service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:12.757157 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6bd23-d5df-42d1-a741-57881547cdff service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:12.757397 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6bd23-d5df-42d1-a741-57881547cdff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:12.759245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e6e6bd23-d5df-42d1-a741-57881547cdff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:12.858453 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6bd23-d5df-42d1-a741-57881547cdff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:41:12.860088 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6bd23-d5df-42d1-a741-57881547cdff service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:41:12.879468 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 721/1440] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:41:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:41:14.823910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6aa2a-2665-4dc6-9fde-cff6424b0004 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:14.824494 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6aa2a-2665-4dc6-9fde-cff6424b0004 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:14.824494 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6aa2a-2665-4dc6-9fde-cff6424b0004 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:14.825806 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 20:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:41:14.831511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47217293-85ba-4349-8533-a22b9380ba62 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:14.831977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47217293-85ba-4349-8533-a22b9380ba62 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:14.832092 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47217293-85ba-4349-8533-a22b9380ba62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:14.871831 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:14.899709 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-47217293-85ba-4349-8533-a22b9380ba62 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:41:14.900864 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-47217293-85ba-4349-8533-a22b9380ba62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:15.000778 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 20:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:41:15.040958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6aa2a-2665-4dc6-9fde-cff6424b0004 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:41:15.042579 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-49f6aa2a-2665-4dc6-9fde-cff6424b0004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:15.151367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6aa2a-2665-4dc6-9fde-cff6424b0004 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:41:15.183793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:15.225526 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2595080-3183-4ef0-a1ed-8a4a6a105e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:41:15.226168 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2595080-3183-4ef0-a1ed-8a4a6a105e89 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:15.226452 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2595080-3183-4ef0-a1ed-8a4a6a105e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:15.226722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2595080-3183-4ef0-a1ed-8a4a6a105e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:15.228389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a2595080-3183-4ef0-a1ed-8a4a6a105e89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:15.349630 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2595080-3183-4ef0-a1ed-8a4a6a105e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:41:15.351059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2595080-3183-4ef0-a1ed-8a4a6a105e89 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:41:15.370211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 721/1443] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:41:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:41:17.628223 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01479a59-659d-45ed-8647-552866143e38 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:17.628763 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01479a59-659d-45ed-8647-552866143e38 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:17.628938 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01479a59-659d-45ed-8647-552866143e38 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:17.630672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 20:41:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:41:17.636630 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe7618-8fb0-4122-9a7b-d9f35365a2ee None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:17.637096 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe7618-8fb0-4122-9a7b-d9f35365a2ee None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:17.637189 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe7618-8fb0-4122-9a7b-d9f35365a2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:17.720124 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-bcbe7618-8fb0-4122-9a7b-d9f35365a2ee None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:41:17.721983 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-bcbe7618-8fb0-4122-9a7b-d9f35365a2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:17.745713 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:17.833960 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 20:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:41:17.872667 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01479a59-659d-45ed-8647-552866143e38 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:41:17.874176 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-01479a59-659d-45ed-8647-552866143e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:17.989220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01479a59-659d-45ed-8647-552866143e38 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:41:18.002959 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:18.083154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cbfa6-fed1-45dc-9321-290eb8baf768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:41:18.083861 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cbfa6-fed1-45dc-9321-290eb8baf768 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:18.084148 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cbfa6-fed1-45dc-9321-290eb8baf768 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:18.084426 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cbfa6-fed1-45dc-9321-290eb8baf768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:18.086153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-374cbfa6-fed1-45dc-9321-290eb8baf768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:18.206202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cbfa6-fed1-45dc-9321-290eb8baf768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:41:18.207562 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cbfa6-fed1-45dc-9321-290eb8baf768 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:41:18.225992 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 724/1446] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:41:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:41:20.568703 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b44c7-c487-4377-a475-10d3061e1958 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:20.569259 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b44c7-c487-4377-a475-10d3061e1958 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:20.569259 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b44c7-c487-4377-a475-10d3061e1958 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:20.570601 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 20:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:41:20.575881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222556b3-5bde-4cd2-af14-47f39770bddb None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:20.576294 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222556b3-5bde-4cd2-af14-47f39770bddb None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:20.576415 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222556b3-5bde-4cd2-af14-47f39770bddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:20.623632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:20.642227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-222556b3-5bde-4cd2-af14-47f39770bddb None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:41:20.643455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-222556b3-5bde-4cd2-af14-47f39770bddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:20.740051 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 20:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:41:20.778031 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b44c7-c487-4377-a475-10d3061e1958 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:41:20.779569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-bf8b44c7-c487-4377-a475-10d3061e1958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:20.884186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b44c7-c487-4377-a475-10d3061e1958 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:41:20.925499 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:20.958725 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb85321-c5d6-4590-a5fb-b6ff8d0c9faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:41:20.959404 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb85321-c5d6-4590-a5fb-b6ff8d0c9faf service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:20.959687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb85321-c5d6-4590-a5fb-b6ff8d0c9faf service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:20.959953 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb85321-c5d6-4590-a5fb-b6ff8d0c9faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:20.961578 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3cb85321-c5d6-4590-a5fb-b6ff8d0c9faf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:21.076857 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb85321-c5d6-4590-a5fb-b6ff8d0c9faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:41:21.078608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb85321-c5d6-4590-a5fb-b6ff8d0c9faf service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:41:21.097248 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 724/1449] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:41:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:41:23.239541 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e11c7-da1a-445d-b62e-a80e840a2e98 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:23.240070 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e11c7-da1a-445d-b62e-a80e840a2e98 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:23.240172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e11c7-da1a-445d-b62e-a80e840a2e98 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:23.241531 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 20:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:41:23.246866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88065576-3af4-4699-b561-f0cd1f778a2b None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:23.247311 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88065576-3af4-4699-b561-f0cd1f778a2b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:23.247453 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88065576-3af4-4699-b561-f0cd1f778a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:23.312671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-88065576-3af4-4699-b561-f0cd1f778a2b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:41:23.313886 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-88065576-3af4-4699-b561-f0cd1f778a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:23.335107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:23.410645 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 20:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:41:23.448779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e11c7-da1a-445d-b62e-a80e840a2e98 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:41:23.450309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-446e11c7-da1a-445d-b62e-a80e840a2e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:23.552503 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e11c7-da1a-445d-b62e-a80e840a2e98 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:41:23.571677 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:23.625589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebeb4fc-f488-4bc4-b7b8-d1072fbbdf70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:41:23.626236 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebeb4fc-f488-4bc4-b7b8-d1072fbbdf70 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:23.626518 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebeb4fc-f488-4bc4-b7b8-d1072fbbdf70 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:23.626792 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebeb4fc-f488-4bc4-b7b8-d1072fbbdf70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:23.628488 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-3ebeb4fc-f488-4bc4-b7b8-d1072fbbdf70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:23.737196 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebeb4fc-f488-4bc4-b7b8-d1072fbbdf70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:41:23.738617 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebeb4fc-f488-4bc4-b7b8-d1072fbbdf70 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:41:23.756149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 727/1452] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:41:25.841339 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35566a6c-3ac1-4e34-b4b7-98809632298a None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:25.841909 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35566a6c-3ac1-4e34-b4b7-98809632298a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:25.841909 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35566a6c-3ac1-4e34-b4b7-98809632298a None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:25.843304 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 20:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:41:25.848673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26679048-9136-4582-b335-51f42a6e70c2 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:25.849069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26679048-9136-4582-b335-51f42a6e70c2 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:25.849242 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26679048-9136-4582-b335-51f42a6e70c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:25.913617 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:25.916687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-26679048-9136-4582-b335-51f42a6e70c2 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:41:25.918402 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-26679048-9136-4582-b335-51f42a6e70c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:26.014609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 20:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:41:26.052988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35566a6c-3ac1-4e34-b4b7-98809632298a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:41:26.054564 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-35566a6c-3ac1-4e34-b4b7-98809632298a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:26.161723 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35566a6c-3ac1-4e34-b4b7-98809632298a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:41:26.210804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:26.234809 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f2f8f-44ca-4b2e-bdae-74f681a3c1f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:41:26.235489 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f2f8f-44ca-4b2e-bdae-74f681a3c1f9 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:26.235776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f2f8f-44ca-4b2e-bdae-74f681a3c1f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:26.236052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f2f8f-44ca-4b2e-bdae-74f681a3c1f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:26.237730 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-130f2f8f-44ca-4b2e-bdae-74f681a3c1f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:26.346373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f2f8f-44ca-4b2e-bdae-74f681a3c1f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:41:26.347821 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f2f8f-44ca-4b2e-bdae-74f681a3c1f9 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:41:26.368444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 727/1455] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:41:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:41:28.525457 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebe278-6041-44a3-874b-3f11ffca3031 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:28.526046 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebe278-6041-44a3-874b-3f11ffca3031 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:28.526046 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebe278-6041-44a3-874b-3f11ffca3031 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:28.527530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 20:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:41:28.532857 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753181a-3ea4-43ec-ab4b-4335c0910e26 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:28.533248 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753181a-3ea4-43ec-ab4b-4335c0910e26 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:28.533425 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753181a-3ea4-43ec-ab4b-4335c0910e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:28.597970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-b753181a-3ea4-43ec-ab4b-4335c0910e26 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:41:28.599194 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b753181a-3ea4-43ec-ab4b-4335c0910e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:28.628471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:28.695085 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 20:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:41:28.734810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebe278-6041-44a3-874b-3f11ffca3031 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:41:28.736966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-61ebe278-6041-44a3-874b-3f11ffca3031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:28.840813 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebe278-6041-44a3-874b-3f11ffca3031 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:41:28.869588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:28.916522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71ce60-2475-4483-a795-6d9080dfc383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:41:28.917167 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71ce60-2475-4483-a795-6d9080dfc383 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:28.917452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71ce60-2475-4483-a795-6d9080dfc383 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:28.917719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71ce60-2475-4483-a795-6d9080dfc383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:28.919379 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-0c71ce60-2475-4483-a795-6d9080dfc383 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:29.026141 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71ce60-2475-4483-a795-6d9080dfc383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:41:29.027595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71ce60-2475-4483-a795-6d9080dfc383 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:41:29.045325 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 730/1458] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:41:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:41:31.144166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9eaad6-993b-4351-9c2e-bc4421ee94bb None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:31.144698 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9eaad6-993b-4351-9c2e-bc4421ee94bb None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:31.144698 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9eaad6-993b-4351-9c2e-bc4421ee94bb None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:31.146053 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 20:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:41:31.151418 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efbb0e-ddbc-43ec-8d48-e0c2e8651fb6 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:31.151865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efbb0e-ddbc-43ec-8d48-e0c2e8651fb6 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:31.151962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efbb0e-ddbc-43ec-8d48-e0c2e8651fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:31.232627 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-38efbb0e-ddbc-43ec-8d48-e0c2e8651fb6 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:41:31.234687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-38efbb0e-ddbc-43ec-8d48-e0c2e8651fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:31.247380 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:31.342272 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 20:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:41:31.380382 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9eaad6-993b-4351-9c2e-bc4421ee94bb None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:41:31.381994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-af9eaad6-993b-4351-9c2e-bc4421ee94bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:31.483371 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9eaad6-993b-4351-9c2e-bc4421ee94bb None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:41:31.537966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:31.557427 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a15f93-b3da-4c14-8196-bf3816c21e00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:41:31.558066 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a15f93-b3da-4c14-8196-bf3816c21e00 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:31.558348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a15f93-b3da-4c14-8196-bf3816c21e00 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:31.558620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a15f93-b3da-4c14-8196-bf3816c21e00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:31.560274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b2a15f93-b3da-4c14-8196-bf3816c21e00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:31.672680 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a15f93-b3da-4c14-8196-bf3816c21e00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:41:31.674861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a15f93-b3da-4c14-8196-bf3816c21e00 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:41:31.693295 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 730/1461] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:41:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:41:33.816025 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c32668-733d-4a2d-9e68-4cc16614e86e None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:33.816593 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c32668-733d-4a2d-9e68-4cc16614e86e None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:33.816593 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c32668-733d-4a2d-9e68-4cc16614e86e None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:33.817966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 20:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:41:33.823314 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90bb99-e295-4e8a-a8c2-a4f6335afe0b None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:33.823745 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90bb99-e295-4e8a-a8c2-a4f6335afe0b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:33.823870 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90bb99-e295-4e8a-a8c2-a4f6335afe0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:33.888691 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-3e90bb99-e295-4e8a-a8c2-a4f6335afe0b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:41:33.889911 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3e90bb99-e295-4e8a-a8c2-a4f6335afe0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:33.928628 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:33.985820 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 20:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:41:34.024337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c32668-733d-4a2d-9e68-4cc16614e86e None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:41:34.025873 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-66c32668-733d-4a2d-9e68-4cc16614e86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:34.129987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c32668-733d-4a2d-9e68-4cc16614e86e None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:41:34.167111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:34.202981 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400d09e-cd0a-4e27-a413-00e27d72b347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:41:34.203650 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400d09e-cd0a-4e27-a413-00e27d72b347 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:34.203932 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400d09e-cd0a-4e27-a413-00e27d72b347 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:34.204203 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400d09e-cd0a-4e27-a413-00e27d72b347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:34.205858 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b400d09e-cd0a-4e27-a413-00e27d72b347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:34.314191 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400d09e-cd0a-4e27-a413-00e27d72b347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:41:34.316238 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400d09e-cd0a-4e27-a413-00e27d72b347 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:41:34.334181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 733/1464] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:41:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:41:36.353667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b45787-5060-48ca-afa8-f492c857de7e None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:36.354331 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b45787-5060-48ca-afa8-f492c857de7e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:36.354331 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b45787-5060-48ca-afa8-f492c857de7e None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:36.355625 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 20:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:41:36.360962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4a947-fce0-4e08-9b04-c449a81dd4a1 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:36.361939 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4a947-fce0-4e08-9b04-c449a81dd4a1 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:36.362028 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4a947-fce0-4e08-9b04-c449a81dd4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:36.427551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-03f4a947-fce0-4e08-9b04-c449a81dd4a1 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:41:36.428752 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-03f4a947-fce0-4e08-9b04-c449a81dd4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:36.446774 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:36.523638 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 20:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:41:36.560336 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b45787-5060-48ca-afa8-f492c857de7e None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:41:36.561846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-19b45787-5060-48ca-afa8-f492c857de7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:36.664691 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b45787-5060-48ca-afa8-f492c857de7e None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:41:36.735012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:36.743148 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b6ca5-988f-4406-bb83-e6684c0a341c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:41:36.743834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b6ca5-988f-4406-bb83-e6684c0a341c service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:36.744115 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b6ca5-988f-4406-bb83-e6684c0a341c service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:36.744394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b6ca5-988f-4406-bb83-e6684c0a341c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:36.746036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-891b6ca5-988f-4406-bb83-e6684c0a341c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:36.853125 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b6ca5-988f-4406-bb83-e6684c0a341c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:41:36.854543 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b6ca5-988f-4406-bb83-e6684c0a341c service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:41:36.872942 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 733/1467] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:41:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:41:38.934013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719315c-1bde-490c-a4d3-0d0f266bc158 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:38.934542 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719315c-1bde-490c-a4d3-0d0f266bc158 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:38.934676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719315c-1bde-490c-a4d3-0d0f266bc158 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:38.936018 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 20:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:41:38.941843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6233185-ff2c-4f91-98dc-ac8a82638581 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:38.942268 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6233185-ff2c-4f91-98dc-ac8a82638581 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:38.942404 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6233185-ff2c-4f91-98dc-ac8a82638581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:39.006768 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-d6233185-ff2c-4f91-98dc-ac8a82638581 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:41:39.007994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d6233185-ff2c-4f91-98dc-ac8a82638581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:39.056405 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:39.105573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 20:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:41:39.143837 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719315c-1bde-490c-a4d3-0d0f266bc158 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:41:39.145427 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-2719315c-1bde-490c-a4d3-0d0f266bc158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:39.247650 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719315c-1bde-490c-a4d3-0d0f266bc158 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:41:39.294966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:39.321407 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdc8f9-e162-47bf-a4fd-65d09a5e7874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:41:39.322059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdc8f9-e162-47bf-a4fd-65d09a5e7874 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:39.322344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdc8f9-e162-47bf-a4fd-65d09a5e7874 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:39.322622 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdc8f9-e162-47bf-a4fd-65d09a5e7874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:39.324298 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-c9cdc8f9-e162-47bf-a4fd-65d09a5e7874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:39.437871 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdc8f9-e162-47bf-a4fd-65d09a5e7874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:41:39.439215 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdc8f9-e162-47bf-a4fd-65d09a5e7874 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:41:39.457537 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 736/1470] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:41:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:41:49.103728 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=22 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:49.454672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=66 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:59.195903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257ccda-864f-4d02-9953-a5800867e79e None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:59.196441 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257ccda-864f-4d02-9953-a5800867e79e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:59.196441 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257ccda-864f-4d02-9953-a5800867e79e None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:59.197776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 735/1471] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:41:59.203723 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231055cd-b9c7-4435-8c51-e52f539a9e31 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:59.204184 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231055cd-b9c7-4435-8c51-e52f539a9e31 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:59.204293 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231055cd-b9c7-4435-8c51-e52f539a9e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:59.269934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-231055cd-b9c7-4435-8c51-e52f539a9e31 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:41:59.271151 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-231055cd-b9c7-4435-8c51-e52f539a9e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:59.368182 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 737/1472] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:41:59.451999 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaefd61-7e07-4592-b707-b0d85deeeb1a None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:59.452287 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaefd61-7e07-4592-b707-b0d85deeeb1a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:59.452567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaefd61-7e07-4592-b707-b0d85deeeb1a None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:59.453942 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 736/1473] 10.222.0.77 () {54 vars in 966 bytes} [Tue Jul 19 20:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:41:59.458923 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87e479-0aab-43a1-b46d-b47ac03b0c01 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:59.459199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87e479-0aab-43a1-b46d-b47ac03b0c01 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:59.459510 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87e479-0aab-43a1-b46d-b47ac03b0c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:59.542985 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-9e87e479-0aab-43a1-b46d-b47ac03b0c01 None None] MFA Rules not processed for user `7d9a41e10cb64ee9972debaf856503d4`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:41:59.544245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9e87e479-0aab-43a1-b46d-b47ac03b0c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:59.564473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:59.620548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 738/1474] 10.222.0.77 () {58 vars in 1063 bytes} [Tue Jul 19 20:41:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:41:59.628134 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaefd61-7e07-4592-b707-b0d85deeeb1a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:41:59.629645 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-eeaefd61-7e07-4592-b707-b0d85deeeb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:59.733156 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaefd61-7e07-4592-b707-b0d85deeeb1a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:41:59.804613 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4b6f0-e82c-4538-882e-dfed5b42e901 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d9a41e10cb64ee9972debaf856503d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:41:59.805255 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4b6f0-e82c-4538-882e-dfed5b42e901 service glance] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:41:59.805534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4b6f0-e82c-4538-882e-dfed5b42e901 service glance] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:41:59.805807 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4b6f0-e82c-4538-882e-dfed5b42e901 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:41:59.807447 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-65c4b6f0-e82c-4538-882e-dfed5b42e901 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:41:59.859781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:41:59.916504 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4b6f0-e82c-4538-882e-dfed5b42e901 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:41:59.917971 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4b6f0-e82c-4538-882e-dfed5b42e901 service glance] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:41:59.936274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 737/1475] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:41:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:42:02.051968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57255a26-ffd4-45d2-80ba-e3259758ff12 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:42:02.052876 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57255a26-ffd4-45d2-80ba-e3259758ff12 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:42:02.052876 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57255a26-ffd4-45d2-80ba-e3259758ff12 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:42:02.054448 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 739/1476] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:42:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:42:02.059922 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44c473-23b6-4ab7-8008-be59de6ce4ad None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:42:02.060340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44c473-23b6-4ab7-8008-be59de6ce4ad None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:42:02.060477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44c473-23b6-4ab7-8008-be59de6ce4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:42:02.123593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-aa44c473-23b6-4ab7-8008-be59de6ce4ad None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:42:02.124773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-aa44c473-23b6-4ab7-8008-be59de6ce4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:42:02.221880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 738/1477] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:42:02.246053 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57255a26-ffd4-45d2-80ba-e3259758ff12 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:42:02.247744 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-57255a26-ffd4-45d2-80ba-e3259758ff12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:42:02.380430 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57255a26-ffd4-45d2-80ba-e3259758ff12 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:42:02.430379 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:02.475452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a9bdf-c6f5-49d9-acbb-6c49a7ddc7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:42:02.476078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a9bdf-c6f5-49d9-acbb-6c49a7ddc7fe admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:42:02.476356 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a9bdf-c6f5-49d9-acbb-6c49a7ddc7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:42:02.476627 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a9bdf-c6f5-49d9-acbb-6c49a7ddc7fe admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:42:02.477351 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a9bdf-c6f5-49d9-acbb-6c49a7ddc7fe admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:42:02.479176 dv-cinder-749155-8-smb devstack@keystone.service[92087]: WARNING py.warnings [None req-fe1a9bdf-c6f5-49d9-acbb-6c49a7ddc7fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:42:02.479176 dv-cinder-749155-8-smb devstack@keystone.service[92087]: warnings.warn(msg) Jul 19 20:42:02.479176 dv-cinder-749155-8-smb devstack@keystone.service[92087]: Jul 19 20:42:02.480341 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a9bdf-c6f5-49d9-acbb-6c49a7ddc7fe admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:42:02.499070 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 740/1478] 10.222.0.77 () {56 vars in 1108 bytes} [Tue Jul 19 20:42:02 2022] GET /identity/v3/projects => generated 2553 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:42:04.579434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86661e33-37b2-4a50-8fea-c6f7b8a8cc17 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:42:04.579964 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86661e33-37b2-4a50-8fea-c6f7b8a8cc17 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:42:04.580090 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86661e33-37b2-4a50-8fea-c6f7b8a8cc17 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:42:04.581430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 739/1479] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:42:04.586720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfb42a-f962-46d3-9a7e-ce833bc6c038 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:42:04.587154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfb42a-f962-46d3-9a7e-ce833bc6c038 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:42:04.587304 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfb42a-f962-46d3-9a7e-ce833bc6c038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:42:04.653133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-60bfb42a-f962-46d3-9a7e-ce833bc6c038 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:42:04.654288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-60bfb42a-f962-46d3-9a7e-ce833bc6c038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:42:04.751658 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 741/1480] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:42:04.797894 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86661e33-37b2-4a50-8fea-c6f7b8a8cc17 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:42:04.799501 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-86661e33-37b2-4a50-8fea-c6f7b8a8cc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:42:04.809520 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:04.945508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86661e33-37b2-4a50-8fea-c6f7b8a8cc17 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:42:05.024452 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:05.057650 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91178e3b-b1d3-4474-83cc-8e1ed81b5203 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:42:05.058298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91178e3b-b1d3-4474-83cc-8e1ed81b5203 service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:42:05.058585 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91178e3b-b1d3-4474-83cc-8e1ed81b5203 service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:42:05.058865 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91178e3b-b1d3-4474-83cc-8e1ed81b5203 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:42:05.060537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-91178e3b-b1d3-4474-83cc-8e1ed81b5203 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:42:05.148826 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91178e3b-b1d3-4474-83cc-8e1ed81b5203 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:42:05.150416 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91178e3b-b1d3-4474-83cc-8e1ed81b5203 service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:42:05.168320 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 740/1481] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:42:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:42:07.370384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501e945-3535-4830-a3c4-8e9ec4bdd8e5 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:42:07.370980 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501e945-3535-4830-a3c4-8e9ec4bdd8e5 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:42:07.370980 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501e945-3535-4830-a3c4-8e9ec4bdd8e5 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:42:07.372334 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 742/1482] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:42:07.378210 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a0a04-e862-4ca4-abdb-f4a2d7068529 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:42:07.378689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a0a04-e862-4ca4-abdb-f4a2d7068529 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:42:07.378886 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a0a04-e862-4ca4-abdb-f4a2d7068529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:42:07.442556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-261a0a04-e862-4ca4-abdb-f4a2d7068529 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:42:07.443793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-261a0a04-e862-4ca4-abdb-f4a2d7068529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:42:07.488817 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:07.539391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 741/1483] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:42:07.575933 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501e945-3535-4830-a3c4-8e9ec4bdd8e5 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:42:07.577508 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-3501e945-3535-4830-a3c4-8e9ec4bdd8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:42:07.601342 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:07.688562 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501e945-3535-4830-a3c4-8e9ec4bdd8e5 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:42:07.766371 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b0a32-da16-44aa-8152-ab749c8b1e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:42:07.767545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b0a32-da16-44aa-8152-ab749c8b1e84 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:42:07.767836 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b0a32-da16-44aa-8152-ab749c8b1e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:42:07.768109 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b0a32-da16-44aa-8152-ab749c8b1e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:42:07.769778 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-996b0a32-da16-44aa-8152-ab749c8b1e84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:42:07.845196 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:07.881199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b0a32-da16-44aa-8152-ab749c8b1e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:42:07.882636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996b0a32-da16-44aa-8152-ab749c8b1e84 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:42:07.901221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 743/1484] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:42:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:42:10.003010 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44be166-4094-4e3f-876d-299d7f53bfb6 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:42:10.003605 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44be166-4094-4e3f-876d-299d7f53bfb6 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:42:10.003605 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44be166-4094-4e3f-876d-299d7f53bfb6 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:42:10.005520 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 742/1485] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:42:10.011197 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55916565-a089-4800-87eb-04dbe25b01cf None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:42:10.011675 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55916565-a089-4800-87eb-04dbe25b01cf None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:42:10.011960 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55916565-a089-4800-87eb-04dbe25b01cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:42:10.075594 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-55916565-a089-4800-87eb-04dbe25b01cf None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:42:10.076800 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-55916565-a089-4800-87eb-04dbe25b01cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:42:10.171100 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 744/1486] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:42:10.211426 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44be166-4094-4e3f-876d-299d7f53bfb6 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:42:10.212948 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b44be166-4094-4e3f-876d-299d7f53bfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:42:10.313844 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44be166-4094-4e3f-876d-299d7f53bfb6 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:42:10.383519 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:10.385341 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af34c5-eb83-47ec-9708-a12f65184065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:42:10.385990 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af34c5-eb83-47ec-9708-a12f65184065 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:42:10.386462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af34c5-eb83-47ec-9708-a12f65184065 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:42:10.386777 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af34c5-eb83-47ec-9708-a12f65184065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:42:10.388954 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-f0af34c5-eb83-47ec-9708-a12f65184065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:42:10.495718 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af34c5-eb83-47ec-9708-a12f65184065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:42:10.497125 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af34c5-eb83-47ec-9708-a12f65184065 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:42:10.515070 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 743/1487] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:42:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:42:12.849870 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa77ae2-ce78-4731-9d3f-df8a06153d0d None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:42:12.850407 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa77ae2-ce78-4731-9d3f-df8a06153d0d None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:42:12.850407 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa77ae2-ce78-4731-9d3f-df8a06153d0d None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:42:12.851841 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 745/1488] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:42:12.857235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec7feb-e0d9-417b-9288-27db83cda5d9 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:42:12.857717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec7feb-e0d9-417b-9288-27db83cda5d9 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:42:12.857818 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec7feb-e0d9-417b-9288-27db83cda5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:42:12.932200 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-7bec7feb-e0d9-417b-9288-27db83cda5d9 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:42:12.933440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7bec7feb-e0d9-417b-9288-27db83cda5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:42:12.995710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:13.048720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 744/1489] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:42:13.090476 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa77ae2-ce78-4731-9d3f-df8a06153d0d None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:42:13.092089 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-2fa77ae2-ce78-4731-9d3f-df8a06153d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:42:13.132980 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:13.203130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa77ae2-ce78-4731-9d3f-df8a06153d0d None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:42:13.281913 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f1135-fefa-4aad-9937-2764e4c1d5a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:42:13.282467 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f1135-fefa-4aad-9937-2764e4c1d5a2 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:42:13.282749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f1135-fefa-4aad-9937-2764e4c1d5a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:42:13.283024 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f1135-fefa-4aad-9937-2764e4c1d5a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:42:13.285357 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-335f1135-fefa-4aad-9937-2764e4c1d5a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:42:13.368233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:13.399745 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f1135-fefa-4aad-9937-2764e4c1d5a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:42:13.401185 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f1135-fefa-4aad-9937-2764e4c1d5a2 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:42:13.432825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 746/1490] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:42:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:42:15.685429 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb27354-b6ad-4254-aff1-4b9fcdb5e04a None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:42:15.686261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb27354-b6ad-4254-aff1-4b9fcdb5e04a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:42:15.686261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb27354-b6ad-4254-aff1-4b9fcdb5e04a None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:42:15.687349 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 745/1491] 10.222.0.77 () {54 vars in 926 bytes} [Tue Jul 19 20:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:42:15.693044 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca802fb-a90e-4dd5-b06f-2701532a3792 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:42:15.693489 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca802fb-a90e-4dd5-b06f-2701532a3792 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:42:15.693600 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca802fb-a90e-4dd5-b06f-2701532a3792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:42:15.757197 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-5ca802fb-a90e-4dd5-b06f-2701532a3792 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:42:15.758425 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-5ca802fb-a90e-4dd5-b06f-2701532a3792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:42:15.875746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 747/1492] 10.222.0.77 () {58 vars in 1023 bytes} [Tue Jul 19 20:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:42:15.915667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb27354-b6ad-4254-aff1-4b9fcdb5e04a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:42:15.917191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-aeb27354-b6ad-4254-aff1-4b9fcdb5e04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:42:16.020852 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb27354-b6ad-4254-aff1-4b9fcdb5e04a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:42:16.093896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c400ff-debe-4456-902a-746815d2a893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:42:16.094541 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c400ff-debe-4456-902a-746815d2a893 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:42:16.094821 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c400ff-debe-4456-902a-746815d2a893 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:42:16.095095 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c400ff-debe-4456-902a-746815d2a893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:42:16.097413 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-37c400ff-debe-4456-902a-746815d2a893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:42:16.106347 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:16.215753 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c400ff-debe-4456-902a-746815d2a893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:42:16.217173 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c400ff-debe-4456-902a-746815d2a893 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:42:16.234696 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 746/1493] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:42:25.873918 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=82 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:42:26.232662 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=50 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:50.288791 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24b8b5-7bb2-4a23-a5e1-1f4679d01d9d None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:43:50.289421 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24b8b5-7bb2-4a23-a5e1-1f4679d01d9d None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:43:50.289421 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a24b8b5-7bb2-4a23-a5e1-1f4679d01d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:43:50.364889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-7a24b8b5-7bb2-4a23-a5e1-1f4679d01d9d None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:43:50.366131 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-7a24b8b5-7bb2-4a23-a5e1-1f4679d01d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:43:50.470141 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 748/1494] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:43:50.478111 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84e8c7-e8dd-4dc0-a4e0-2b73749370f3 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:43:50.478618 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84e8c7-e8dd-4dc0-a4e0-2b73749370f3 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:43:50.478724 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84e8c7-e8dd-4dc0-a4e0-2b73749370f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:43:50.561484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-de84e8c7-e8dd-4dc0-a4e0-2b73749370f3 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:43:50.562596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-de84e8c7-e8dd-4dc0-a4e0-2b73749370f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:43:50.667956 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 747/1495] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:43:50.673114 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24b8b5-7bb2-4a23-a5e1-1f4679d01d9d None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:43:50.674306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-7a24b8b5-7bb2-4a23-a5e1-1f4679d01d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:43:50.685472 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a24b8b5-7bb2-4a23-a5e1-1f4679d01d9d None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:43:50.746182 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:50.783961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce3f3c-7d26-4d89-80c7-e9b5e9f3cbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:43:50.784631 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce3f3c-7d26-4d89-80c7-e9b5e9f3cbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:43:50.784911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce3f3c-7d26-4d89-80c7-e9b5e9f3cbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:43:50.785183 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce3f3c-7d26-4d89-80c7-e9b5e9f3cbe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:43:50.785904 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce3f3c-7d26-4d89-80c7-e9b5e9f3cbe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:43:50.786206 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce3f3c-7d26-4d89-80c7-e9b5e9f3cbe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:43:50.787230 dv-cinder-749155-8-smb devstack@keystone.service[92087]: WARNING py.warnings [None req-f3ce3f3c-7d26-4d89-80c7-e9b5e9f3cbe6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:43:50.787230 dv-cinder-749155-8-smb devstack@keystone.service[92087]: warnings.warn(msg) Jul 19 20:43:50.787230 dv-cinder-749155-8-smb devstack@keystone.service[92087]: Jul 19 20:43:50.788435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ce3f3c-7d26-4d89-80c7-e9b5e9f3cbe6 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:43:50.803085 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 749/1496] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:43:50.811899 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84e8c7-e8dd-4dc0-a4e0-2b73749370f3 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:43:50.822088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84e8c7-e8dd-4dc0-a4e0-2b73749370f3 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:43:50.895754 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:50.932995 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6c202-7e7b-45b7-9b01-99e9b22bb694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:43:50.933663 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6c202-7e7b-45b7-9b01-99e9b22bb694 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:43:50.933964 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6c202-7e7b-45b7-9b01-99e9b22bb694 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:43:50.934214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6c202-7e7b-45b7-9b01-99e9b22bb694 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:43:50.935710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6c202-7e7b-45b7-9b01-99e9b22bb694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:43:50.937121 dv-cinder-749155-8-smb devstack@keystone.service[92088]: WARNING py.warnings [None req-9ab6c202-7e7b-45b7-9b01-99e9b22bb694 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:43:50.937121 dv-cinder-749155-8-smb devstack@keystone.service[92088]: warnings.warn(msg) Jul 19 20:43:50.937121 dv-cinder-749155-8-smb devstack@keystone.service[92088]: Jul 19 20:43:50.940020 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6c202-7e7b-45b7-9b01-99e9b22bb694 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:43:51.127578 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 748/1497] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:43:50 2022] POST /identity/v3/projects => generated 377 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:43:51.131657 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce3f3c-7d26-4d89-80c7-e9b5e9f3cbe6 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:43:51.133212 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-f3ce3f3c-7d26-4d89-80c7-e9b5e9f3cbe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:43:51.168235 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce3f3c-7d26-4d89-80c7-e9b5e9f3cbe6 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:43:51.265005 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc109e-c668-4815-8914-478e99779f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:43:51.265821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc109e-c668-4815-8914-478e99779f19 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:43:51.266121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc109e-c668-4815-8914-478e99779f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:43:51.266437 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc109e-c668-4815-8914-478e99779f19 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:43:51.267325 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc109e-c668-4815-8914-478e99779f19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:43:51.268586 dv-cinder-749155-8-smb devstack@keystone.service[92087]: WARNING py.warnings [None req-35fc109e-c668-4815-8914-478e99779f19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:43:51.268586 dv-cinder-749155-8-smb devstack@keystone.service[92087]: warnings.warn(msg) Jul 19 20:43:51.268586 dv-cinder-749155-8-smb devstack@keystone.service[92087]: Jul 19 20:43:51.270106 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fc109e-c668-4815-8914-478e99779f19 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:43:51.325854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 750/1498] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:43:51 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:43:51.330160 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6c202-7e7b-45b7-9b01-99e9b22bb694 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:43:51.331743 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-9ab6c202-7e7b-45b7-9b01-99e9b22bb694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:43:51.395740 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6c202-7e7b-45b7-9b01-99e9b22bb694 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:43:51.481363 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:51.493415 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8cd9a-4565-4d22-91c5-f2f0aebeed27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:43:51.494084 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8cd9a-4565-4d22-91c5-f2f0aebeed27 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:43:51.494364 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8cd9a-4565-4d22-91c5-f2f0aebeed27 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:43:51.494638 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8cd9a-4565-4d22-91c5-f2f0aebeed27 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:43:51.495396 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8cd9a-4565-4d22-91c5-f2f0aebeed27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:43:51.496402 dv-cinder-749155-8-smb devstack@keystone.service[92088]: WARNING py.warnings [None req-b0d8cd9a-4565-4d22-91c5-f2f0aebeed27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:43:51.496402 dv-cinder-749155-8-smb devstack@keystone.service[92088]: warnings.warn(msg) Jul 19 20:43:51.496402 dv-cinder-749155-8-smb devstack@keystone.service[92088]: Jul 19 20:43:51.497436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8cd9a-4565-4d22-91c5-f2f0aebeed27 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:43:51.510469 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 749/1499] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:43:51.514662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc109e-c668-4815-8914-478e99779f19 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:43:51.516309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-35fc109e-c668-4815-8914-478e99779f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:43:51.528027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc109e-c668-4815-8914-478e99779f19 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:43:51.553634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:51.624995 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f33a2d-d9f1-493c-8f60-5e1c9b2b1685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:43:51.625698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f33a2d-d9f1-493c-8f60-5e1c9b2b1685 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:43:51.625978 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f33a2d-d9f1-493c-8f60-5e1c9b2b1685 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:43:51.626253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f33a2d-d9f1-493c-8f60-5e1c9b2b1685 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:43:51.626979 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f33a2d-d9f1-493c-8f60-5e1c9b2b1685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:43:51.628027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: WARNING py.warnings [None req-f8f33a2d-d9f1-493c-8f60-5e1c9b2b1685 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:43:51.628027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: warnings.warn(msg) Jul 19 20:43:51.628027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: Jul 19 20:43:51.628940 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f33a2d-d9f1-493c-8f60-5e1c9b2b1685 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:43:51.641361 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 751/1500] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:43:51.646031 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8cd9a-4565-4d22-91c5-f2f0aebeed27 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:43:51.647669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b0d8cd9a-4565-4d22-91c5-f2f0aebeed27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:43:51.685452 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8cd9a-4565-4d22-91c5-f2f0aebeed27 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:43:51.802221 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42adfd3-edb0-4f81-829b-3cb2aa0381b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:43:51.803143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42adfd3-edb0-4f81-829b-3cb2aa0381b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:43:51.803521 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42adfd3-edb0-4f81-829b-3cb2aa0381b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:43:51.803795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42adfd3-edb0-4f81-829b-3cb2aa0381b9 admin admin] PATH_INFO: `/v3/projects/b2b15d1a614143d39157021884c6df02/users/dff0fdfbfd7e49009775ca9ed7656963/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:43:51.825623 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42adfd3-edb0-4f81-829b-3cb2aa0381b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b15d1a614143d39157021884c6df02, user_id=dff0fdfbfd7e49009775ca9ed7656963, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:43:51.826743 dv-cinder-749155-8-smb devstack@keystone.service[92088]: WARNING py.warnings [None req-e42adfd3-edb0-4f81-829b-3cb2aa0381b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:43:51.826743 dv-cinder-749155-8-smb devstack@keystone.service[92088]: warnings.warn(msg) Jul 19 20:43:51.826743 dv-cinder-749155-8-smb devstack@keystone.service[92088]: Jul 19 20:43:51.828724 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42adfd3-edb0-4f81-829b-3cb2aa0381b9 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:43:51.853541 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 750/1501] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:43:51 2022] PUT /identity/v3/projects/b2b15d1a614143d39157021884c6df02/users/dff0fdfbfd7e49009775ca9ed7656963/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:43:51.866105 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500428a-faf0-4ff9-acf1-792b0da2322c None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:43:51.866391 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500428a-faf0-4ff9-acf1-792b0da2322c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:43:51.866669 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500428a-faf0-4ff9-acf1-792b0da2322c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:43:51.925239 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-b500428a-faf0-4ff9-acf1-792b0da2322c None None] MFA Rules not processed for user `dff0fdfbfd7e49009775ca9ed7656963`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:43:51.926366 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b500428a-faf0-4ff9-acf1-792b0da2322c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:43:52.009039 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 752/1502] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:43:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:43:52.022698 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714ac13-8b69-4ba8-ad07-c4fde74a1ed4 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:43:52.022985 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714ac13-8b69-4ba8-ad07-c4fde74a1ed4 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:43:52.023286 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714ac13-8b69-4ba8-ad07-c4fde74a1ed4 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:43:52.024646 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 751/1503] 10.222.0.77 () {54 vars in 964 bytes} [Tue Jul 19 20:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:43:52.029795 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba25f1-9d68-4678-81d3-b4471773fd6c None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:43:52.030083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba25f1-9d68-4678-81d3-b4471773fd6c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:43:52.030361 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba25f1-9d68-4678-81d3-b4471773fd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:43:52.084705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:52.133641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-8bba25f1-9d68-4678-81d3-b4471773fd6c None None] MFA Rules not processed for user `1ab64f417fe74fc585f32691aa7fb515`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:43:52.134860 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-8bba25f1-9d68-4678-81d3-b4471773fd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:43:52.339725 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 753/1504] 10.222.0.77 () {58 vars in 1061 bytes} [Tue Jul 19 20:43:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:43:52.347999 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714ac13-8b69-4ba8-ad07-c4fde74a1ed4 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:43:52.349518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-9714ac13-8b69-4ba8-ad07-c4fde74a1ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:43:52.399444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:52.455287 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714ac13-8b69-4ba8-ad07-c4fde74a1ed4 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:43:52.543001 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d411f12-7268-4a35-bcec-3302e9351829 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:43:52.543800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d411f12-7268-4a35-bcec-3302e9351829 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:43:52.544199 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d411f12-7268-4a35-bcec-3302e9351829 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:43:52.544535 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d411f12-7268-4a35-bcec-3302e9351829 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:43:52.546707 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7d411f12-7268-4a35-bcec-3302e9351829 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:43:52.657007 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d411f12-7268-4a35-bcec-3302e9351829 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:43:52.658348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d411f12-7268-4a35-bcec-3302e9351829 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:43:52.661886 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:52.676825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 752/1505] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:43:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:43:52.719838 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6f946-757f-4483-ab7c-b81680383879 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:43:52.720247 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6f946-757f-4483-ab7c-b81680383879 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:43:52.720524 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6f946-757f-4483-ab7c-b81680383879 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:43:52.721812 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 754/1506] 10.222.0.77 () {52 vars in 829 bytes} [Tue Jul 19 20:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:43:52.725391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d411f12-7268-4a35-bcec-3302e9351829 service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:43:52.726656 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7d411f12-7268-4a35-bcec-3302e9351829 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:43:52.824778 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d411f12-7268-4a35-bcec-3302e9351829 service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:43:52.921212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac31d94-567d-4b4d-963f-c3611f9410e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:43:52.921997 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac31d94-567d-4b4d-963f-c3611f9410e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:43:52.922274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac31d94-567d-4b4d-963f-c3611f9410e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:43:52.922543 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac31d94-567d-4b4d-963f-c3611f9410e0 admin admin] PATH_INFO: `/v3/users/dff0fdfbfd7e49009775ca9ed7656963` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:43:52.934988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac31d94-567d-4b4d-963f-c3611f9410e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff0fdfbfd7e49009775ca9ed7656963)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:43:52.936043 dv-cinder-749155-8-smb devstack@keystone.service[92088]: WARNING py.warnings [None req-dac31d94-567d-4b4d-963f-c3611f9410e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:43:52.936043 dv-cinder-749155-8-smb devstack@keystone.service[92088]: warnings.warn(msg) Jul 19 20:43:52.936043 dv-cinder-749155-8-smb devstack@keystone.service[92088]: Jul 19 20:43:52.937233 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac31d94-567d-4b4d-963f-c3611f9410e0 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:43:52.946689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:53.001934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-dac31d94-567d-4b4d-963f-c3611f9410e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff0fdfbfd7e49009775ca9ed7656963'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:43:53.019932 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-dac31d94-567d-4b4d-963f-c3611f9410e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff0fdfbfd7e49009775ca9ed7656963'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:43:53.041846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-dac31d94-567d-4b4d-963f-c3611f9410e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff0fdfbfd7e49009775ca9ed7656963'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:43:53.053452 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-dac31d94-567d-4b4d-963f-c3611f9410e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff0fdfbfd7e49009775ca9ed7656963'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:43:53.054113 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-dac31d94-567d-4b4d-963f-c3611f9410e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff0fdfbfd7e49009775ca9ed7656963'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:43:53.061274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 753/1507] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:43:52 2022] DELETE /identity/v3/users/dff0fdfbfd7e49009775ca9ed7656963 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:43:53.066947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ca3eb-9098-477d-89b9-93c32fcb8141 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:43:53.067276 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ca3eb-9098-477d-89b9-93c32fcb8141 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:43:53.067560 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ca3eb-9098-477d-89b9-93c32fcb8141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:43:53.122927 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-b27ca3eb-9098-477d-89b9-93c32fcb8141 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:43:53.124157 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b27ca3eb-9098-477d-89b9-93c32fcb8141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:43:53.198754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:53.214929 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 755/1508] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:43:53.226219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac31d94-567d-4b4d-963f-c3611f9410e0 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:43:53.227494 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-dac31d94-567d-4b4d-963f-c3611f9410e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:43:53.341322 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac31d94-567d-4b4d-963f-c3611f9410e0 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:43:53.400463 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:43:53.424172 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb387d0d-513f-4365-ac8e-68ae031e8bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:43:53.424931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb387d0d-513f-4365-ac8e-68ae031e8bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:43:53.425247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb387d0d-513f-4365-ac8e-68ae031e8bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:43:53.425651 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb387d0d-513f-4365-ac8e-68ae031e8bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:43:53.427625 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-cb387d0d-513f-4365-ac8e-68ae031e8bb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:43:53.544204 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb387d0d-513f-4365-ac8e-68ae031e8bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:43:53.545654 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb387d0d-513f-4365-ac8e-68ae031e8bb4 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:43:53.565683 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 754/1509] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:43:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:43:53.951987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ca3eb-9098-477d-89b9-93c32fcb8141 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:43:53.954333 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b27ca3eb-9098-477d-89b9-93c32fcb8141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:43:53.966220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ca3eb-9098-477d-89b9-93c32fcb8141 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:43:54.069548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41475f3-239f-4d43-b65d-c96ffa9ae9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:43:54.070418 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41475f3-239f-4d43-b65d-c96ffa9ae9e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:43:54.070697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41475f3-239f-4d43-b65d-c96ffa9ae9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:43:54.070968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41475f3-239f-4d43-b65d-c96ffa9ae9e5 admin admin] PATH_INFO: `/v3/projects/b2b15d1a614143d39157021884c6df02` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:43:54.082206 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41475f3-239f-4d43-b65d-c96ffa9ae9e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b15d1a614143d39157021884c6df02)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:43:54.083171 dv-cinder-749155-8-smb devstack@keystone.service[92087]: WARNING py.warnings [None req-a41475f3-239f-4d43-b65d-c96ffa9ae9e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:43:54.083171 dv-cinder-749155-8-smb devstack@keystone.service[92087]: warnings.warn(msg) Jul 19 20:43:54.083171 dv-cinder-749155-8-smb devstack@keystone.service[92087]: Jul 19 20:43:54.084396 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41475f3-239f-4d43-b65d-c96ffa9ae9e5 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:43:54.144304 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a41475f3-239f-4d43-b65d-c96ffa9ae9e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b15d1a614143d39157021884c6df02', 'request_id': 'req-a41475f3-239f-4d43-b65d-c96ffa9ae9e5'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:43:54.154903 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a41475f3-239f-4d43-b65d-c96ffa9ae9e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b15d1a614143d39157021884c6df02', 'request_id': 'req-a41475f3-239f-4d43-b65d-c96ffa9ae9e5'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:43:54.161910 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a41475f3-239f-4d43-b65d-c96ffa9ae9e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b15d1a614143d39157021884c6df02', 'request_id': 'req-a41475f3-239f-4d43-b65d-c96ffa9ae9e5'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:43:54.194505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a41475f3-239f-4d43-b65d-c96ffa9ae9e5 admin admin] The token cache is being invalidate because project b2b15d1a614143d39157021884c6df02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:43:54.194771 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a41475f3-239f-4d43-b65d-c96ffa9ae9e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:43:54.195211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a41475f3-239f-4d43-b65d-c96ffa9ae9e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:43:54.196695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 756/1510] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:43:53 2022] DELETE /identity/v3/projects/b2b15d1a614143d39157021884c6df02 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:44:03.563142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=62 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:44:04.192520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:54.148750 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ebd8c-c4de-4113-a00b-f3fb73beea14 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:45:54.149326 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ebd8c-c4de-4113-a00b-f3fb73beea14 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:45:54.149326 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ebd8c-c4de-4113-a00b-f3fb73beea14 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:45:54.150602 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 20:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:45:54.156456 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832078cc-7dac-42b1-a482-9b13f784d904 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:45:54.157235 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832078cc-7dac-42b1-a482-9b13f784d904 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:45:54.157235 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832078cc-7dac-42b1-a482-9b13f784d904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:45:54.235927 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-832078cc-7dac-42b1-a482-9b13f784d904 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:45:54.237129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-832078cc-7dac-42b1-a482-9b13f784d904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:45:54.346052 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 20:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:45:54.500256 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ebd8c-c4de-4113-a00b-f3fb73beea14 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:45:54.502428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-6e7ebd8c-c4de-4113-a00b-f3fb73beea14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:45:54.626396 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ebd8c-c4de-4113-a00b-f3fb73beea14 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:45:54.631915 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0adc6-4fb2-401d-befd-aa7074fc020d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:45:54.632564 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0adc6-4fb2-401d-befd-aa7074fc020d service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:45:54.632851 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0adc6-4fb2-401d-befd-aa7074fc020d service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:45:54.633126 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0adc6-4fb2-401d-befd-aa7074fc020d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:45:54.641955 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0adc6-4fb2-401d-befd-aa7074fc020d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:45:54.643630 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0adc6-4fb2-401d-befd-aa7074fc020d service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:45:54.653023 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 756/1513] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:45:55.506928 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c884058-b281-432a-a374-c0a0e81a0e9c None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:45:55.507541 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c884058-b281-432a-a374-c0a0e81a0e9c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:45:55.507541 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c884058-b281-432a-a374-c0a0e81a0e9c None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:45:55.508893 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 20:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:45:55.514273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1bd10-4262-4b16-9b32-ad1dd775988d None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:45:55.514767 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1bd10-4262-4b16-9b32-ad1dd775988d None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:45:55.514873 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1bd10-4262-4b16-9b32-ad1dd775988d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:45:55.534513 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-c4e1bd10-4262-4b16-9b32-ad1dd775988d None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:45:55.535753 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c4e1bd10-4262-4b16-9b32-ad1dd775988d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:45:55.543807 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 20:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:45:55.702787 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c884058-b281-432a-a374-c0a0e81a0e9c None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:45:55.717706 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c884058-b281-432a-a374-c0a0e81a0e9c None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:45:55.723140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd1821-4701-41ed-a417-50b41c4b2381 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:45:55.723818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd1821-4701-41ed-a417-50b41c4b2381 service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:45:55.724104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd1821-4701-41ed-a417-50b41c4b2381 service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:45:55.724382 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd1821-4701-41ed-a417-50b41c4b2381 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:45:55.732877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd1821-4701-41ed-a417-50b41c4b2381 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:45:55.734461 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd1821-4701-41ed-a417-50b41c4b2381 service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:45:55.744183 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 759/1516] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:45:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:45:57.850022 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b151b-aaa6-4ecc-b74f-b0008a7bbb97 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:45:57.850596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b151b-aaa6-4ecc-b74f-b0008a7bbb97 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:45:57.850596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b151b-aaa6-4ecc-b74f-b0008a7bbb97 None None] PATH_INFO: `/v3` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:45:57.851937 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 758/1517] 10.222.0.81 () {54 vars in 925 bytes} [Tue Jul 19 20:45:57 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:45:57.861813 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63a71b-6ddd-4196-9a42-86ed33cdf2f5 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:45:57.862255 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63a71b-6ddd-4196-9a42-86ed33cdf2f5 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:45:57.862371 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63a71b-6ddd-4196-9a42-86ed33cdf2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:45:57.921118 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-fb63a71b-6ddd-4196-9a42-86ed33cdf2f5 None None] MFA Rules not processed for user `04843ec31eb84585944c7a2b9cd1c0cb`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:45:57.922336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-fb63a71b-6ddd-4196-9a42-86ed33cdf2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:45:57.939902 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:45:57.994778 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 760/1518] 10.222.0.81 () {58 vars in 1015 bytes} [Tue Jul 19 20:45:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:46:05.529609 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=56 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:07.006548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12a573-702d-4a0e-a3a6-d7ea37fc8206 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:07.007231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12a573-702d-4a0e-a3a6-d7ea37fc8206 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:07.007231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12a573-702d-4a0e-a3a6-d7ea37fc8206 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:07.008537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 759/1519] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 20:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:46:07.013773 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef5bd5-7fe3-47aa-be39-c42afba84eea None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:07.014219 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef5bd5-7fe3-47aa-be39-c42afba84eea None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:07.014320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef5bd5-7fe3-47aa-be39-c42afba84eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:07.032679 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-43ef5bd5-7fe3-47aa-be39-c42afba84eea None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:46:07.033874 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-43ef5bd5-7fe3-47aa-be39-c42afba84eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:46:07.042128 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 761/1520] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 20:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:46:07.205049 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12a573-702d-4a0e-a3a6-d7ea37fc8206 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:46:07.219318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12a573-702d-4a0e-a3a6-d7ea37fc8206 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:46:07.224875 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf8441-6065-4deb-9c93-4d22a8d0956c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:46:07.225513 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf8441-6065-4deb-9c93-4d22a8d0956c service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:07.225794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf8441-6065-4deb-9c93-4d22a8d0956c service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:07.226068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf8441-6065-4deb-9c93-4d22a8d0956c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:07.234518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf8441-6065-4deb-9c93-4d22a8d0956c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:46:07.236121 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf8441-6065-4deb-9c93-4d22a8d0956c service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:46:07.245613 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 760/1521] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:46:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:46:08.072401 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c64c83-1c1e-4772-ba87-3fb1b650cf21 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:08.072984 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c64c83-1c1e-4772-ba87-3fb1b650cf21 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:08.072984 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c64c83-1c1e-4772-ba87-3fb1b650cf21 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:08.074328 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 20:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:46:08.079214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574237b5-2a8f-4ff3-a451-5d5f616206d7 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:08.079703 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574237b5-2a8f-4ff3-a451-5d5f616206d7 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:08.079844 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574237b5-2a8f-4ff3-a451-5d5f616206d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:08.098466 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-574237b5-2a8f-4ff3-a451-5d5f616206d7 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:46:08.099717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-574237b5-2a8f-4ff3-a451-5d5f616206d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:46:08.108415 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 20:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:46:08.261305 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c64c83-1c1e-4772-ba87-3fb1b650cf21 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:46:08.276352 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c64c83-1c1e-4772-ba87-3fb1b650cf21 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:46:08.283702 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3444e-7501-4faf-9413-359092dbf68f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:46:08.284353 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3444e-7501-4faf-9413-359092dbf68f service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:08.284638 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3444e-7501-4faf-9413-359092dbf68f service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:08.284916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3444e-7501-4faf-9413-359092dbf68f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:08.294209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3444e-7501-4faf-9413-359092dbf68f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:46:08.295854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3444e-7501-4faf-9413-359092dbf68f service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:46:08.305698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 763/1524] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:46:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:46:09.793693 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5285-c19e-4778-9ffd-cc4831814fa2 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:09.794243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5285-c19e-4778-9ffd-cc4831814fa2 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:09.794243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5285-c19e-4778-9ffd-cc4831814fa2 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:09.795629 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 762/1525] 10.222.0.77 () {54 vars in 961 bytes} [Tue Jul 19 20:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:46:09.800760 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e075838-5514-422b-8788-3fce249eec48 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:09.801221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e075838-5514-422b-8788-3fce249eec48 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:09.801320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e075838-5514-422b-8788-3fce249eec48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:09.820091 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-4e075838-5514-422b-8788-3fce249eec48 None None] MFA Rules not processed for user `04843ec31eb84585944c7a2b9cd1c0cb`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:46:09.821312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-4e075838-5514-422b-8788-3fce249eec48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:46:09.830605 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 764/1526] 10.222.0.77 () {58 vars in 1058 bytes} [Tue Jul 19 20:46:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:46:09.838355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a5285-c19e-4778-9ffd-cc4831814fa2 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:46:09.852274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a5285-c19e-4778-9ffd-cc4831814fa2 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:46:09.857762 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06fcde-6778-4f9e-a858-254e32d3ee76 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04843ec31eb84585944c7a2b9cd1c0cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:46:09.858433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06fcde-6778-4f9e-a858-254e32d3ee76 service placement] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:09.858716 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06fcde-6778-4f9e-a858-254e32d3ee76 service placement] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:09.858990 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06fcde-6778-4f9e-a858-254e32d3ee76 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:09.867690 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06fcde-6778-4f9e-a858-254e32d3ee76 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:46:09.869289 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06fcde-6778-4f9e-a858-254e32d3ee76 service placement] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:46:09.879610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 763/1527] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:46:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:46:19.546402 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ea001-9cbb-4b50-9a41-bfb668cc92c7 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:19.546974 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ea001-9cbb-4b50-9a41-bfb668cc92c7 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:19.546974 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ea001-9cbb-4b50-9a41-bfb668cc92c7 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:19.548356 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 20:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:46:19.553125 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00556eab-c7c1-4a32-9846-199b8ef9cfbc None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:19.553540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00556eab-c7c1-4a32-9846-199b8ef9cfbc None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:19.553675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00556eab-c7c1-4a32-9846-199b8ef9cfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:19.571225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-00556eab-c7c1-4a32-9846-199b8ef9cfbc None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:46:19.572458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-00556eab-c7c1-4a32-9846-199b8ef9cfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:46:19.580858 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 20:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:46:19.735277 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ea001-9cbb-4b50-9a41-bfb668cc92c7 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:46:19.750112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ea001-9cbb-4b50-9a41-bfb668cc92c7 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:46:19.755683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2b389-b53e-49c8-9486-cfb022836dd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:46:19.756318 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2b389-b53e-49c8-9486-cfb022836dd8 service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:19.756595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2b389-b53e-49c8-9486-cfb022836dd8 service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:19.756865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2b389-b53e-49c8-9486-cfb022836dd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:19.765558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2b389-b53e-49c8-9486-cfb022836dd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:46:19.767301 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2b389-b53e-49c8-9486-cfb022836dd8 service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:46:19.776682 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 766/1530] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:46:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:46:20.592528 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73979b-370a-477d-ab0a-78d4ecea3004 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:20.593089 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73979b-370a-477d-ab0a-78d4ecea3004 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:20.593089 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73979b-370a-477d-ab0a-78d4ecea3004 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:20.594443 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 20:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:46:20.599199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378d0d2-048b-4066-b966-59972ba808ac None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:20.599642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378d0d2-048b-4066-b966-59972ba808ac None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:20.599798 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378d0d2-048b-4066-b966-59972ba808ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:20.619169 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-2378d0d2-048b-4066-b966-59972ba808ac None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:46:20.620415 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-2378d0d2-048b-4066-b966-59972ba808ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:46:20.630785 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 20:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:46:20.785274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73979b-370a-477d-ab0a-78d4ecea3004 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:46:20.800478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73979b-370a-477d-ab0a-78d4ecea3004 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:46:20.806141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80908d5-bb93-4575-95ba-61e47e65adbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:46:20.806774 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80908d5-bb93-4575-95ba-61e47e65adbf service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:20.807053 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80908d5-bb93-4575-95ba-61e47e65adbf service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:20.807353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80908d5-bb93-4575-95ba-61e47e65adbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:20.815618 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80908d5-bb93-4575-95ba-61e47e65adbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:46:20.817178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80908d5-bb93-4575-95ba-61e47e65adbf service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:46:20.826609 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 766/1533] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:46:25.092451 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0ce40-2018-4e25-8d60-f8d75d054ed3 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:25.093021 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0ce40-2018-4e25-8d60-f8d75d054ed3 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:25.093021 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0ce40-2018-4e25-8d60-f8d75d054ed3 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:25.094370 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 20:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:46:25.099939 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082479dc-c838-466c-bc6e-6c98da36f290 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:25.100425 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082479dc-c838-466c-bc6e-6c98da36f290 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:25.100539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082479dc-c838-466c-bc6e-6c98da36f290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:25.118214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-082479dc-c838-466c-bc6e-6c98da36f290 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:46:25.119450 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-082479dc-c838-466c-bc6e-6c98da36f290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:46:25.127818 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 20:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:46:25.204099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0ce40-2018-4e25-8d60-f8d75d054ed3 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:46:25.205843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-dfd0ce40-2018-4e25-8d60-f8d75d054ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:46:25.284752 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0ce40-2018-4e25-8d60-f8d75d054ed3 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:46:25.288629 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c16bf9-4f9b-448c-aa11-a5536f02b7bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:46:25.289281 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c16bf9-4f9b-448c-aa11-a5536f02b7bf service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:25.289556 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c16bf9-4f9b-448c-aa11-a5536f02b7bf service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:25.289826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c16bf9-4f9b-448c-aa11-a5536f02b7bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:25.299298 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c16bf9-4f9b-448c-aa11-a5536f02b7bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:46:25.300717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c16bf9-4f9b-448c-aa11-a5536f02b7bf service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:46:25.310856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 769/1536] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:46:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:46:27.400894 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5673b-eec9-4bed-8829-6f9f103636bc None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:27.401487 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5673b-eec9-4bed-8829-6f9f103636bc None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:27.401487 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5673b-eec9-4bed-8829-6f9f103636bc None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:27.402820 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 20:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:46:27.408193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c0717-28b0-406d-b8a4-5472959fd03b None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:27.408642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c0717-28b0-406d-b8a4-5472959fd03b None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:27.408754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c0717-28b0-406d-b8a4-5472959fd03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:27.428774 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-bd8c0717-28b0-406d-b8a4-5472959fd03b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:46:27.430054 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-bd8c0717-28b0-406d-b8a4-5472959fd03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:46:27.438488 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 20:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:46:27.477529 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5673b-eec9-4bed-8829-6f9f103636bc None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:46:27.479242 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-29f5673b-eec9-4bed-8829-6f9f103636bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:46:27.493357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5673b-eec9-4bed-8829-6f9f103636bc None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:46:27.497268 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980fddc-0688-499a-b2e3-1b4c577f2b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:46:27.497904 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980fddc-0688-499a-b2e3-1b4c577f2b66 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:27.498185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980fddc-0688-499a-b2e3-1b4c577f2b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:27.498455 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980fddc-0688-499a-b2e3-1b4c577f2b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:27.507597 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980fddc-0688-499a-b2e3-1b4c577f2b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:46:27.509028 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980fddc-0688-499a-b2e3-1b4c577f2b66 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:46:27.519004 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 769/1539] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:46:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:46:31.200538 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc46a59-2fa8-472a-9d00-120b5c4e297a None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:31.201092 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc46a59-2fa8-472a-9d00-120b5c4e297a None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:31.201092 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc46a59-2fa8-472a-9d00-120b5c4e297a None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:31.202371 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 771/1540] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 20:46:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:46:31.207443 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdede97b-583f-417e-9b7e-d09627ce2316 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:31.207858 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdede97b-583f-417e-9b7e-d09627ce2316 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:31.207984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdede97b-583f-417e-9b7e-d09627ce2316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:31.225470 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-cdede97b-583f-417e-9b7e-d09627ce2316 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:46:31.226640 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-cdede97b-583f-417e-9b7e-d09627ce2316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:46:31.234302 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 770/1541] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 20:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:46:31.538905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc46a59-2fa8-472a-9d00-120b5c4e297a None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:46:31.540637 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-ffc46a59-2fa8-472a-9d00-120b5c4e297a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:46:31.545179 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=83 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:31.622473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc46a59-2fa8-472a-9d00-120b5c4e297a None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:46:31.626277 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250fb69-fd75-4c5d-a12f-790887e8d695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:46:31.626923 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250fb69-fd75-4c5d-a12f-790887e8d695 service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:31.627211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250fb69-fd75-4c5d-a12f-790887e8d695 service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:31.627529 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250fb69-fd75-4c5d-a12f-790887e8d695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:31.638619 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250fb69-fd75-4c5d-a12f-790887e8d695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:46:31.640531 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250fb69-fd75-4c5d-a12f-790887e8d695 service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:46:31.652333 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 772/1542] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:46:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:46:33.676951 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90130fb2-1c30-4823-9023-61580b1ef4a9 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:33.677482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90130fb2-1c30-4823-9023-61580b1ef4a9 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:33.677482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90130fb2-1c30-4823-9023-61580b1ef4a9 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:33.678772 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 771/1543] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 20:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:46:33.684913 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82790e7e-a0c4-424c-a40b-ddf33895d8ba None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:33.685407 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82790e7e-a0c4-424c-a40b-ddf33895d8ba None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:33.685556 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82790e7e-a0c4-424c-a40b-ddf33895d8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:33.704337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-82790e7e-a0c4-424c-a40b-ddf33895d8ba None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:46:33.705527 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-82790e7e-a0c4-424c-a40b-ddf33895d8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:46:33.713375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 773/1544] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 20:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:46:34.015386 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90130fb2-1c30-4823-9023-61580b1ef4a9 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:46:34.017065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-90130fb2-1c30-4823-9023-61580b1ef4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:46:34.030531 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90130fb2-1c30-4823-9023-61580b1ef4a9 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:46:34.034048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458066a0-c4ce-4f7f-9106-d224b9ebbf18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:46:34.034679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458066a0-c4ce-4f7f-9106-d224b9ebbf18 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:46:34.034962 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458066a0-c4ce-4f7f-9106-d224b9ebbf18 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:46:34.035238 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458066a0-c4ce-4f7f-9106-d224b9ebbf18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:46:34.044722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458066a0-c4ce-4f7f-9106-d224b9ebbf18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:46:34.046133 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458066a0-c4ce-4f7f-9106-d224b9ebbf18 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:46:34.055494 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 772/1545] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:46:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:46:43.699932 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=37 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:46:44.051280 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=42 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:12.396458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736c631-29e8-4b0f-8a48-1b5d1aedc094 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:12.397732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736c631-29e8-4b0f-8a48-1b5d1aedc094 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:12.398253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736c631-29e8-4b0f-8a48-1b5d1aedc094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:12.433288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-a736c631-29e8-4b0f-8a48-1b5d1aedc094 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:12.434970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-a736c631-29e8-4b0f-8a48-1b5d1aedc094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:12.450791 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 774/1546] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:48:12.460174 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e08335-b3e7-40e2-bf94-29f60d33388c None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:12.460796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e08335-b3e7-40e2-bf94-29f60d33388c None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:12.460796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e08335-b3e7-40e2-bf94-29f60d33388c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:12.488621 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-99e08335-b3e7-40e2-bf94-29f60d33388c None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:12.489891 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-99e08335-b3e7-40e2-bf94-29f60d33388c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:12.505115 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 773/1547] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:12.510878 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736c631-29e8-4b0f-8a48-1b5d1aedc094 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:12.526953 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736c631-29e8-4b0f-8a48-1b5d1aedc094 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:12.535319 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5906242-e9a4-4ba5-93f1-935c7f64fe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:12.536665 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5906242-e9a4-4ba5-93f1-935c7f64fe4b admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:12.537185 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5906242-e9a4-4ba5-93f1-935c7f64fe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:12.537706 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5906242-e9a4-4ba5-93f1-935c7f64fe4b admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:12.538680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5906242-e9a4-4ba5-93f1-935c7f64fe4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:48:12.539214 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5906242-e9a4-4ba5-93f1-935c7f64fe4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:12.541136 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5906242-e9a4-4ba5-93f1-935c7f64fe4b admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:12.560494 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 775/1548] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:48:12.569473 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e08335-b3e7-40e2-bf94-29f60d33388c None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:12.585476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e08335-b3e7-40e2-bf94-29f60d33388c None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:12.594822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711dbf6-c97f-455e-86a3-e1047f8ab07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:12.597679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711dbf6-c97f-455e-86a3-e1047f8ab07b admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:12.597679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711dbf6-c97f-455e-86a3-e1047f8ab07b admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:12.597679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711dbf6-c97f-455e-86a3-e1047f8ab07b admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:12.597679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711dbf6-c97f-455e-86a3-e1047f8ab07b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:12.598654 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711dbf6-c97f-455e-86a3-e1047f8ab07b admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:12.659193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 774/1549] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:12 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:48:12.663414 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5906242-e9a4-4ba5-93f1-935c7f64fe4b admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:12.678349 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5906242-e9a4-4ba5-93f1-935c7f64fe4b admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:12.775543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be67d1-b5e9-461d-8b26-2e7045df7a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:12.777101 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be67d1-b5e9-461d-8b26-2e7045df7a98 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:12.777686 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be67d1-b5e9-461d-8b26-2e7045df7a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:12.779942 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be67d1-b5e9-461d-8b26-2e7045df7a98 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:12.780963 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be67d1-b5e9-461d-8b26-2e7045df7a98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:12.789905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be67d1-b5e9-461d-8b26-2e7045df7a98 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:12.791775 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902677e-0391-401d-a392-a1c306f8412a None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:12.792069 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902677e-0391-401d-a392-a1c306f8412a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:12.792352 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902677e-0391-401d-a392-a1c306f8412a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:12.818298 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 776/1550] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:12 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:12.820028 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88540f10-d585-4b85-aeb1-271a95bb066e None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:12.820553 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88540f10-d585-4b85-aeb1-271a95bb066e None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:12.821060 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88540f10-d585-4b85-aeb1-271a95bb066e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:12.841588 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-e902677e-0391-401d-a392-a1c306f8412a None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:12.847682 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e902677e-0391-401d-a392-a1c306f8412a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:12.855218 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-88540f10-d585-4b85-aeb1-271a95bb066e None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:12.856898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-88540f10-d585-4b85-aeb1-271a95bb066e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:12.872821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 777/1552] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:12.873039 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 775/1552] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:12.873793 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88540f10-d585-4b85-aeb1-271a95bb066e None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:12.874857 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dca49e-bf90-4506-97ba-9072211a980d None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:12.875286 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dca49e-bf90-4506-97ba-9072211a980d None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:12.875703 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dca49e-bf90-4506-97ba-9072211a980d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:12.896036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88540f10-d585-4b85-aeb1-271a95bb066e None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:12.904143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b59ce6-0d92-4260-b19b-de440c56ec00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:12.906046 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b59ce6-0d92-4260-b19b-de440c56ec00 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:12.906343 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b59ce6-0d92-4260-b19b-de440c56ec00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:12.906476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-42dca49e-bf90-4506-97ba-9072211a980d None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:12.906649 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b59ce6-0d92-4260-b19b-de440c56ec00 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:12.907423 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b59ce6-0d92-4260-b19b-de440c56ec00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:12.908428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-42dca49e-bf90-4506-97ba-9072211a980d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:12.909105 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b59ce6-0d92-4260-b19b-de440c56ec00 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:12.923236 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 776/1553] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:12.923457 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 778/1554] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:12.924838 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2ccd2-8427-46de-88be-90fcde04e229 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:12.925184 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2ccd2-8427-46de-88be-90fcde04e229 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:12.925483 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bb414-e763-4348-8591-5d1b42e2941f None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:12.925610 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2ccd2-8427-46de-88be-90fcde04e229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:12.925975 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bb414-e763-4348-8591-5d1b42e2941f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:12.926439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bb414-e763-4348-8591-5d1b42e2941f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:12.946937 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-f1d2ccd2-8427-46de-88be-90fcde04e229 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:12.948231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-f1d2ccd2-8427-46de-88be-90fcde04e229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:12.950497 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-0e4bb414-e763-4348-8591-5d1b42e2941f None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:12.951936 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-0e4bb414-e763-4348-8591-5d1b42e2941f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:12.957181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 779/1555] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:12.958524 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d84c4a-b63e-4a1e-9c98-0ffa6c74bcbf None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:12.958817 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d84c4a-b63e-4a1e-9c98-0ffa6c74bcbf None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:12.959094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d84c4a-b63e-4a1e-9c98-0ffa6c74bcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:12.961037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 777/1556] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:12.963633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac635c-5982-4ed7-b93d-d135ab6566f2 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:12.963949 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac635c-5982-4ed7-b93d-d135ab6566f2 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:12.964208 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac635c-5982-4ed7-b93d-d135ab6566f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:12.988799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-39d84c4a-b63e-4a1e-9c98-0ffa6c74bcbf None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:12.989400 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-0cac635c-5982-4ed7-b93d-d135ab6566f2 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:12.990023 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-39d84c4a-b63e-4a1e-9c98-0ffa6c74bcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:12.990607 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-0cac635c-5982-4ed7-b93d-d135ab6566f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:12.998698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 780/1557] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:12.999044 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 778/1558] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:13.000361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b021c-d8dc-4728-a799-40ff5aa579e8 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.000650 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b021c-d8dc-4728-a799-40ff5aa579e8 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.000931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b021c-d8dc-4728-a799-40ff5aa579e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.003665 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d84c4a-b63e-4a1e-9c98-0ffa6c74bcbf None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:13.018796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-e15b021c-d8dc-4728-a799-40ff5aa579e8 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:13.020046 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e15b021c-d8dc-4728-a799-40ff5aa579e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:13.023162 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d84c4a-b63e-4a1e-9c98-0ffa6c74bcbf None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:13.028781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 779/1559] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:13.028967 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10347f0-ed49-49fe-b154-49389973ac31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:13.029656 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10347f0-ed49-49fe-b154-49389973ac31 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.029945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10347f0-ed49-49fe-b154-49389973ac31 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.030061 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532f3de-25b3-4e8e-936a-b1b06386a419 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.030234 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10347f0-ed49-49fe-b154-49389973ac31 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.030336 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532f3de-25b3-4e8e-936a-b1b06386a419 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.030593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532f3de-25b3-4e8e-936a-b1b06386a419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.030964 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10347f0-ed49-49fe-b154-49389973ac31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:13.032731 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10347f0-ed49-49fe-b154-49389973ac31 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:13.044277 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 781/1560] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:13.045598 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2373dab-a02a-46a3-8598-061e5cd706d1 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.045893 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2373dab-a02a-46a3-8598-061e5cd706d1 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.046209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2373dab-a02a-46a3-8598-061e5cd706d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.052264 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-8532f3de-25b3-4e8e-936a-b1b06386a419 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:13.053481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-8532f3de-25b3-4e8e-936a-b1b06386a419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:13.061508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 780/1561] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:13.062793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f5843-08ee-496a-9dcb-703d8c96a605 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.063080 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f5843-08ee-496a-9dcb-703d8c96a605 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.063392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f5843-08ee-496a-9dcb-703d8c96a605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.066073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-e2373dab-a02a-46a3-8598-061e5cd706d1 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:13.067594 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e2373dab-a02a-46a3-8598-061e5cd706d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:13.077780 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 782/1562] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:13.082484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-2c5f5843-08ee-496a-9dcb-703d8c96a605 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:13.082721 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cbcc3-c07c-4da7-a1b0-8a2c2a118be5 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.083015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cbcc3-c07c-4da7-a1b0-8a2c2a118be5 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.083313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cbcc3-c07c-4da7-a1b0-8a2c2a118be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.083807 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-2c5f5843-08ee-496a-9dcb-703d8c96a605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:13.092536 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 781/1563] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:13.097473 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f5843-08ee-496a-9dcb-703d8c96a605 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:13.104257 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-ea4cbcc3-c07c-4da7-a1b0-8a2c2a118be5 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:13.105663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-ea4cbcc3-c07c-4da7-a1b0-8a2c2a118be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:13.111359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f5843-08ee-496a-9dcb-703d8c96a605 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:13.114075 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 783/1564] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:13.115030 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cbcc3-c07c-4da7-a1b0-8a2c2a118be5 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:13.116168 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc792b-e967-4fdd-a389-6b82754aef60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:13.116840 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc792b-e967-4fdd-a389-6b82754aef60 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.117129 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc792b-e967-4fdd-a389-6b82754aef60 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.117376 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc792b-e967-4fdd-a389-6b82754aef60 admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.118117 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc792b-e967-4fdd-a389-6b82754aef60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:48:13.118424 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc792b-e967-4fdd-a389-6b82754aef60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:13.119506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: WARNING py.warnings [None req-d2bc792b-e967-4fdd-a389-6b82754aef60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:48:13.119506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: warnings.warn(msg) Jul 19 20:48:13.119506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: Jul 19 20:48:13.120391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc792b-e967-4fdd-a389-6b82754aef60 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:13.125765 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cbcc3-c07c-4da7-a1b0-8a2c2a118be5 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:13.130643 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b41586-84a3-42ff-9be7-2566ab7b4278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:13.131371 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b41586-84a3-42ff-9be7-2566ab7b4278 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.131658 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b41586-84a3-42ff-9be7-2566ab7b4278 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.131926 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b41586-84a3-42ff-9be7-2566ab7b4278 admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.132690 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b41586-84a3-42ff-9be7-2566ab7b4278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:48:13.132977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b41586-84a3-42ff-9be7-2566ab7b4278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:13.133088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 782/1565] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:48:13.133927 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc792b-e967-4fdd-a389-6b82754aef60 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:13.137033 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b41586-84a3-42ff-9be7-2566ab7b4278 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:13.144452 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc792b-e967-4fdd-a389-6b82754aef60 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:13.149141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba011d55-7950-431d-8cae-808c2ff14e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:13.149813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba011d55-7950-431d-8cae-808c2ff14e27 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.149929 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 784/1566] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:48:13.150627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba011d55-7950-431d-8cae-808c2ff14e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.150910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba011d55-7950-431d-8cae-808c2ff14e27 admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.151386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b41586-84a3-42ff-9be7-2566ab7b4278 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:13.151688 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba011d55-7950-431d-8cae-808c2ff14e27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:48:13.152002 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba011d55-7950-431d-8cae-808c2ff14e27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:13.153618 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba011d55-7950-431d-8cae-808c2ff14e27 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:13.162392 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b41586-84a3-42ff-9be7-2566ab7b4278 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:13.171211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 783/1567] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:48:13.171211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211c0ba-e395-40e4-8594-f8ba26152e7d None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.171211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211c0ba-e395-40e4-8594-f8ba26152e7d None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.171211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211c0ba-e395-40e4-8594-f8ba26152e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.173011 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311a99e-8301-4929-b404-99c3e098fef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:13.174184 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311a99e-8301-4929-b404-99c3e098fef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.174322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311a99e-8301-4929-b404-99c3e098fef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.174538 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311a99e-8301-4929-b404-99c3e098fef2 admin admin] PATH_INFO: `/v3/projects/9a0f83826a964db4a4af40a95230c92c/users/16ae562d24ea478290604c7748af2a09/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.188596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-f211c0ba-e395-40e4-8594-f8ba26152e7d None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:13.189832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-f211c0ba-e395-40e4-8594-f8ba26152e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:13.191849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311a99e-8301-4929-b404-99c3e098fef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0f83826a964db4a4af40a95230c92c, user_id=16ae562d24ea478290604c7748af2a09, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:13.193029 dv-cinder-749155-8-smb devstack@keystone.service[92087]: WARNING py.warnings [None req-7311a99e-8301-4929-b404-99c3e098fef2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:48:13.193029 dv-cinder-749155-8-smb devstack@keystone.service[92087]: warnings.warn(msg) Jul 19 20:48:13.193029 dv-cinder-749155-8-smb devstack@keystone.service[92087]: Jul 19 20:48:13.194852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311a99e-8301-4929-b404-99c3e098fef2 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:13.198588 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 784/1568] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:13.200549 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211c0ba-e395-40e4-8594-f8ba26152e7d None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:13.210291 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211c0ba-e395-40e4-8594-f8ba26152e7d None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:13.210957 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 785/1569] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:13 2022] PUT /identity/v3/projects/9a0f83826a964db4a4af40a95230c92c/users/16ae562d24ea478290604c7748af2a09/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:13.212190 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311a99e-8301-4929-b404-99c3e098fef2 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:13.257852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:13.284809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311a99e-8301-4929-b404-99c3e098fef2 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:13.295741 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21047a0d-b959-423a-bd9e-818cdb955bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:13.296425 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21047a0d-b959-423a-bd9e-818cdb955bbe admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.296712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21047a0d-b959-423a-bd9e-818cdb955bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.296999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21047a0d-b959-423a-bd9e-818cdb955bbe admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.297733 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21047a0d-b959-423a-bd9e-818cdb955bbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:48:13.298038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21047a0d-b959-423a-bd9e-818cdb955bbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:13.298680 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53bfea-62c8-4b05-bcff-b24f544bd0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:13.299401 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53bfea-62c8-4b05-bcff-b24f544bd0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.299687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53bfea-62c8-4b05-bcff-b24f544bd0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.299867 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21047a0d-b959-423a-bd9e-818cdb955bbe admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:13.299979 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53bfea-62c8-4b05-bcff-b24f544bd0b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.300683 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53bfea-62c8-4b05-bcff-b24f544bd0b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:48:13.300994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53bfea-62c8-4b05-bcff-b24f544bd0b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:13.302669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53bfea-62c8-4b05-bcff-b24f544bd0b4 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:13.321737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 786/1570] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:48:13.321737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aab0ee-8a52-42c6-ab0d-57394fb21f84 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.321737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aab0ee-8a52-42c6-ab0d-57394fb21f84 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.321737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aab0ee-8a52-42c6-ab0d-57394fb21f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.327242 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 785/1571] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:48:13.328491 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53bfea-62c8-4b05-bcff-b24f544bd0b4 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:13.338942 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53bfea-62c8-4b05-bcff-b24f544bd0b4 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:13.342348 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-d3aab0ee-8a52-42c6-ab0d-57394fb21f84 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:13.343627 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-d3aab0ee-8a52-42c6-ab0d-57394fb21f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:13.343822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a4a63-ea5a-4025-87f1-587c69282a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:13.344491 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a4a63-ea5a-4025-87f1-587c69282a4f admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.344701 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a4a63-ea5a-4025-87f1-587c69282a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.344977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a4a63-ea5a-4025-87f1-587c69282a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.345670 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a4a63-ea5a-4025-87f1-587c69282a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:13.347603 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a4a63-ea5a-4025-87f1-587c69282a4f admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:13.352272 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 787/1572] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:13.353163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aab0ee-8a52-42c6-ab0d-57394fb21f84 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:13.363224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aab0ee-8a52-42c6-ab0d-57394fb21f84 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:13.369268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3262b9a-369e-4305-8e83-12e2736559a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:13.370270 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3262b9a-369e-4305-8e83-12e2736559a0 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.370661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3262b9a-369e-4305-8e83-12e2736559a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.371024 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3262b9a-369e-4305-8e83-12e2736559a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.372054 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3262b9a-369e-4305-8e83-12e2736559a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:13.373364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: WARNING py.warnings [None req-c3262b9a-369e-4305-8e83-12e2736559a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:48:13.373364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: warnings.warn(msg) Jul 19 20:48:13.373364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: Jul 19 20:48:13.375319 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3262b9a-369e-4305-8e83-12e2736559a0 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:13.383561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 786/1573] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:13 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:13.383561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a4a63-ea5a-4025-87f1-587c69282a4f admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:13.402563 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:13.409667 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 788/1574] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:13 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:13.409667 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3262b9a-369e-4305-8e83-12e2736559a0 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:13.459738 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a4a63-ea5a-4025-87f1-587c69282a4f admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:13.493714 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3262b9a-369e-4305-8e83-12e2736559a0 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:13.499111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21316f5-e303-48fe-b724-a5cd5e5ae098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:13.499827 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21316f5-e303-48fe-b724-a5cd5e5ae098 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.500116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21316f5-e303-48fe-b724-a5cd5e5ae098 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.500403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21316f5-e303-48fe-b724-a5cd5e5ae098 admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.501131 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21316f5-e303-48fe-b724-a5cd5e5ae098 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:48:13.501438 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21316f5-e303-48fe-b724-a5cd5e5ae098 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:13.503053 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21316f5-e303-48fe-b724-a5cd5e5ae098 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:13.515634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 789/1575] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:48:13.516991 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b785204-4a0d-49a9-815c-ae6f6bf2c060 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.517282 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b785204-4a0d-49a9-815c-ae6f6bf2c060 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.517566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b785204-4a0d-49a9-815c-ae6f6bf2c060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.526685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72323e1-f673-45df-8eee-dfeb0967a39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:13.527406 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72323e1-f673-45df-8eee-dfeb0967a39a admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.527692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72323e1-f673-45df-8eee-dfeb0967a39a admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.527972 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72323e1-f673-45df-8eee-dfeb0967a39a admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.528692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72323e1-f673-45df-8eee-dfeb0967a39a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:13.530607 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72323e1-f673-45df-8eee-dfeb0967a39a admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:13.546235 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-4b785204-4a0d-49a9-815c-ae6f6bf2c060 None None] MFA Rules not processed for user `16ae562d24ea478290604c7748af2a09`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:13.547745 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-4b785204-4a0d-49a9-815c-ae6f6bf2c060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:13.559327 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 787/1576] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:13 2022] POST /identity/v3/projects => generated 379 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:13.559886 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72323e1-f673-45df-8eee-dfeb0967a39a admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:13.628116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72323e1-f673-45df-8eee-dfeb0967a39a admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:13.633330 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba067d0-8a7e-4f50-95f3-642c9b152375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:13.634159 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba067d0-8a7e-4f50-95f3-642c9b152375 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.634513 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba067d0-8a7e-4f50-95f3-642c9b152375 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.634862 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba067d0-8a7e-4f50-95f3-642c9b152375 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.635640 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba067d0-8a7e-4f50-95f3-642c9b152375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:13.637883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba067d0-8a7e-4f50-95f3-642c9b152375 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:13.649685 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 790/1577] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:13.650442 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b785204-4a0d-49a9-815c-ae6f6bf2c060 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:13.662435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b785204-4a0d-49a9-815c-ae6f6bf2c060 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:13.674466 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 788/1578] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:13 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:13.675322 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba067d0-8a7e-4f50-95f3-642c9b152375 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:13.676446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0e59c-cdae-4527-acec-35482175288c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:13.677207 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0e59c-cdae-4527-acec-35482175288c admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.677603 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0e59c-cdae-4527-acec-35482175288c admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.677935 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0e59c-cdae-4527-acec-35482175288c admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.678846 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0e59c-cdae-4527-acec-35482175288c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:13.682537 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0e59c-cdae-4527-acec-35482175288c admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:13.712738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 791/1579] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:13 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:13.713581 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0e59c-cdae-4527-acec-35482175288c admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:13.721724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:13.727851 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:13.759024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba067d0-8a7e-4f50-95f3-642c9b152375 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:13.790499 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0e59c-cdae-4527-acec-35482175288c admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:13.795943 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43194bf-baab-47ab-980d-be8bf0d7730c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:13.796623 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43194bf-baab-47ab-980d-be8bf0d7730c admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.796908 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43194bf-baab-47ab-980d-be8bf0d7730c admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.797184 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43194bf-baab-47ab-980d-be8bf0d7730c admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.797879 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43194bf-baab-47ab-980d-be8bf0d7730c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:13.799923 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43194bf-baab-47ab-980d-be8bf0d7730c admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:13.821369 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 792/1580] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:13 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:13.822145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43194bf-baab-47ab-980d-be8bf0d7730c admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:13.832632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43194bf-baab-47ab-980d-be8bf0d7730c admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:13.836146 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cc6cf-0606-443a-ab6b-7cef8973ae5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:13.836825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cc6cf-0606-443a-ab6b-7cef8973ae5f admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.837121 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cc6cf-0606-443a-ab6b-7cef8973ae5f admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.837348 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadf2da-f72d-4196-b81c-2e17d2fa8f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:13.838010 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cc6cf-0606-443a-ab6b-7cef8973ae5f admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.838550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadf2da-f72d-4196-b81c-2e17d2fa8f94 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.838677 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cc6cf-0606-443a-ab6b-7cef8973ae5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:48:13.838835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadf2da-f72d-4196-b81c-2e17d2fa8f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.838945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cc6cf-0606-443a-ab6b-7cef8973ae5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:13.839116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadf2da-f72d-4196-b81c-2e17d2fa8f94 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.839849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadf2da-f72d-4196-b81c-2e17d2fa8f94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:13.840516 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cc6cf-0606-443a-ab6b-7cef8973ae5f admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:13.841798 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadf2da-f72d-4196-b81c-2e17d2fa8f94 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:13.854716 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 789/1581] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:48:13.855764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cc6cf-0606-443a-ab6b-7cef8973ae5f admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:13.864424 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 793/1582] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:13 2022] POST /identity/v3/users => generated 296 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:13.869331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadf2da-f72d-4196-b81c-2e17d2fa8f94 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:13.872647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cc6cf-0606-443a-ab6b-7cef8973ae5f admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:13.878190 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83168e48-1ed9-49d1-a56e-f621a0234c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:13.878860 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83168e48-1ed9-49d1-a56e-f621a0234c74 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.879140 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83168e48-1ed9-49d1-a56e-f621a0234c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.879400 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadf2da-f72d-4196-b81c-2e17d2fa8f94 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:13.879630 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83168e48-1ed9-49d1-a56e-f621a0234c74 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.880136 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83168e48-1ed9-49d1-a56e-f621a0234c74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:13.883388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83168e48-1ed9-49d1-a56e-f621a0234c74 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:13.885175 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12016817-f34b-4121-9e61-c7274a4da63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:13.885434 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12016817-f34b-4121-9e61-c7274a4da63d admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.886802 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12016817-f34b-4121-9e61-c7274a4da63d admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.887558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12016817-f34b-4121-9e61-c7274a4da63d admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.888404 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12016817-f34b-4121-9e61-c7274a4da63d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:13.890297 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12016817-f34b-4121-9e61-c7274a4da63d admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:13.912967 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 794/1583] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:13 2022] POST /identity/v3/users => generated 290 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:13.913781 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12016817-f34b-4121-9e61-c7274a4da63d admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:13.918675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 790/1584] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:13 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:13.918675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242b9b1-0c40-4c82-ab55-50be18c43117 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.918675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242b9b1-0c40-4c82-ab55-50be18c43117 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.918675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242b9b1-0c40-4c82-ab55-50be18c43117 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.919721 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 791/1585] 10.222.0.77 () {54 vars in 962 bytes} [Tue Jul 19 20:48:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:48:13.920644 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242b9b1-0c40-4c82-ab55-50be18c43117 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:13.925810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12016817-f34b-4121-9e61-c7274a4da63d admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:13.989105 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9da497-c8f8-42de-90d6-2ec83a25906d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:13.989711 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9da497-c8f8-42de-90d6-2ec83a25906d admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:13.989998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9da497-c8f8-42de-90d6-2ec83a25906d admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:13.990422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9da497-c8f8-42de-90d6-2ec83a25906d admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:13.991140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9da497-c8f8-42de-90d6-2ec83a25906d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:13.993136 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9da497-c8f8-42de-90d6-2ec83a25906d admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:13.999787 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242b9b1-0c40-4c82-ab55-50be18c43117 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.006538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1546d-0ec9-4e97-a8f8-ef61276d1d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.007883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1546d-0ec9-4e97-a8f8-ef61276d1d9a admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.008386 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1546d-0ec9-4e97-a8f8-ef61276d1d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.009129 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1546d-0ec9-4e97-a8f8-ef61276d1d9a admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.010301 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1546d-0ec9-4e97-a8f8-ef61276d1d9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.012121 dv-cinder-749155-8-smb devstack@keystone.service[92088]: WARNING py.warnings [None req-6ee1546d-0ec9-4e97-a8f8-ef61276d1d9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:48:14.012121 dv-cinder-749155-8-smb devstack@keystone.service[92088]: warnings.warn(msg) Jul 19 20:48:14.012121 dv-cinder-749155-8-smb devstack@keystone.service[92088]: Jul 19 20:48:14.013455 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1546d-0ec9-4e97-a8f8-ef61276d1d9a admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.016095 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 795/1586] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:13 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:14.016934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9da497-c8f8-42de-90d6-2ec83a25906d admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.039398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9da497-c8f8-42de-90d6-2ec83a25906d admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.046788 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 792/1587] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:13 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:14.046788 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1546d-0ec9-4e97-a8f8-ef61276d1d9a admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.047096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4138d6e-4b37-4783-a952-8893c3e6ddfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.047096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4138d6e-4b37-4783-a952-8893c3e6ddfe admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.047096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4138d6e-4b37-4783-a952-8893c3e6ddfe admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.047096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4138d6e-4b37-4783-a952-8893c3e6ddfe admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.047799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4138d6e-4b37-4783-a952-8893c3e6ddfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.048680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4138d6e-4b37-4783-a952-8893c3e6ddfe admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.056698 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1546d-0ec9-4e97-a8f8-ef61276d1d9a admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.059603 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 796/1588] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:14.060304 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4138d6e-4b37-4783-a952-8893c3e6ddfe admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.064460 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a756b8-9ee3-49af-a6ae-044b7044d764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.071998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a756b8-9ee3-49af-a6ae-044b7044d764 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.071998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a756b8-9ee3-49af-a6ae-044b7044d764 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.071998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a756b8-9ee3-49af-a6ae-044b7044d764 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.071998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a756b8-9ee3-49af-a6ae-044b7044d764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.071998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a756b8-9ee3-49af-a6ae-044b7044d764 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.072496 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4138d6e-4b37-4783-a952-8893c3e6ddfe admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.078944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6776ef-db1c-4505-a891-bcd0ad81dae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.079653 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6776ef-db1c-4505-a891-bcd0ad81dae1 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.079939 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6776ef-db1c-4505-a891-bcd0ad81dae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.080223 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6776ef-db1c-4505-a891-bcd0ad81dae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.080965 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6776ef-db1c-4505-a891-bcd0ad81dae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.082567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6776ef-db1c-4505-a891-bcd0ad81dae1 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.093993 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 797/1589] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:14.094858 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6776ef-db1c-4505-a891-bcd0ad81dae1 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.105826 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 793/1590] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:14 2022] POST /identity/v3/projects => generated 405 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:14.105826 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a756b8-9ee3-49af-a6ae-044b7044d764 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.106690 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6776ef-db1c-4505-a891-bcd0ad81dae1 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.131493 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:14.131976 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:14.182067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a8cd3-2a81-422c-97f3-6c00faa65562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.182743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a8cd3-2a81-422c-97f3-6c00faa65562 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.183027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a8cd3-2a81-422c-97f3-6c00faa65562 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.183363 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a8cd3-2a81-422c-97f3-6c00faa65562 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.184097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a8cd3-2a81-422c-97f3-6c00faa65562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.185706 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a8cd3-2a81-422c-97f3-6c00faa65562 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.188392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a756b8-9ee3-49af-a6ae-044b7044d764 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.193815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac6cd1-6a9a-4ad7-b83f-555b219aabbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.194494 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac6cd1-6a9a-4ad7-b83f-555b219aabbf admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.194769 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac6cd1-6a9a-4ad7-b83f-555b219aabbf admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.195039 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac6cd1-6a9a-4ad7-b83f-555b219aabbf admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.199808 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac6cd1-6a9a-4ad7-b83f-555b219aabbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.199974 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 798/1591] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:14.199974 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adfa63-8833-4b2b-8a3a-003f4138dd5d None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.199974 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adfa63-8833-4b2b-8a3a-003f4138dd5d None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.199974 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4adfa63-8833-4b2b-8a3a-003f4138dd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.200299 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac6cd1-6a9a-4ad7-b83f-555b219aabbf admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.223084 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 794/1592] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:14 2022] POST /identity/v3/users => generated 283 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:14.224394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac6cd1-6a9a-4ad7-b83f-555b219aabbf admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.234953 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac6cd1-6a9a-4ad7-b83f-555b219aabbf admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.240205 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb43484-77e1-4927-92ed-bfed2cba3c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.240821 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb43484-77e1-4927-92ed-bfed2cba3c90 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.241108 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb43484-77e1-4927-92ed-bfed2cba3c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.241386 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb43484-77e1-4927-92ed-bfed2cba3c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.242149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb43484-77e1-4927-92ed-bfed2cba3c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.243949 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb43484-77e1-4927-92ed-bfed2cba3c90 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.244862 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-e4adfa63-8833-4b2b-8a3a-003f4138dd5d None None] MFA Rules not processed for user `6dbbb8f7b3f2449fb9c64ca3815b6c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:14.246087 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e4adfa63-8833-4b2b-8a3a-003f4138dd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:14.257807 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 795/1593] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:14.257807 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb43484-77e1-4927-92ed-bfed2cba3c90 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.272860 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb43484-77e1-4927-92ed-bfed2cba3c90 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.279038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712d639-0b8a-4634-adc1-1899088b790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.279939 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712d639-0b8a-4634-adc1-1899088b790a admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.280226 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712d639-0b8a-4634-adc1-1899088b790a admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.280500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712d639-0b8a-4634-adc1-1899088b790a admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.281302 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712d639-0b8a-4634-adc1-1899088b790a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.282904 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712d639-0b8a-4634-adc1-1899088b790a admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.295472 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 796/1594] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:14.296418 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712d639-0b8a-4634-adc1-1899088b790a admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.307084 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712d639-0b8a-4634-adc1-1899088b790a admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.311935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fb214-7357-4cbd-8d53-33735d8650c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.312608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fb214-7357-4cbd-8d53-33735d8650c1 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.312889 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fb214-7357-4cbd-8d53-33735d8650c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.313166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fb214-7357-4cbd-8d53-33735d8650c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.313892 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9fb214-7357-4cbd-8d53-33735d8650c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.315535 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9fb214-7357-4cbd-8d53-33735d8650c1 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.326413 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 799/1595] 10.222.0.77 () {58 vars in 1059 bytes} [Tue Jul 19 20:48:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:14.327100 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4adfa63-8833-4b2b-8a3a-003f4138dd5d None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.338571 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 797/1596] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:14.338571 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fb214-7357-4cbd-8d53-33735d8650c1 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.339009 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4adfa63-8833-4b2b-8a3a-003f4138dd5d None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.343557 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7095dcc-c794-41e9-9595-b4030f8fb5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.344253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7095dcc-c794-41e9-9595-b4030f8fb5ab admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.344536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7095dcc-c794-41e9-9595-b4030f8fb5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.344813 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7095dcc-c794-41e9-9595-b4030f8fb5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.345607 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7095dcc-c794-41e9-9595-b4030f8fb5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.347221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7095dcc-c794-41e9-9595-b4030f8fb5ab admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.350342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fb214-7357-4cbd-8d53-33735d8650c1 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.356715 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c06353-6835-4334-8dd2-c1b8e8681a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.357908 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c06353-6835-4334-8dd2-c1b8e8681a48 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.358316 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c06353-6835-4334-8dd2-c1b8e8681a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.358598 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c06353-6835-4334-8dd2-c1b8e8681a48 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.358755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 800/1597] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:14.359602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7095dcc-c794-41e9-9595-b4030f8fb5ab admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.360829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c06353-6835-4334-8dd2-c1b8e8681a48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.363022 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c06353-6835-4334-8dd2-c1b8e8681a48 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.370870 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7095dcc-c794-41e9-9595-b4030f8fb5ab admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.377067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a2df8-e180-4203-9d14-30c32fcc8540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.377817 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a2df8-e180-4203-9d14-30c32fcc8540 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.378138 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a2df8-e180-4203-9d14-30c32fcc8540 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.378417 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a2df8-e180-4203-9d14-30c32fcc8540 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.379320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a2df8-e180-4203-9d14-30c32fcc8540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.381137 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a2df8-e180-4203-9d14-30c32fcc8540 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.388343 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 798/1598] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:14 2022] POST /identity/v3/users => generated 303 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:14.393006 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c06353-6835-4334-8dd2-c1b8e8681a48 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.403233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 801/1599] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:14.403233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a2df8-e180-4203-9d14-30c32fcc8540 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.403709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c06353-6835-4334-8dd2-c1b8e8681a48 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.406433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7ba2b-cce6-48b8-b0b4-680a12c99185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.407211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7ba2b-cce6-48b8-b0b4-680a12c99185 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.407722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7ba2b-cce6-48b8-b0b4-680a12c99185 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.408190 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7ba2b-cce6-48b8-b0b4-680a12c99185 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.408953 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7ba2b-cce6-48b8-b0b4-680a12c99185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.411315 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b7ba2b-cce6-48b8-b0b4-680a12c99185 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.413025 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a2df8-e180-4203-9d14-30c32fcc8540 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.418543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012263ac-2351-4203-b710-2f4fd4c14f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.419230 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012263ac-2351-4203-b710-2f4fd4c14f9f admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.419558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012263ac-2351-4203-b710-2f4fd4c14f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.419836 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012263ac-2351-4203-b710-2f4fd4c14f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.420576 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012263ac-2351-4203-b710-2f4fd4c14f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.422180 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012263ac-2351-4203-b710-2f4fd4c14f9f admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.431898 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 799/1600] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:14.433030 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7ba2b-cce6-48b8-b0b4-680a12c99185 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.435781 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 802/1601] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:14.436578 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012263ac-2351-4203-b710-2f4fd4c14f9f admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.444173 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7ba2b-cce6-48b8-b0b4-680a12c99185 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.448859 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d036c-6b82-41b0-a5f9-e79e503d4a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.449547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d036c-6b82-41b0-a5f9-e79e503d4a75 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.449809 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d036c-6b82-41b0-a5f9-e79e503d4a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.450082 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d036c-6b82-41b0-a5f9-e79e503d4a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.450526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012263ac-2351-4203-b710-2f4fd4c14f9f admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.450811 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d036c-6b82-41b0-a5f9-e79e503d4a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.452440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d036c-6b82-41b0-a5f9-e79e503d4a75 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.456246 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e92496-8e18-4294-9aa5-fa789bb01b71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.456907 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e92496-8e18-4294-9aa5-fa789bb01b71 service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.457197 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e92496-8e18-4294-9aa5-fa789bb01b71 service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.457475 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e92496-8e18-4294-9aa5-fa789bb01b71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.463963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 800/1602] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:14.464783 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d036c-6b82-41b0-a5f9-e79e503d4a75 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.477764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d036c-6b82-41b0-a5f9-e79e503d4a75 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.482991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57475f92-0284-4179-9d3f-78e02b29a984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.483916 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57475f92-0284-4179-9d3f-78e02b29a984 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.484192 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57475f92-0284-4179-9d3f-78e02b29a984 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.484464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57475f92-0284-4179-9d3f-78e02b29a984 admin admin] PATH_INFO: `/v3/projects/0c5d187681694964acac472e4a8d2314/users/107c862e60f2436b8d886aca6b9bc189/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.501981 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57475f92-0284-4179-9d3f-78e02b29a984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c5d187681694964acac472e4a8d2314, user_id=107c862e60f2436b8d886aca6b9bc189, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.502961 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57475f92-0284-4179-9d3f-78e02b29a984 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.521636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e92496-8e18-4294-9aa5-fa789bb01b71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.521944 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 801/1603] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:14 2022] PUT /identity/v3/projects/0c5d187681694964acac472e4a8d2314/users/107c862e60f2436b8d886aca6b9bc189/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:14.523787 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e92496-8e18-4294-9aa5-fa789bb01b71 service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.528733 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57475f92-0284-4179-9d3f-78e02b29a984 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.543243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 803/1604] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:14.544191 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e92496-8e18-4294-9aa5-fa789bb01b71 service nova] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.554637 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e92496-8e18-4294-9aa5-fa789bb01b71 service nova] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.558562 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:14.626170 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57475f92-0284-4179-9d3f-78e02b29a984 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.629028 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be8097-cf78-4798-9974-e6c1d39b61b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.629901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be8097-cf78-4798-9974-e6c1d39b61b6 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.630449 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be8097-cf78-4798-9974-e6c1d39b61b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.630860 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be8097-cf78-4798-9974-e6c1d39b61b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.631021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b5930-0e64-4faa-a432-bf0b9396c5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.631657 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be8097-cf78-4798-9974-e6c1d39b61b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.631906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b5930-0e64-4faa-a432-bf0b9396c5c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.632212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b5930-0e64-4faa-a432-bf0b9396c5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.632443 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b5930-0e64-4faa-a432-bf0b9396c5c9 admin admin] PATH_INFO: `/v3/projects/5c7878d5f9ac4b5980671793626f4d0d/users/c1a2b827eaad4e2784613fa4a54c2c44/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.634216 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be8097-cf78-4798-9974-e6c1d39b61b6 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.649463 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b5930-0e64-4faa-a432-bf0b9396c5c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7878d5f9ac4b5980671793626f4d0d, user_id=c1a2b827eaad4e2784613fa4a54c2c44, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.653652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 804/1605] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:14.653652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be8097-cf78-4798-9974-e6c1d39b61b6 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.653910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b5930-0e64-4faa-a432-bf0b9396c5c9 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.657475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:14.667552 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be8097-cf78-4798-9974-e6c1d39b61b6 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.687337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 802/1606] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:14 2022] PUT /identity/v3/projects/5c7878d5f9ac4b5980671793626f4d0d/users/c1a2b827eaad4e2784613fa4a54c2c44/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:14.687337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b5930-0e64-4faa-a432-bf0b9396c5c9 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.774657 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b5930-0e64-4faa-a432-bf0b9396c5c9 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.775514 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c7e12-9792-41bf-82ca-b182cb6f67df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.776830 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c7e12-9792-41bf-82ca-b182cb6f67df admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.777080 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c7e12-9792-41bf-82ca-b182cb6f67df admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.777439 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c7e12-9792-41bf-82ca-b182cb6f67df admin admin] PATH_INFO: `/v3/projects/6778b4968e9d4abaad68b475c910f443/users/ceb44c6507d844b5a2e2b3ccfa64bdd2/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.780763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a2519-d4f4-4061-afc8-b746e168882e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.781443 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a2519-d4f4-4061-afc8-b746e168882e admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.781746 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a2519-d4f4-4061-afc8-b746e168882e admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.782001 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a2519-d4f4-4061-afc8-b746e168882e admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.782765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a2519-d4f4-4061-afc8-b746e168882e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.784398 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a2519-d4f4-4061-afc8-b746e168882e admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.794406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c7e12-9792-41bf-82ca-b182cb6f67df admin admin] RBAC: Authorizing `identity:create_grant(project_id=6778b4968e9d4abaad68b475c910f443, user_id=ceb44c6507d844b5a2e2b3ccfa64bdd2, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.795786 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 803/1607] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:14.796597 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a2519-d4f4-4061-afc8-b746e168882e admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.797668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c7e12-9792-41bf-82ca-b182cb6f67df admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.808178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a2519-d4f4-4061-afc8-b746e168882e admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.813884 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 805/1608] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:14 2022] PUT /identity/v3/projects/6778b4968e9d4abaad68b475c910f443/users/ceb44c6507d844b5a2e2b3ccfa64bdd2/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:14.815217 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c7e12-9792-41bf-82ca-b182cb6f67df admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.876497 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268cc95-4536-4084-8e5a-e30b385d9fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.877812 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268cc95-4536-4084-8e5a-e30b385d9fba admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.878144 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268cc95-4536-4084-8e5a-e30b385d9fba admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.878429 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268cc95-4536-4084-8e5a-e30b385d9fba admin admin] PATH_INFO: `/v3/projects/63f961747cb04372a6b0c4e9947f1d6e/users/89b1a8c2998047efa0025277558149a1/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.895082 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268cc95-4536-4084-8e5a-e30b385d9fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f961747cb04372a6b0c4e9947f1d6e, user_id=89b1a8c2998047efa0025277558149a1, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.897773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268cc95-4536-4084-8e5a-e30b385d9fba admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.905202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c7e12-9792-41bf-82ca-b182cb6f67df admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:14.910291 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfad52-e9bd-4f38-8515-b795ea88b06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:14.911734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfad52-e9bd-4f38-8515-b795ea88b06b admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.912013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfad52-e9bd-4f38-8515-b795ea88b06b admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.912283 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfad52-e9bd-4f38-8515-b795ea88b06b admin admin] PATH_INFO: `/v3/projects/deb2e26326d8462197eb7b9bd9f34916/users/4e8c2119269a4b79a880b4adf78c1dec/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.914287 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 804/1609] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:14 2022] PUT /identity/v3/projects/63f961747cb04372a6b0c4e9947f1d6e/users/89b1a8c2998047efa0025277558149a1/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:14.926214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daf9b5-f084-4dba-9867-1425a5e7edec None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:14.926214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daf9b5-f084-4dba-9867-1425a5e7edec None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:14.926214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daf9b5-f084-4dba-9867-1425a5e7edec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:14.928966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfad52-e9bd-4f38-8515-b795ea88b06b admin admin] RBAC: Authorizing `identity:create_grant(project_id=deb2e26326d8462197eb7b9bd9f34916, user_id=4e8c2119269a4b79a880b4adf78c1dec, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:14.932515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfad52-e9bd-4f38-8515-b795ea88b06b admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:14.946716 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 806/1610] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:14 2022] PUT /identity/v3/projects/deb2e26326d8462197eb7b9bd9f34916/users/4e8c2119269a4b79a880b4adf78c1dec/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:14.947624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfad52-e9bd-4f38-8515-b795ea88b06b admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:14.952130 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-14daf9b5-f084-4dba-9867-1425a5e7edec None None] MFA Rules not processed for user `107c862e60f2436b8d886aca6b9bc189`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:14.953345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-14daf9b5-f084-4dba-9867-1425a5e7edec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:14.959180 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:15.013144 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfad52-e9bd-4f38-8515-b795ea88b06b admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:15.021314 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cfc56-11ba-4ae0-b82a-23b643449710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:15.021554 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 805/1611] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:15.022012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cfc56-11ba-4ae0-b82a-23b643449710 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:15.022303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cfc56-11ba-4ae0-b82a-23b643449710 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:15.022578 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cfc56-11ba-4ae0-b82a-23b643449710 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:15.023375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cfc56-11ba-4ae0-b82a-23b643449710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:15.024739 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f2590-ca36-4b4d-9f6c-a8e797d5e166 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:15.025076 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cfc56-11ba-4ae0-b82a-23b643449710 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:15.025204 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f2590-ca36-4b4d-9f6c-a8e797d5e166 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:15.025672 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f2590-ca36-4b4d-9f6c-a8e797d5e166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:15.037347 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 807/1612] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:15.037723 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:15.038743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df15069-65c7-491f-b234-675eefbe6e3f None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:15.039038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df15069-65c7-491f-b234-675eefbe6e3f None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:15.039499 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df15069-65c7-491f-b234-675eefbe6e3f None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:15.041658 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 808/1613] 10.222.0.77 () {54 vars in 912 bytes} [Tue Jul 19 20:48:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:48:15.042381 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df15069-65c7-491f-b234-675eefbe6e3f None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:15.059506 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df15069-65c7-491f-b234-675eefbe6e3f None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:15.059777 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-794f2590-ca36-4b4d-9f6c-a8e797d5e166 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:15.060979 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-794f2590-ca36-4b4d-9f6c-a8e797d5e166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:15.067392 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43ce9c-eece-461f-a408-c1d3f929d5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:15.068320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43ce9c-eece-461f-a408-c1d3f929d5ca admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:15.068603 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43ce9c-eece-461f-a408-c1d3f929d5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:15.068877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43ce9c-eece-461f-a408-c1d3f929d5ca admin admin] PATH_INFO: `/v3/projects/4e16ac974e1148bcb4703220a448e3bc/users/031645836ff8416e8e5c420a37be8a4a/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:15.069808 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 806/1614] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:15.071334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdbd94-cbe1-4bcb-8dcb-87a49bb845af None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:15.071626 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdbd94-cbe1-4bcb-8dcb-87a49bb845af None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:15.072473 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdbd94-cbe1-4bcb-8dcb-87a49bb845af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:15.090173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43ce9c-eece-461f-a408-c1d3f929d5ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e16ac974e1148bcb4703220a448e3bc, user_id=031645836ff8416e8e5c420a37be8a4a, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:15.092928 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43ce9c-eece-461f-a408-c1d3f929d5ca admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:15.094458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-cacdbd94-cbe1-4bcb-8dcb-87a49bb845af None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:15.095721 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-cacdbd94-cbe1-4bcb-8dcb-87a49bb845af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:15.105116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 807/1615] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:15.106142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f3b08-cffa-4102-8971-e4855cbfd474 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:15.106435 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f3b08-cffa-4102-8971-e4855cbfd474 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:15.106703 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f3b08-cffa-4102-8971-e4855cbfd474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:15.109058 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 809/1616] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:15 2022] PUT /identity/v3/projects/4e16ac974e1148bcb4703220a448e3bc/users/031645836ff8416e8e5c420a37be8a4a/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:15.110445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf687a-16e2-4936-b1db-a5b505edfc65 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:15.110754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf687a-16e2-4936-b1db-a5b505edfc65 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:15.111014 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf687a-16e2-4936-b1db-a5b505edfc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:15.130438 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-43bf687a-16e2-4936-b1db-a5b505edfc65 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:15.131613 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-43bf687a-16e2-4936-b1db-a5b505edfc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:15.143869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-555f3b08-cffa-4102-8971-e4855cbfd474 None None] MFA Rules not processed for user `89b1a8c2998047efa0025277558149a1`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:15.145179 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-555f3b08-cffa-4102-8971-e4855cbfd474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:15.199613 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 810/1617] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:15.200288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf687a-16e2-4936-b1db-a5b505edfc65 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:15.212306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf687a-16e2-4936-b1db-a5b505edfc65 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:15.217678 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8ab1f-318c-4cd6-916a-1f4db114f346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:15.218336 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 808/1618] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:15.219540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8ab1f-318c-4cd6-916a-1f4db114f346 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:15.219680 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa18130-9319-4e83-9812-31d04c0d171d None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:15.219851 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8ab1f-318c-4cd6-916a-1f4db114f346 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:15.219991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa18130-9319-4e83-9812-31d04c0d171d None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:15.220167 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8ab1f-318c-4cd6-916a-1f4db114f346 admin admin] PATH_INFO: `/v3/projects/a9a128610eeb44ff9ff37e14c54b654d/users/9ac645a9dd604d27814fd3b16bf4a2c4/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:15.220287 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa18130-9319-4e83-9812-31d04c0d171d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:15.239172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8ab1f-318c-4cd6-916a-1f4db114f346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a128610eeb44ff9ff37e14c54b654d, user_id=9ac645a9dd604d27814fd3b16bf4a2c4, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:15.240334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-eaa18130-9319-4e83-9812-31d04c0d171d None None] MFA Rules not processed for user `6dbbb8f7b3f2449fb9c64ca3815b6c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:15.241528 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-eaa18130-9319-4e83-9812-31d04c0d171d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:15.241948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c8ab1f-318c-4cd6-916a-1f4db114f346 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:15.256383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 811/1619] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:15 2022] PUT /identity/v3/projects/a9a128610eeb44ff9ff37e14c54b654d/users/9ac645a9dd604d27814fd3b16bf4a2c4/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:15.258200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f8075-e0c4-4f99-9b21-9116929d03f7 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:15.258655 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f8075-e0c4-4f99-9b21-9116929d03f7 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:15.258940 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f8075-e0c4-4f99-9b21-9116929d03f7 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:15.261185 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 812/1620] 10.222.0.77 () {54 vars in 962 bytes} [Tue Jul 19 20:48:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:48:15.261977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f8075-e0c4-4f99-9b21-9116929d03f7 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:15.316171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 809/1621] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jul 19 20:48:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:15.317019 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa18130-9319-4e83-9812-31d04c0d171d None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:15.318956 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f8075-e0c4-4f99-9b21-9116929d03f7 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:15.324439 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b3858-54e0-4e02-8f14-fe555baec239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:15.325072 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b3858-54e0-4e02-8f14-fe555baec239 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:15.325348 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b3858-54e0-4e02-8f14-fe555baec239 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:15.325624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b3858-54e0-4e02-8f14-fe555baec239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:15.336828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:15.373741 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa18130-9319-4e83-9812-31d04c0d171d None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:15.377398 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70934dd8-d9a0-496b-b520-4d10996ae724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:15.378052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70934dd8-d9a0-496b-b520-4d10996ae724 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:15.378339 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70934dd8-d9a0-496b-b520-4d10996ae724 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:15.378618 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70934dd8-d9a0-496b-b520-4d10996ae724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:15.390481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b3858-54e0-4e02-8f14-fe555baec239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:15.392099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b3858-54e0-4e02-8f14-fe555baec239 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:15.402500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 813/1622] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:15.403842 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb292530-8e80-4e80-9660-434f89cb7b6b None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:15.404139 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb292530-8e80-4e80-9660-434f89cb7b6b None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:15.404709 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb292530-8e80-4e80-9660-434f89cb7b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:15.406843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:15.436857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-eb292530-8e80-4e80-9660-434f89cb7b6b None None] MFA Rules not processed for user `031645836ff8416e8e5c420a37be8a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:15.438600 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-eb292530-8e80-4e80-9660-434f89cb7b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:15.448409 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70934dd8-d9a0-496b-b520-4d10996ae724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:15.450384 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70934dd8-d9a0-496b-b520-4d10996ae724 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:15.460312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 810/1623] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:15.461504 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70934dd8-d9a0-496b-b520-4d10996ae724 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:15.470155 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70934dd8-d9a0-496b-b520-4d10996ae724 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:15.476890 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e149c9-8c23-462e-9cf9-be26fdba4fa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:15.477748 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e149c9-8c23-462e-9cf9-be26fdba4fa4 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:15.478055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e149c9-8c23-462e-9cf9-be26fdba4fa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:15.478743 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e149c9-8c23-462e-9cf9-be26fdba4fa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:15.489334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e149c9-8c23-462e-9cf9-be26fdba4fa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:15.491034 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e149c9-8c23-462e-9cf9-be26fdba4fa4 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:15.502007 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 811/1624] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:15.503471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c5840-216e-4e74-a789-68527ab7b546 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:15.503782 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c5840-216e-4e74-a789-68527ab7b546 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:15.504041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c5840-216e-4e74-a789-68527ab7b546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:15.521118 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 814/1625] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:15 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:15.522348 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1656f-4a52-40e4-b502-77b9fcc94aef None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:15.522487 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-308c5840-216e-4e74-a789-68527ab7b546 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:15.522708 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1656f-4a52-40e4-b502-77b9fcc94aef None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:15.522919 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1656f-4a52-40e4-b502-77b9fcc94aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:15.523746 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-308c5840-216e-4e74-a789-68527ab7b546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:15.537530 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 812/1626] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:15.537530 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c5840-216e-4e74-a789-68527ab7b546 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:15.543566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-ebf1656f-4a52-40e4-b502-77b9fcc94aef None None] MFA Rules not processed for user `6dbbb8f7b3f2449fb9c64ca3815b6c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:15.544778 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-ebf1656f-4a52-40e4-b502-77b9fcc94aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:15.615289 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c5840-216e-4e74-a789-68527ab7b546 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:15.619994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04fc45-9063-43b1-a994-cf610ebd2266 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:15.620880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04fc45-9063-43b1-a994-cf610ebd2266 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:15.621178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04fc45-9063-43b1-a994-cf610ebd2266 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:15.621457 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04fc45-9063-43b1-a994-cf610ebd2266 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:15.646790 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 815/1627] 10.222.0.77 () {58 vars in 1059 bytes} [Tue Jul 19 20:48:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:15.654992 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1656f-4a52-40e4-b502-77b9fcc94aef None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:15.666426 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1656f-4a52-40e4-b502-77b9fcc94aef None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:15.670867 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c8f81-8fe7-4532-a213-7c44656f83f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:15.671775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c8f81-8fe7-4532-a213-7c44656f83f6 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:15.672273 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c8f81-8fe7-4532-a213-7c44656f83f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:15.672557 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c8f81-8fe7-4532-a213-7c44656f83f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:15.684291 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c8f81-8fe7-4532-a213-7c44656f83f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:15.685740 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c8f81-8fe7-4532-a213-7c44656f83f6 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:15.698871 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 816/1628] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:15.701074 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c8f81-8fe7-4532-a213-7c44656f83f6 service neutron] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:15.715816 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c8f81-8fe7-4532-a213-7c44656f83f6 service neutron] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:15.720665 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04fc45-9063-43b1-a994-cf610ebd2266 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:15.722349 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b180ef-fdd6-4f2b-936b-fcf1894a5712 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:15.722717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04fc45-9063-43b1-a994-cf610ebd2266 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:15.724011 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b180ef-fdd6-4f2b-936b-fcf1894a5712 service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:15.724480 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b180ef-fdd6-4f2b-936b-fcf1894a5712 service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:15.725099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b180ef-fdd6-4f2b-936b-fcf1894a5712 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:15.740658 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b180ef-fdd6-4f2b-936b-fcf1894a5712 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:15.742044 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 813/1629] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:15.742610 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b180ef-fdd6-4f2b-936b-fcf1894a5712 service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:15.743220 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04fc45-9063-43b1-a994-cf610ebd2266 service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:15.756966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 817/1630] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:15.759646 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04fc45-9063-43b1-a994-cf610ebd2266 service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:15.766653 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d33e04-333d-4344-96c1-d549039ce49e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:15.767426 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d33e04-333d-4344-96c1-d549039ce49e service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:15.767699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d33e04-333d-4344-96c1-d549039ce49e service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:15.767984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d33e04-333d-4344-96c1-d549039ce49e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:15.846831 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:15.867469 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d33e04-333d-4344-96c1-d549039ce49e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:15.869737 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d33e04-333d-4344-96c1-d549039ce49e service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:15.896900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 814/1631] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:16.280358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b180ef-fdd6-4f2b-936b-fcf1894a5712 service cinder] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:16.288429 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:16.297620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b180ef-fdd6-4f2b-936b-fcf1894a5712 service cinder] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:16.305105 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3644ae-dce0-4fae-967a-e609b43beaad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:16.306065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3644ae-dce0-4fae-967a-e609b43beaad service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:16.306539 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3644ae-dce0-4fae-967a-e609b43beaad service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:16.307086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3644ae-dce0-4fae-967a-e609b43beaad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:16.434651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3644ae-dce0-4fae-967a-e609b43beaad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:16.437041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3644ae-dce0-4fae-967a-e609b43beaad service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:16.463278 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 818/1632] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:16.538046 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c5501-e4c8-42eb-8aa5-739fe1c46eb1 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:16.538582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c5501-e4c8-42eb-8aa5-739fe1c46eb1 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:16.538582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c5501-e4c8-42eb-8aa5-739fe1c46eb1 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:16.540011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 815/1633] 10.222.0.77 () {54 vars in 912 bytes} [Tue Jul 19 20:48:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:48:16.545889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea5d0c-d5df-4d76-865a-a9fdcc170c83 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:16.546120 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea5d0c-d5df-4d76-865a-a9fdcc170c83 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:16.546403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea5d0c-d5df-4d76-865a-a9fdcc170c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:16.570056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-b6ea5d0c-d5df-4d76-865a-a9fdcc170c83 None None] MFA Rules not processed for user `6dbbb8f7b3f2449fb9c64ca3815b6c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:16.571295 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b6ea5d0c-d5df-4d76-865a-a9fdcc170c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:16.590434 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 819/1634] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jul 19 20:48:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:16.618791 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c5501-e4c8-42eb-8aa5-739fe1c46eb1 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:16.632395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8c5501-e4c8-42eb-8aa5-739fe1c46eb1 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:16.637833 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47d466-23f0-46ce-8e31-2c191172cf1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:16.638487 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47d466-23f0-46ce-8e31-2c191172cf1c service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:16.638773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47d466-23f0-46ce-8e31-2c191172cf1c service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:16.639052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47d466-23f0-46ce-8e31-2c191172cf1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:16.654434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47d466-23f0-46ce-8e31-2c191172cf1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:16.656563 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47d466-23f0-46ce-8e31-2c191172cf1c service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:16.676385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 816/1635] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:17.109342 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034c225-54b2-4003-b0fc-5e323edf5588 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:17.110532 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034c225-54b2-4003-b0fc-5e323edf5588 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:17.111102 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034c225-54b2-4003-b0fc-5e323edf5588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:17.172133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-7034c225-54b2-4003-b0fc-5e323edf5588 None None] MFA Rules not processed for user `9ac645a9dd604d27814fd3b16bf4a2c4`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:17.175739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-7034c225-54b2-4003-b0fc-5e323edf5588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:17.377391 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 820/1636] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:17.382849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47d466-23f0-46ce-8e31-2c191172cf1c service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:17.410312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47d466-23f0-46ce-8e31-2c191172cf1c service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:17.433548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544f7b5-47ac-4d95-a4e2-f978f303f851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:17.435901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544f7b5-47ac-4d95-a4e2-f978f303f851 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:17.436467 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544f7b5-47ac-4d95-a4e2-f978f303f851 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:17.436757 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544f7b5-47ac-4d95-a4e2-f978f303f851 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:17.437785 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544f7b5-47ac-4d95-a4e2-f978f303f851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:17.444051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544f7b5-47ac-4d95-a4e2-f978f303f851 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:17.496138 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 817/1637] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:17 2022] POST /identity/v3/projects => generated 405 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:17.500903 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034c225-54b2-4003-b0fc-5e323edf5588 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:17.516305 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034c225-54b2-4003-b0fc-5e323edf5588 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:17.613996 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476da3b5-1a4b-40c1-96bc-8a4a322d50cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:17.614177 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476da3b5-1a4b-40c1-96bc-8a4a322d50cf admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:17.614399 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476da3b5-1a4b-40c1-96bc-8a4a322d50cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:17.615207 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476da3b5-1a4b-40c1-96bc-8a4a322d50cf admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:17.615689 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476da3b5-1a4b-40c1-96bc-8a4a322d50cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:17.618044 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476da3b5-1a4b-40c1-96bc-8a4a322d50cf admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:17.647999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 821/1638] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:17 2022] POST /identity/v3/users => generated 309 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:17.652024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544f7b5-47ac-4d95-a4e2-f978f303f851 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:17.695453 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544f7b5-47ac-4d95-a4e2-f978f303f851 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:17.703230 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa623507-11f8-4025-b8e4-222785ad5020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:17.704088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa623507-11f8-4025-b8e4-222785ad5020 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:17.704393 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa623507-11f8-4025-b8e4-222785ad5020 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:17.706091 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa623507-11f8-4025-b8e4-222785ad5020 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:17.708195 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa623507-11f8-4025-b8e4-222785ad5020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:17.710903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa623507-11f8-4025-b8e4-222785ad5020 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:17.732518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 818/1639] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:48:17.737326 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476da3b5-1a4b-40c1-96bc-8a4a322d50cf admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:17.754035 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476da3b5-1a4b-40c1-96bc-8a4a322d50cf admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:17.766829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa623507-11f8-4025-b8e4-222785ad5020 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:17.768842 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b127ef-cd7b-43ae-baeb-0add58692fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:17.769779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b127ef-cd7b-43ae-baeb-0add58692fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:17.770068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b127ef-cd7b-43ae-baeb-0add58692fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:17.770347 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b127ef-cd7b-43ae-baeb-0add58692fa1 admin admin] PATH_INFO: `/v3/projects/16664960592647fabf5eb63daa8d763c/users/1d2d929c51c5435891e6614acc095d97/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:17.796771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa623507-11f8-4025-b8e4-222785ad5020 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:17.837807 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd307a1f-6f6c-4034-962b-6a138cafee0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:17.848802 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd307a1f-6f6c-4034-962b-6a138cafee0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:17.849182 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd307a1f-6f6c-4034-962b-6a138cafee0f admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:17.849586 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd307a1f-6f6c-4034-962b-6a138cafee0f admin admin] PATH_INFO: `/v3/users/107c862e60f2436b8d886aca6b9bc189` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:17.851436 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:17.862834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd307a1f-6f6c-4034-962b-6a138cafee0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=107c862e60f2436b8d886aca6b9bc189)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:17.874232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd307a1f-6f6c-4034-962b-6a138cafee0f admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:17.875489 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b127ef-cd7b-43ae-baeb-0add58692fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16664960592647fabf5eb63daa8d763c, user_id=1d2d929c51c5435891e6614acc095d97, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:17.896728 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b127ef-cd7b-43ae-baeb-0add58692fa1 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:17.961679 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 822/1640] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:17 2022] PUT /identity/v3/projects/16664960592647fabf5eb63daa8d763c/users/1d2d929c51c5435891e6614acc095d97/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:17.968484 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b127ef-cd7b-43ae-baeb-0add58692fa1 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:18.032958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-cd307a1f-6f6c-4034-962b-6a138cafee0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '107c862e60f2436b8d886aca6b9bc189'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:18.051638 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-cd307a1f-6f6c-4034-962b-6a138cafee0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '107c862e60f2436b8d886aca6b9bc189'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:18.078222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-cd307a1f-6f6c-4034-962b-6a138cafee0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '107c862e60f2436b8d886aca6b9bc189'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:18.094124 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-cd307a1f-6f6c-4034-962b-6a138cafee0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '107c862e60f2436b8d886aca6b9bc189'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:18.094778 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-cd307a1f-6f6c-4034-962b-6a138cafee0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '107c862e60f2436b8d886aca6b9bc189'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:18.106670 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 819/1641] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:48:17 2022] DELETE /identity/v3/users/107c862e60f2436b8d886aca6b9bc189 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:48:18.116028 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d15b9e-1a3b-4c61-ac26-db1a41c49c9b None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:18.116813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d15b9e-1a3b-4c61-ac26-db1a41c49c9b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:18.117341 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d15b9e-1a3b-4c61-ac26-db1a41c49c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:18.171499 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-f4d15b9e-1a3b-4c61-ac26-db1a41c49c9b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:18.172887 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-f4d15b9e-1a3b-4c61-ac26-db1a41c49c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:18.177589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b127ef-cd7b-43ae-baeb-0add58692fa1 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:18.291736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 820/1642] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:18.297838 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc445c0-b81f-402f-b56c-4c4cf9be5323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:18.298777 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc445c0-b81f-402f-b56c-4c4cf9be5323 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:18.299143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc445c0-b81f-402f-b56c-4c4cf9be5323 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:18.299520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc445c0-b81f-402f-b56c-4c4cf9be5323 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:18.300612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc445c0-b81f-402f-b56c-4c4cf9be5323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:18.302733 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc445c0-b81f-402f-b56c-4c4cf9be5323 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:18.316314 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 823/1643] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:18.320514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d15b9e-1a3b-4c61-ac26-db1a41c49c9b None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:18.324994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-f4d15b9e-1a3b-4c61-ac26-db1a41c49c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:18.334645 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc445c0-b81f-402f-b56c-4c4cf9be5323 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:18.336802 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-afc445c0-b81f-402f-b56c-4c4cf9be5323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:18.359490 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d15b9e-1a3b-4c61-ac26-db1a41c49c9b None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:18.384237 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8e101-fd26-4759-9a59-dd6f9b891488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:18.385702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8e101-fd26-4759-9a59-dd6f9b891488 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:18.386034 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8e101-fd26-4759-9a59-dd6f9b891488 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:18.386313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8e101-fd26-4759-9a59-dd6f9b891488 admin admin] PATH_INFO: `/v3/projects/16664960592647fabf5eb63daa8d763c/users/1d2d929c51c5435891e6614acc095d97/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:18.411290 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc445c0-b81f-402f-b56c-4c4cf9be5323 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:18.415885 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd9dea-8962-4329-a1d3-e4745a79f0d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:18.417145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd9dea-8962-4329-a1d3-e4745a79f0d8 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:18.417145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd9dea-8962-4329-a1d3-e4745a79f0d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:18.417371 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8e101-fd26-4759-9a59-dd6f9b891488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16664960592647fabf5eb63daa8d763c, user_id=1d2d929c51c5435891e6614acc095d97, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:18.417470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd9dea-8962-4329-a1d3-e4745a79f0d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:18.429478 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd9dea-8962-4329-a1d3-e4745a79f0d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:18.432424 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebd9dea-8962-4329-a1d3-e4745a79f0d8 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:18.432878 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8e101-fd26-4759-9a59-dd6f9b891488 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:18.444943 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 824/1644] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:48:18.445799 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:18.492157 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 821/1645] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:18 2022] PUT /identity/v3/projects/16664960592647fabf5eb63daa8d763c/users/1d2d929c51c5435891e6614acc095d97/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:19.766601 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd9dea-8962-4329-a1d3-e4745a79f0d8 service neutron] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:19.767807 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-1ebd9dea-8962-4329-a1d3-e4745a79f0d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:19.789225 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd9dea-8962-4329-a1d3-e4745a79f0d8 service neutron] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:19.878140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:19.937691 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa68098-d48f-40a2-9e6c-847855fcc909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:19.938780 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa68098-d48f-40a2-9e6c-847855fcc909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:19.939075 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa68098-d48f-40a2-9e6c-847855fcc909 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:19.939402 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa68098-d48f-40a2-9e6c-847855fcc909 admin admin] PATH_INFO: `/v3/projects/0c5d187681694964acac472e4a8d2314` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:19.940707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa68098-d48f-40a2-9e6c-847855fcc909 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c5d187681694964acac472e4a8d2314)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:19.942651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa68098-d48f-40a2-9e6c-847855fcc909 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:20.011543 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8e101-fd26-4759-9a59-dd6f9b891488 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:20.013529 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-6aa8e101-fd26-4759-9a59-dd6f9b891488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:20.061173 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8e101-fd26-4759-9a59-dd6f9b891488 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:20.139794 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-eaa68098-d48f-40a2-9e6c-847855fcc909 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c5d187681694964acac472e4a8d2314', 'request_id': 'req-eaa68098-d48f-40a2-9e6c-847855fcc909'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:20.166670 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-eaa68098-d48f-40a2-9e6c-847855fcc909 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c5d187681694964acac472e4a8d2314', 'request_id': 'req-eaa68098-d48f-40a2-9e6c-847855fcc909'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:20.175759 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-eaa68098-d48f-40a2-9e6c-847855fcc909 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c5d187681694964acac472e4a8d2314', 'request_id': 'req-eaa68098-d48f-40a2-9e6c-847855fcc909'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:20.241751 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-eaa68098-d48f-40a2-9e6c-847855fcc909 admin admin] The token cache is being invalidate because project 0c5d187681694964acac472e4a8d2314 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:48:20.242055 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-eaa68098-d48f-40a2-9e6c-847855fcc909 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:20.244780 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-eaa68098-d48f-40a2-9e6c-847855fcc909 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:20.247753 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 825/1646] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:48:19 2022] DELETE /identity/v3/projects/0c5d187681694964acac472e4a8d2314 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:20.253455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10939180-9fc7-4d0d-a78d-93bccfda6d0c None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:20.253838 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10939180-9fc7-4d0d-a78d-93bccfda6d0c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:20.254323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10939180-9fc7-4d0d-a78d-93bccfda6d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:20.294761 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82d6df-2bb4-45ca-a64c-3c97e3bcd0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:20.298353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82d6df-2bb4-45ca-a64c-3c97e3bcd0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:20.298482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82d6df-2bb4-45ca-a64c-3c97e3bcd0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:20.298683 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82d6df-2bb4-45ca-a64c-3c97e3bcd0b3 admin admin] PATH_INFO: `/v3/users/89b1a8c2998047efa0025277558149a1` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:20.304126 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82d6df-2bb4-45ca-a64c-3c97e3bcd0b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b1a8c2998047efa0025277558149a1)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:20.306063 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-10939180-9fc7-4d0d-a78d-93bccfda6d0c None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:20.307530 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82d6df-2bb4-45ca-a64c-3c97e3bcd0b3 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:20.311386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-10939180-9fc7-4d0d-a78d-93bccfda6d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:20.345873 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 826/1647] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:48:20.357219 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0fe1a-257f-4913-b8f1-dbee28c5a1c7 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:20.359621 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0fe1a-257f-4913-b8f1-dbee28c5a1c7 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:20.360076 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0fe1a-257f-4913-b8f1-dbee28c5a1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:20.435329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2b82d6df-2bb4-45ca-a64c-3c97e3bcd0b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b1a8c2998047efa0025277558149a1'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:20.440335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-50f0fe1a-257f-4913-b8f1-dbee28c5a1c7 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:20.443834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-50f0fe1a-257f-4913-b8f1-dbee28c5a1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:20.448585 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2b82d6df-2bb4-45ca-a64c-3c97e3bcd0b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b1a8c2998047efa0025277558149a1'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:20.478828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 827/1648] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:20.480622 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0fe1a-257f-4913-b8f1-dbee28c5a1c7 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:20.496265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2b82d6df-2bb4-45ca-a64c-3c97e3bcd0b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b1a8c2998047efa0025277558149a1'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:20.501782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0fe1a-257f-4913-b8f1-dbee28c5a1c7 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:20.515839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64699e8-8f0f-4a0f-a075-db352b4198e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:20.517331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64699e8-8f0f-4a0f-a075-db352b4198e8 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:20.517929 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64699e8-8f0f-4a0f-a075-db352b4198e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:20.517929 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64699e8-8f0f-4a0f-a075-db352b4198e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:20.518561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2b82d6df-2bb4-45ca-a64c-3c97e3bcd0b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b1a8c2998047efa0025277558149a1'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:20.520247 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64699e8-8f0f-4a0f-a075-db352b4198e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:48:20.520566 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2b82d6df-2bb4-45ca-a64c-3c97e3bcd0b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b1a8c2998047efa0025277558149a1'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:20.521051 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64699e8-8f0f-4a0f-a075-db352b4198e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:20.524715 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64699e8-8f0f-4a0f-a075-db352b4198e8 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:20.536315 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 822/1649] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:48:20 2022] DELETE /identity/v3/users/89b1a8c2998047efa0025277558149a1 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:20.542876 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd8814-c028-4560-b251-2785d8e93b88 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:20.543213 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd8814-c028-4560-b251-2785d8e93b88 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:20.543578 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd8814-c028-4560-b251-2785d8e93b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:20.560324 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 828/1650] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:48:20.567845 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64699e8-8f0f-4a0f-a075-db352b4198e8 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:20.570008 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-d64699e8-8f0f-4a0f-a075-db352b4198e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:20.593628 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-f8cd8814-c028-4560-b251-2785d8e93b88 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:20.597114 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-f8cd8814-c028-4560-b251-2785d8e93b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:20.623744 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64699e8-8f0f-4a0f-a075-db352b4198e8 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:20.796478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 823/1651] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:20.826476 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefeb290-904b-4cf1-ae90-668f83465288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:20.827357 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefeb290-904b-4cf1-ae90-668f83465288 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:20.827688 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefeb290-904b-4cf1-ae90-668f83465288 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:20.828061 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefeb290-904b-4cf1-ae90-668f83465288 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:20.828933 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefeb290-904b-4cf1-ae90-668f83465288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:20.832460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefeb290-904b-4cf1-ae90-668f83465288 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:20.847047 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd8814-c028-4560-b251-2785d8e93b88 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:20.849145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-f8cd8814-c028-4560-b251-2785d8e93b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:20.899232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:20.914896 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 829/1652] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:20 2022] POST /identity/v3/projects => generated 377 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:20.921634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefeb290-904b-4cf1-ae90-668f83465288 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:20.997535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:21.012828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd8814-c028-4560-b251-2785d8e93b88 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:21.096376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefeb290-904b-4cf1-ae90-668f83465288 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:21.109584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c494b0-75d8-4bc4-9bc3-1ae2e36107d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:21.110365 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c494b0-75d8-4bc4-9bc3-1ae2e36107d9 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:21.110763 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c494b0-75d8-4bc4-9bc3-1ae2e36107d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:21.112918 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c494b0-75d8-4bc4-9bc3-1ae2e36107d9 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:21.113631 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c494b0-75d8-4bc4-9bc3-1ae2e36107d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:21.120220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c494b0-75d8-4bc4-9bc3-1ae2e36107d9 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:21.153537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851547de-507f-46b1-a6d2-c3b33728dc54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:21.154678 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851547de-507f-46b1-a6d2-c3b33728dc54 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:21.155100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851547de-507f-46b1-a6d2-c3b33728dc54 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:21.155586 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851547de-507f-46b1-a6d2-c3b33728dc54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:21.156591 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 830/1653] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:20 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:21.161787 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c494b0-75d8-4bc4-9bc3-1ae2e36107d9 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:21.169394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851547de-507f-46b1-a6d2-c3b33728dc54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:21.171636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851547de-507f-46b1-a6d2-c3b33728dc54 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:21.184267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 824/1654] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:21.185571 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c494b0-75d8-4bc4-9bc3-1ae2e36107d9 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:21.190825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172cfb69-2319-434b-933b-f703cb590bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:21.191669 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cfb69-2319-434b-933b-f703cb590bab admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:21.192131 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cfb69-2319-434b-933b-f703cb590bab admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:21.192551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cfb69-2319-434b-933b-f703cb590bab admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:21.193353 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172cfb69-2319-434b-933b-f703cb590bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:21.195205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172cfb69-2319-434b-933b-f703cb590bab admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:21.210236 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 831/1655] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:21.214693 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851547de-507f-46b1-a6d2-c3b33728dc54 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:21.228506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851547de-507f-46b1-a6d2-c3b33728dc54 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:21.238093 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c2604-22b8-49a4-93d4-beb7b3b4c8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:21.238367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c2604-22b8-49a4-93d4-beb7b3b4c8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:21.238748 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c2604-22b8-49a4-93d4-beb7b3b4c8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:21.239582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c2604-22b8-49a4-93d4-beb7b3b4c8d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:21.240821 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c2604-22b8-49a4-93d4-beb7b3b4c8d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:21.243666 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c2604-22b8-49a4-93d4-beb7b3b4c8d3 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:21.260712 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 825/1656] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:48:21.264604 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172cfb69-2319-434b-933b-f703cb590bab admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:21.278245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172cfb69-2319-434b-933b-f703cb590bab admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:21.286495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b0999-74ae-437e-bf23-1605bac713b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:21.288365 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b0999-74ae-437e-bf23-1605bac713b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:21.288761 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b0999-74ae-437e-bf23-1605bac713b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:21.289141 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b0999-74ae-437e-bf23-1605bac713b4 admin admin] PATH_INFO: `/v3/projects/f1f248ce7d2145bfa1b7f364f754d254/users/0617f9a3c9ff4de481f43596527811b3/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:21.314497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b0999-74ae-437e-bf23-1605bac713b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1f248ce7d2145bfa1b7f364f754d254, user_id=0617f9a3c9ff4de481f43596527811b3, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:21.318997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b0999-74ae-437e-bf23-1605bac713b4 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:21.339610 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 832/1657] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:21 2022] PUT /identity/v3/projects/f1f248ce7d2145bfa1b7f364f754d254/users/0617f9a3c9ff4de481f43596527811b3/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:48:21.351147 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317b25f-b369-4bad-9e16-0e16010345e6 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:21.352050 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317b25f-b369-4bad-9e16-0e16010345e6 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:21.352572 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317b25f-b369-4bad-9e16-0e16010345e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:21.424589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-e317b25f-b369-4bad-9e16-0e16010345e6 None None] MFA Rules not processed for user `0617f9a3c9ff4de481f43596527811b3`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:21.425835 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e317b25f-b369-4bad-9e16-0e16010345e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:21.556918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 826/1658] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:21.560826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b0999-74ae-437e-bf23-1605bac713b4 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:21.703799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b0999-74ae-437e-bf23-1605bac713b4 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:21.710115 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b07ace-018a-4ab9-9e8e-79efd0ea1fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:21.711728 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b07ace-018a-4ab9-9e8e-79efd0ea1fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:21.712219 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b07ace-018a-4ab9-9e8e-79efd0ea1fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:21.712811 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b07ace-018a-4ab9-9e8e-79efd0ea1fa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:21.713832 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b07ace-018a-4ab9-9e8e-79efd0ea1fa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:21.716088 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b07ace-018a-4ab9-9e8e-79efd0ea1fa4 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:21.770754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 833/1659] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:21 2022] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:48:21.772302 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317b25f-b369-4bad-9e16-0e16010345e6 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:21.787564 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317b25f-b369-4bad-9e16-0e16010345e6 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:21.868288 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:21.920793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84c261-e0cc-4c29-8236-ac7482904f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:21.921505 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84c261-e0cc-4c29-8236-ac7482904f9c admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:21.921784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84c261-e0cc-4c29-8236-ac7482904f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:21.922054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84c261-e0cc-4c29-8236-ac7482904f9c admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:21.922920 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84c261-e0cc-4c29-8236-ac7482904f9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:21.924923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84c261-e0cc-4c29-8236-ac7482904f9c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:21.967419 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 827/1660] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:21 2022] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:21.973014 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b07ace-018a-4ab9-9e8e-79efd0ea1fa4 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:21.999629 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b07ace-018a-4ab9-9e8e-79efd0ea1fa4 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:22.007708 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5334f-9d3f-4970-84e8-5d2948c5facf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:22.014431 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5334f-9d3f-4970-84e8-5d2948c5facf admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:22.034725 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5334f-9d3f-4970-84e8-5d2948c5facf admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:22.035337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5334f-9d3f-4970-84e8-5d2948c5facf admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:22.038188 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5334f-9d3f-4970-84e8-5d2948c5facf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:22.041982 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5334f-9d3f-4970-84e8-5d2948c5facf admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:22.098634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 834/1661] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:22.104157 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84c261-e0cc-4c29-8236-ac7482904f9c admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:22.118266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84c261-e0cc-4c29-8236-ac7482904f9c admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:22.133586 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e12a7-1772-4be6-b80c-1fd1ef3b14fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:22.138639 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e12a7-1772-4be6-b80c-1fd1ef3b14fc admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:22.139345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e12a7-1772-4be6-b80c-1fd1ef3b14fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:22.139817 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e12a7-1772-4be6-b80c-1fd1ef3b14fc admin admin] PATH_INFO: `/v3/projects/8fa153e212a444d5be4eef61860ba73e/users/df56c0591f5444b8bfd99b02691ce5c1/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:22.169785 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e12a7-1772-4be6-b80c-1fd1ef3b14fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa153e212a444d5be4eef61860ba73e, user_id=df56c0591f5444b8bfd99b02691ce5c1, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:22.173447 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e12a7-1772-4be6-b80c-1fd1ef3b14fc admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:22.206119 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 828/1662] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:22 2022] PUT /identity/v3/projects/8fa153e212a444d5be4eef61860ba73e/users/df56c0591f5444b8bfd99b02691ce5c1/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:22.207507 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5334f-9d3f-4970-84e8-5d2948c5facf admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:22.226685 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5334f-9d3f-4970-84e8-5d2948c5facf admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:22.294509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b0d60-4e95-4c6d-a18e-afe3bb2571cc None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:22.294801 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b0d60-4e95-4c6d-a18e-afe3bb2571cc None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:22.295574 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b0d60-4e95-4c6d-a18e-afe3bb2571cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:22.340881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:22.354365 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928e9c6-f5b5-4a55-973b-a889e2321428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:22.354737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928e9c6-f5b5-4a55-973b-a889e2321428 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:22.355759 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928e9c6-f5b5-4a55-973b-a889e2321428 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:22.356855 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928e9c6-f5b5-4a55-973b-a889e2321428 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:22.358485 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928e9c6-f5b5-4a55-973b-a889e2321428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:22.360854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928e9c6-f5b5-4a55-973b-a889e2321428 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:22.392945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 835/1663] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:48:22.404868 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-dd3b0d60-4e95-4c6d-a18e-afe3bb2571cc None None] MFA Rules not processed for user `1d2d929c51c5435891e6614acc095d97`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:22.406134 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-dd3b0d60-4e95-4c6d-a18e-afe3bb2571cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:22.406771 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928e9c6-f5b5-4a55-973b-a889e2321428 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:22.460043 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928e9c6-f5b5-4a55-973b-a889e2321428 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:22.487319 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736899d-42b0-4a6e-b71c-6a4fee858064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:22.488276 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736899d-42b0-4a6e-b71c-6a4fee858064 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:22.488555 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736899d-42b0-4a6e-b71c-6a4fee858064 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:22.488829 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736899d-42b0-4a6e-b71c-6a4fee858064 admin admin] PATH_INFO: `/v3/projects/8fa153e212a444d5be4eef61860ba73e/users/df56c0591f5444b8bfd99b02691ce5c1/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:22.502847 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736899d-42b0-4a6e-b71c-6a4fee858064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa153e212a444d5be4eef61860ba73e, user_id=df56c0591f5444b8bfd99b02691ce5c1, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:22.505794 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736899d-42b0-4a6e-b71c-6a4fee858064 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:22.554754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 836/1664] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:22 2022] PUT /identity/v3/projects/8fa153e212a444d5be4eef61860ba73e/users/df56c0591f5444b8bfd99b02691ce5c1/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:22.567066 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188f894-b263-44ea-822f-5973fb36fe02 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:22.567379 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188f894-b263-44ea-822f-5973fb36fe02 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:22.567655 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188f894-b263-44ea-822f-5973fb36fe02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:22.622263 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-9188f894-b263-44ea-822f-5973fb36fe02 None None] MFA Rules not processed for user `df56c0591f5444b8bfd99b02691ce5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:22.623602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9188f894-b263-44ea-822f-5973fb36fe02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:22.658583 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 829/1665] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:22 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:48:22.748082 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 837/1666] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:48:22.760771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b0d60-4e95-4c6d-a18e-afe3bb2571cc None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:22.763511 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-dd3b0d60-4e95-4c6d-a18e-afe3bb2571cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:22.919354 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b0d60-4e95-4c6d-a18e-afe3bb2571cc None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:22.998305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd589e-b83d-403c-8a90-62c47720100d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:23.013765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd589e-b83d-403c-8a90-62c47720100d service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:23.015640 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd589e-b83d-403c-8a90-62c47720100d service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:23.016139 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd589e-b83d-403c-8a90-62c47720100d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:23.035243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:23.126611 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd589e-b83d-403c-8a90-62c47720100d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:23.128452 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd589e-b83d-403c-8a90-62c47720100d service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:23.175785 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 830/1667] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:23.735038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188f894-b263-44ea-822f-5973fb36fe02 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:23.736832 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9188f894-b263-44ea-822f-5973fb36fe02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:23.977794 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188f894-b263-44ea-822f-5973fb36fe02 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:23.989321 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22b7b9-3768-4280-8c29-6be15c9ce190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:23.990613 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22b7b9-3768-4280-8c29-6be15c9ce190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:23.991096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22b7b9-3768-4280-8c29-6be15c9ce190 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:23.991640 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22b7b9-3768-4280-8c29-6be15c9ce190 admin admin] PATH_INFO: `/v3/users/16ae562d24ea478290604c7748af2a09` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:23.996210 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22b7b9-3768-4280-8c29-6be15c9ce190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16ae562d24ea478290604c7748af2a09)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:23.998502 dv-cinder-749155-8-smb devstack@keystone.service[92087]: WARNING py.warnings [None req-9e22b7b9-3768-4280-8c29-6be15c9ce190 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:48:23.998502 dv-cinder-749155-8-smb devstack@keystone.service[92087]: warnings.warn(msg) Jul 19 20:48:23.998502 dv-cinder-749155-8-smb devstack@keystone.service[92087]: Jul 19 20:48:24.000674 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22b7b9-3768-4280-8c29-6be15c9ce190 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:24.128023 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9e22b7b9-3768-4280-8c29-6be15c9ce190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16ae562d24ea478290604c7748af2a09'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:24.139576 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9e22b7b9-3768-4280-8c29-6be15c9ce190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16ae562d24ea478290604c7748af2a09'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:24.153241 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd589e-b83d-403c-8a90-62c47720100d service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:24.155179 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-92cd589e-b83d-403c-8a90-62c47720100d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:24.175137 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:24.196084 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd589e-b83d-403c-8a90-62c47720100d service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:24.206306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9e22b7b9-3768-4280-8c29-6be15c9ce190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16ae562d24ea478290604c7748af2a09'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:24.209940 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9e22b7b9-3768-4280-8c29-6be15c9ce190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16ae562d24ea478290604c7748af2a09'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:24.213004 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fdbac-8f37-454c-b52d-68fdd99aad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:24.218562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fdbac-8f37-454c-b52d-68fdd99aad8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:24.220973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fdbac-8f37-454c-b52d-68fdd99aad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:24.221386 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fdbac-8f37-454c-b52d-68fdd99aad8b admin admin] PATH_INFO: `/v3/projects/63f961747cb04372a6b0c4e9947f1d6e` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:24.225514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073fdbac-8f37-454c-b52d-68fdd99aad8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f961747cb04372a6b0c4e9947f1d6e)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:24.228892 dv-cinder-749155-8-smb devstack@keystone.service[92088]: WARNING py.warnings [None req-073fdbac-8f37-454c-b52d-68fdd99aad8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 20:48:24.228892 dv-cinder-749155-8-smb devstack@keystone.service[92088]: warnings.warn(msg) Jul 19 20:48:24.228892 dv-cinder-749155-8-smb devstack@keystone.service[92088]: Jul 19 20:48:24.230359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073fdbac-8f37-454c-b52d-68fdd99aad8b admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:24.242836 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9e22b7b9-3768-4280-8c29-6be15c9ce190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16ae562d24ea478290604c7748af2a09'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:24.258610 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 838/1668] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:48:23 2022] DELETE /identity/v3/users/16ae562d24ea478290604c7748af2a09 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:24.265012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ad563-7747-4e0d-b437-42eb552e559f None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:24.266227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ad563-7747-4e0d-b437-42eb552e559f None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:24.266600 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ad563-7747-4e0d-b437-42eb552e559f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:24.346882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-fb8ad563-7747-4e0d-b437-42eb552e559f None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:24.351555 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-fb8ad563-7747-4e0d-b437-42eb552e559f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:24.465327 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-073fdbac-8f37-454c-b52d-68fdd99aad8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f961747cb04372a6b0c4e9947f1d6e', 'request_id': 'req-073fdbac-8f37-454c-b52d-68fdd99aad8b'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:24.485601 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-073fdbac-8f37-454c-b52d-68fdd99aad8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f961747cb04372a6b0c4e9947f1d6e', 'request_id': 'req-073fdbac-8f37-454c-b52d-68fdd99aad8b'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:24.507815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-073fdbac-8f37-454c-b52d-68fdd99aad8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f961747cb04372a6b0c4e9947f1d6e', 'request_id': 'req-073fdbac-8f37-454c-b52d-68fdd99aad8b'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:24.550510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-073fdbac-8f37-454c-b52d-68fdd99aad8b admin admin] The token cache is being invalidate because project 63f961747cb04372a6b0c4e9947f1d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:48:24.551369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-073fdbac-8f37-454c-b52d-68fdd99aad8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:24.555171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-073fdbac-8f37-454c-b52d-68fdd99aad8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:24.569914 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 839/1669] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:24.570157 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 831/1670] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:48:24 2022] DELETE /identity/v3/projects/63f961747cb04372a6b0c4e9947f1d6e => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:48:24.570231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7073de6-4a07-4b98-af44-2d437e079cd6 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:24.570231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7073de6-4a07-4b98-af44-2d437e079cd6 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:24.570705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7073de6-4a07-4b98-af44-2d437e079cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:24.596963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fdbac-8f37-454c-b52d-68fdd99aad8b admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:24.603168 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-073fdbac-8f37-454c-b52d-68fdd99aad8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:24.618260 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-e7073de6-4a07-4b98-af44-2d437e079cd6 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:24.624994 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e7073de6-4a07-4b98-af44-2d437e079cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:24.788844 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fdbac-8f37-454c-b52d-68fdd99aad8b admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:24.800390 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f96a0-83d4-4e7c-899b-a3cd79d58347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:24.801122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f96a0-83d4-4e7c-899b-a3cd79d58347 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:24.801404 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f96a0-83d4-4e7c-899b-a3cd79d58347 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:24.801682 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f96a0-83d4-4e7c-899b-a3cd79d58347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:24.804294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c56f96a0-83d4-4e7c-899b-a3cd79d58347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:24.838161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 840/1671] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:24.846028 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca41db2-26e0-4d56-9ba9-4f6e9df7ce3c None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:24.846472 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca41db2-26e0-4d56-9ba9-4f6e9df7ce3c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:24.846859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca41db2-26e0-4d56-9ba9-4f6e9df7ce3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:24.886525 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-7ca41db2-26e0-4d56-9ba9-4f6e9df7ce3c None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:24.891074 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-7ca41db2-26e0-4d56-9ba9-4f6e9df7ce3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:24.907808 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:24.917484 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 841/1672] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:48:24.922275 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca41db2-26e0-4d56-9ba9-4f6e9df7ce3c None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:24.942712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca41db2-26e0-4d56-9ba9-4f6e9df7ce3c None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:24.961928 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94e553-e8e0-4652-8c09-292b89e90a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:24.962782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94e553-e8e0-4652-8c09-292b89e90a4d admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:24.963083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94e553-e8e0-4652-8c09-292b89e90a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:24.963403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94e553-e8e0-4652-8c09-292b89e90a4d admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:24.964333 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94e553-e8e0-4652-8c09-292b89e90a4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:48:24.964530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94e553-e8e0-4652-8c09-292b89e90a4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:24.969076 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94e553-e8e0-4652-8c09-292b89e90a4d admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:24.978694 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f96a0-83d4-4e7c-899b-a3cd79d58347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:24.986355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f96a0-83d4-4e7c-899b-a3cd79d58347 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:24.998552 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 842/1673] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:48:25.002607 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94e553-e8e0-4652-8c09-292b89e90a4d admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:25.030295 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 832/1674] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:25.038500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94e553-e8e0-4652-8c09-292b89e90a4d admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:25.055757 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18589806-0839-4626-a305-d74313cd2e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:25.056594 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18589806-0839-4626-a305-d74313cd2e24 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:25.056885 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18589806-0839-4626-a305-d74313cd2e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:25.057161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18589806-0839-4626-a305-d74313cd2e24 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:25.057867 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18589806-0839-4626-a305-d74313cd2e24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:25.062552 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18589806-0839-4626-a305-d74313cd2e24 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:25.139630 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 843/1675] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:25 2022] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:48:25.142744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f96a0-83d4-4e7c-899b-a3cd79d58347 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:25.162725 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f96a0-83d4-4e7c-899b-a3cd79d58347 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:25.309507 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873726d-e283-4720-af88-f220e73ffb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:25.311375 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873726d-e283-4720-af88-f220e73ffb06 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:25.311938 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873726d-e283-4720-af88-f220e73ffb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:25.315121 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873726d-e283-4720-af88-f220e73ffb06 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:25.325322 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873726d-e283-4720-af88-f220e73ffb06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:25.328409 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873726d-e283-4720-af88-f220e73ffb06 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:25.370432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 833/1676] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:25 2022] POST /identity/v3/users => generated 283 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:25.374354 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18589806-0839-4626-a305-d74313cd2e24 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:25.393659 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18589806-0839-4626-a305-d74313cd2e24 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:25.422711 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3831f5-6799-43a4-8aa0-93d4220510b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:25.423462 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3831f5-6799-43a4-8aa0-93d4220510b9 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:25.424698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3831f5-6799-43a4-8aa0-93d4220510b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:25.424698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3831f5-6799-43a4-8aa0-93d4220510b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:25.424966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3831f5-6799-43a4-8aa0-93d4220510b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:25.426413 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3831f5-6799-43a4-8aa0-93d4220510b9 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:25.460272 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 844/1677] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:25.464142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873726d-e283-4720-af88-f220e73ffb06 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:25.478404 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873726d-e283-4720-af88-f220e73ffb06 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:25.496408 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4148133-29fc-45ea-bd6e-4975efcd20b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:25.497168 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4148133-29fc-45ea-bd6e-4975efcd20b9 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:25.497510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4148133-29fc-45ea-bd6e-4975efcd20b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:25.497842 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4148133-29fc-45ea-bd6e-4975efcd20b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:25.498636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4148133-29fc-45ea-bd6e-4975efcd20b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:25.500401 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4148133-29fc-45ea-bd6e-4975efcd20b9 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:25.516767 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 834/1678] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:48:25.521028 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3831f5-6799-43a4-8aa0-93d4220510b9 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:25.537955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3831f5-6799-43a4-8aa0-93d4220510b9 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:25.545040 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece3d33-ad9d-4e6a-ab36-9aa3f5b832e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:25.545959 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3d33-ad9d-4e6a-ab36-9aa3f5b832e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:25.546289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3d33-ad9d-4e6a-ab36-9aa3f5b832e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:25.546566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3d33-ad9d-4e6a-ab36-9aa3f5b832e8 admin admin] PATH_INFO: `/v3/projects/fb774134acd348a0be749da7b29fb0b5/users/ad884726def746179dca1c2c0fef9a99/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:25.564295 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece3d33-ad9d-4e6a-ab36-9aa3f5b832e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb774134acd348a0be749da7b29fb0b5, user_id=ad884726def746179dca1c2c0fef9a99, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:25.567832 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece3d33-ad9d-4e6a-ab36-9aa3f5b832e8 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:25.587299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 845/1679] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:25 2022] PUT /identity/v3/projects/fb774134acd348a0be749da7b29fb0b5/users/ad884726def746179dca1c2c0fef9a99/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:25.598370 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a3931-eed6-491a-ba5e-f3e2125169ba None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:25.598577 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a3931-eed6-491a-ba5e-f3e2125169ba None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:25.598800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a3931-eed6-491a-ba5e-f3e2125169ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:25.642924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-0b3a3931-eed6-491a-ba5e-f3e2125169ba None None] MFA Rules not processed for user `ad884726def746179dca1c2c0fef9a99`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:25.644501 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-0b3a3931-eed6-491a-ba5e-f3e2125169ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:25.801626 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 835/1680] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:25.807985 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece3d33-ad9d-4e6a-ab36-9aa3f5b832e8 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:25.830364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:25.940490 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c45072-fc0a-4709-852c-f9dea25fa9b4 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:25.943770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c45072-fc0a-4709-852c-f9dea25fa9b4 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:25.944127 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c45072-fc0a-4709-852c-f9dea25fa9b4 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:25.947877 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 836/1681] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jul 19 20:48:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:48:26.006936 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefee4e-05c2-4b60-a707-03ccc5f574f7 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:26.007234 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefee4e-05c2-4b60-a707-03ccc5f574f7 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:26.007551 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefee4e-05c2-4b60-a707-03ccc5f574f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:26.060454 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece3d33-ad9d-4e6a-ab36-9aa3f5b832e8 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:26.065022 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-cbefee4e-05c2-4b60-a707-03ccc5f574f7 None None] MFA Rules not processed for user `04843ec31eb84585944c7a2b9cd1c0cb`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:26.065022 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-cbefee4e-05c2-4b60-a707-03ccc5f574f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:26.085503 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff374590-faef-45ca-a8fa-06408b810620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:26.086781 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff374590-faef-45ca-a8fa-06408b810620 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:26.087208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff374590-faef-45ca-a8fa-06408b810620 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:26.088047 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff374590-faef-45ca-a8fa-06408b810620 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:26.095665 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff374590-faef-45ca-a8fa-06408b810620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:26.103679 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff374590-faef-45ca-a8fa-06408b810620 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:26.164854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 846/1682] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:25 2022] POST /identity/v3/projects => generated 365 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:26.170780 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff374590-faef-45ca-a8fa-06408b810620 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:26.218920 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:26.269273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 837/1683] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jul 19 20:48:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:48:26.327605 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a0dcb-4d69-42b1-b1c5-da3d3c85eb24 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:26.328008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a0dcb-4d69-42b1-b1c5-da3d3c85eb24 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:26.328620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a0dcb-4d69-42b1-b1c5-da3d3c85eb24 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:26.330714 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 838/1684] 10.222.0.77 () {54 vars in 961 bytes} [Tue Jul 19 20:48:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:48:26.337882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453f5d3-d31c-4d86-ab68-adc5ec0c8745 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:26.338395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453f5d3-d31c-4d86-ab68-adc5ec0c8745 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:26.338772 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453f5d3-d31c-4d86-ab68-adc5ec0c8745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:26.352649 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff374590-faef-45ca-a8fa-06408b810620 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:26.371886 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e925ece-bfb1-4007-a38e-9c8fd6eadfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:26.372928 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e925ece-bfb1-4007-a38e-9c8fd6eadfac admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:26.373317 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e925ece-bfb1-4007-a38e-9c8fd6eadfac admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:26.375201 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e925ece-bfb1-4007-a38e-9c8fd6eadfac admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:26.376210 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e925ece-bfb1-4007-a38e-9c8fd6eadfac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:26.381198 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-b453f5d3-d31c-4d86-ab68-adc5ec0c8745 None None] MFA Rules not processed for user `04843ec31eb84585944c7a2b9cd1c0cb`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:26.381837 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e925ece-bfb1-4007-a38e-9c8fd6eadfac admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:26.384856 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b453f5d3-d31c-4d86-ab68-adc5ec0c8745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:26.427849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 847/1685] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:26 2022] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:26.429070 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e925ece-bfb1-4007-a38e-9c8fd6eadfac admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:26.457887 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e925ece-bfb1-4007-a38e-9c8fd6eadfac admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:26.474065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c6d6f-62aa-4a77-933a-0dceac0e7e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:26.474951 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c6d6f-62aa-4a77-933a-0dceac0e7e82 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:26.475536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c6d6f-62aa-4a77-933a-0dceac0e7e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:26.475923 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c6d6f-62aa-4a77-933a-0dceac0e7e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:26.478984 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c6d6f-62aa-4a77-933a-0dceac0e7e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:26.482104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c6d6f-62aa-4a77-933a-0dceac0e7e82 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:26.532546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 848/1686] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:26.533511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c6d6f-62aa-4a77-933a-0dceac0e7e82 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:26.553050 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c6d6f-62aa-4a77-933a-0dceac0e7e82 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:26.570117 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e839b-4698-44a4-a729-5cd00f2c149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:26.581826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e839b-4698-44a4-a729-5cd00f2c149b admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:26.588700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e839b-4698-44a4-a729-5cd00f2c149b admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:26.589364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e839b-4698-44a4-a729-5cd00f2c149b admin admin] PATH_INFO: `/v3/projects/f2e2e893440c471ebeec9e342306cda4/users/c28082a902294fe7aee0704e7ce2c308/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:26.609081 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 839/1687] 10.222.0.77 () {58 vars in 1058 bytes} [Tue Jul 19 20:48:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 19 20:48:26.610257 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453f5d3-d31c-4d86-ab68-adc5ec0c8745 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:26.616273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b453f5d3-d31c-4d86-ab68-adc5ec0c8745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:26.654493 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e839b-4698-44a4-a729-5cd00f2c149b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e2e893440c471ebeec9e342306cda4, user_id=c28082a902294fe7aee0704e7ce2c308, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:26.665376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299e839b-4698-44a4-a729-5cd00f2c149b admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:26.715633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 849/1688] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:26 2022] PUT /identity/v3/projects/f2e2e893440c471ebeec9e342306cda4/users/c28082a902294fe7aee0704e7ce2c308/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:26.717227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e839b-4698-44a4-a729-5cd00f2c149b admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:26.773471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453f5d3-d31c-4d86-ab68-adc5ec0c8745 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:26.815046 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:26.855636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e839b-4698-44a4-a729-5cd00f2c149b admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:26.887209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bca81-d26e-4bd1-bc48-73bf251d7001 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04843ec31eb84585944c7a2b9cd1c0cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:26.888175 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bca81-d26e-4bd1-bc48-73bf251d7001 service placement] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:26.892219 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bca81-d26e-4bd1-bc48-73bf251d7001 service placement] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:26.892539 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822bca81-d26e-4bd1-bc48-73bf251d7001 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:26.917823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822bca81-d26e-4bd1-bc48-73bf251d7001 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:26.920959 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822bca81-d26e-4bd1-bc48-73bf251d7001 service placement] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:26.941117 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c29e7f-286f-499e-9d3e-e274970a94ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:26.942508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c29e7f-286f-499e-9d3e-e274970a94ac service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:26.942785 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c29e7f-286f-499e-9d3e-e274970a94ac service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:26.943071 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c29e7f-286f-499e-9d3e-e274970a94ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:26.948591 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 850/1689] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:26.949455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bca81-d26e-4bd1-bc48-73bf251d7001 service placement] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:26.953412 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-f7c29e7f-286f-499e-9d3e-e274970a94ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:27.144507 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822bca81-d26e-4bd1-bc48-73bf251d7001 service placement] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:27.159996 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584f35a-3acd-4055-b418-7b820c5256f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:27.161261 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584f35a-3acd-4055-b418-7b820c5256f5 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:27.163843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584f35a-3acd-4055-b418-7b820c5256f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:27.164321 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584f35a-3acd-4055-b418-7b820c5256f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:27.165771 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584f35a-3acd-4055-b418-7b820c5256f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:27.173455 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:27.173889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584f35a-3acd-4055-b418-7b820c5256f5 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:27.182604 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c29e7f-286f-499e-9d3e-e274970a94ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:27.184631 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c29e7f-286f-499e-9d3e-e274970a94ac service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:27.205292 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 840/1690] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:27.209753 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 851/1691] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:27.211236 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c29e7f-286f-499e-9d3e-e274970a94ac service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:27.233658 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c29e7f-286f-499e-9d3e-e274970a94ac service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:27.244660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567a0b7-18dd-4127-80e2-37389e9b13d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:27.247719 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567a0b7-18dd-4127-80e2-37389e9b13d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:27.248565 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567a0b7-18dd-4127-80e2-37389e9b13d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:27.249009 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567a0b7-18dd-4127-80e2-37389e9b13d3 admin admin] PATH_INFO: `/v3/projects/f2e2e893440c471ebeec9e342306cda4/users/c28082a902294fe7aee0704e7ce2c308/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:27.251693 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567a0b7-18dd-4127-80e2-37389e9b13d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e2e893440c471ebeec9e342306cda4, user_id=c28082a902294fe7aee0704e7ce2c308, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:27.255867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567a0b7-18dd-4127-80e2-37389e9b13d3 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:27.256819 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584f35a-3acd-4055-b418-7b820c5256f5 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:27.258694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9584f35a-3acd-4055-b418-7b820c5256f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:27.279189 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 841/1692] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:27 2022] PUT /identity/v3/projects/f2e2e893440c471ebeec9e342306cda4/users/c28082a902294fe7aee0704e7ce2c308/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:27.294073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584f35a-3acd-4055-b418-7b820c5256f5 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:27.302673 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b50323-f0f1-4c02-a09c-3d1758ff94b7 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:27.303205 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b50323-f0f1-4c02-a09c-3d1758ff94b7 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:27.303695 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b50323-f0f1-4c02-a09c-3d1758ff94b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:27.358945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-46b50323-f0f1-4c02-a09c-3d1758ff94b7 None None] MFA Rules not processed for user `c28082a902294fe7aee0704e7ce2c308`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:27.363994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-46b50323-f0f1-4c02-a09c-3d1758ff94b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:27.477079 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821db125-5444-44ae-8145-24367f158f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:27.478734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821db125-5444-44ae-8145-24367f158f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:27.478846 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821db125-5444-44ae-8145-24367f158f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:27.479201 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821db125-5444-44ae-8145-24367f158f47 admin admin] PATH_INFO: `/v3/projects/9a0f83826a964db4a4af40a95230c92c` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:27.483364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821db125-5444-44ae-8145-24367f158f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a0f83826a964db4a4af40a95230c92c)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:27.486431 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821db125-5444-44ae-8145-24367f158f47 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:27.512861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 842/1693] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:27.541351 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b50323-f0f1-4c02-a09c-3d1758ff94b7 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:27.542958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-46b50323-f0f1-4c02-a09c-3d1758ff94b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:27.654049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-821db125-5444-44ae-8145-24367f158f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a0f83826a964db4a4af40a95230c92c', 'request_id': 'req-821db125-5444-44ae-8145-24367f158f47'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:27.671965 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-821db125-5444-44ae-8145-24367f158f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a0f83826a964db4a4af40a95230c92c', 'request_id': 'req-821db125-5444-44ae-8145-24367f158f47'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:27.693832 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-821db125-5444-44ae-8145-24367f158f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a0f83826a964db4a4af40a95230c92c', 'request_id': 'req-821db125-5444-44ae-8145-24367f158f47'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:27.724189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:27.731216 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b50323-f0f1-4c02-a09c-3d1758ff94b7 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:27.732797 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-821db125-5444-44ae-8145-24367f158f47 admin admin] The token cache is being invalidate because project 9a0f83826a964db4a4af40a95230c92c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:48:27.733279 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-821db125-5444-44ae-8145-24367f158f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:27.735563 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-821db125-5444-44ae-8145-24367f158f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:27.742606 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 852/1694] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:48:27 2022] DELETE /identity/v3/projects/9a0f83826a964db4a4af40a95230c92c => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:27.744756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afea84c-f548-46bb-b3b6-bf2b6ba3c909 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:27.745246 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afea84c-f548-46bb-b3b6-bf2b6ba3c909 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:27.745667 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afea84c-f548-46bb-b3b6-bf2b6ba3c909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:27.794547 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-5afea84c-f548-46bb-b3b6-bf2b6ba3c909 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:27.795912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-5afea84c-f548-46bb-b3b6-bf2b6ba3c909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:27.964173 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5eca8-c26a-4e38-a17c-65adcbf20437 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:27.964903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5eca8-c26a-4e38-a17c-65adcbf20437 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:27.965189 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5eca8-c26a-4e38-a17c-65adcbf20437 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:27.965465 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5eca8-c26a-4e38-a17c-65adcbf20437 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:27.980404 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a4f5eca8-c26a-4e38-a17c-65adcbf20437 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:27.989363 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 853/1695] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:27.998388 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99890867-cfc5-4826-ac9c-710eb4af0218 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:27.999165 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99890867-cfc5-4826-ac9c-710eb4af0218 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:27.999724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99890867-cfc5-4826-ac9c-710eb4af0218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:28.039479 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-99890867-cfc5-4826-ac9c-710eb4af0218 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:28.042564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-99890867-cfc5-4826-ac9c-710eb4af0218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:28.058619 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 854/1696] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:28.059879 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:28.062343 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99890867-cfc5-4826-ac9c-710eb4af0218 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:28.085581 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99890867-cfc5-4826-ac9c-710eb4af0218 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:28.110987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725f148-0cea-4d00-a666-7e067fb9f2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:28.114021 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725f148-0cea-4d00-a666-7e067fb9f2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:28.114685 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725f148-0cea-4d00-a666-7e067fb9f2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:28.115978 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725f148-0cea-4d00-a666-7e067fb9f2d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:28.120143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725f148-0cea-4d00-a666-7e067fb9f2d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:48:28.121985 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725f148-0cea-4d00-a666-7e067fb9f2d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:28.123801 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725f148-0cea-4d00-a666-7e067fb9f2d4 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:28.125743 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5eca8-c26a-4e38-a17c-65adcbf20437 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:28.127194 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5eca8-c26a-4e38-a17c-65adcbf20437 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:28.143862 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 843/1697] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:48:28.184769 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 855/1698] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:48:28.185497 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5eca8-c26a-4e38-a17c-65adcbf20437 service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:28.199641 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5eca8-c26a-4e38-a17c-65adcbf20437 service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:28.215464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d74174-e9de-42c4-a8a5-633006d002a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:28.216147 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d74174-e9de-42c4-a8a5-633006d002a1 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:28.216431 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d74174-e9de-42c4-a8a5-633006d002a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:28.216709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d74174-e9de-42c4-a8a5-633006d002a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:28.217442 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d74174-e9de-42c4-a8a5-633006d002a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:28.219340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d74174-e9de-42c4-a8a5-633006d002a1 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:28.270683 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 844/1699] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:28 2022] POST /identity/v3/projects => generated 381 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:48:28.275400 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725f148-0cea-4d00-a666-7e067fb9f2d4 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:28.286623 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725f148-0cea-4d00-a666-7e067fb9f2d4 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:28.354584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d74174-e9de-42c4-a8a5-633006d002a1 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:28.356556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a7d74174-e9de-42c4-a8a5-633006d002a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:28.441503 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060e191-0e05-42d6-806c-e084493c9d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:28.443020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060e191-0e05-42d6-806c-e084493c9d5b admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:28.443556 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060e191-0e05-42d6-806c-e084493c9d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:28.444596 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060e191-0e05-42d6-806c-e084493c9d5b admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:28.446444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060e191-0e05-42d6-806c-e084493c9d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:28.449807 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060e191-0e05-42d6-806c-e084493c9d5b admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:28.483671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 856/1700] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:28 2022] POST /identity/v3/users => generated 291 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:28.486320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060e191-0e05-42d6-806c-e084493c9d5b admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:28.490425 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d74174-e9de-42c4-a8a5-633006d002a1 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:28.505031 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9cc22-69dd-4ae9-bda9-6cad9725381c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:28.506029 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9cc22-69dd-4ae9-bda9-6cad9725381c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:28.506225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9cc22-69dd-4ae9-bda9-6cad9725381c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:28.506483 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-8060e191-0e05-42d6-806c-e084493c9d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:28.506591 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9cc22-69dd-4ae9-bda9-6cad9725381c admin admin] PATH_INFO: `/v3/users/031645836ff8416e8e5c420a37be8a4a` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:28.508125 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9cc22-69dd-4ae9-bda9-6cad9725381c admin admin] RBAC: Authorizing `identity:delete_user(user_id=031645836ff8416e8e5c420a37be8a4a)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:28.510014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9cc22-69dd-4ae9-bda9-6cad9725381c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:28.626682 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-7cd9cc22-69dd-4ae9-bda9-6cad9725381c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '031645836ff8416e8e5c420a37be8a4a'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:28.646468 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060e191-0e05-42d6-806c-e084493c9d5b admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:28.647400 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-7cd9cc22-69dd-4ae9-bda9-6cad9725381c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '031645836ff8416e8e5c420a37be8a4a'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:28.654504 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842ee4b-f1b1-404f-b404-8935696237dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:28.655540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842ee4b-f1b1-404f-b404-8935696237dc service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:28.656118 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842ee4b-f1b1-404f-b404-8935696237dc service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:28.656404 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842ee4b-f1b1-404f-b404-8935696237dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:28.659689 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-5842ee4b-f1b1-404f-b404-8935696237dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:28.669243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-7cd9cc22-69dd-4ae9-bda9-6cad9725381c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '031645836ff8416e8e5c420a37be8a4a'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:28.685403 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-7cd9cc22-69dd-4ae9-bda9-6cad9725381c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '031645836ff8416e8e5c420a37be8a4a'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:28.686071 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-7cd9cc22-69dd-4ae9-bda9-6cad9725381c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '031645836ff8416e8e5c420a37be8a4a'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:28.705646 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 845/1701] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:48:28 2022] DELETE /identity/v3/users/031645836ff8416e8e5c420a37be8a4a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:28.705646 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9cc22-69dd-4ae9-bda9-6cad9725381c admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:28.705915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:28.706223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7cd9cc22-69dd-4ae9-bda9-6cad9725381c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:28.769616 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842ee4b-f1b1-404f-b404-8935696237dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:28.771681 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842ee4b-f1b1-404f-b404-8935696237dc service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:28.779368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:28.803085 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 857/1702] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:28.807215 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d24b86-4224-4ec6-a732-108cbe9f768c None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:28.807701 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d24b86-4224-4ec6-a732-108cbe9f768c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:28.808155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d24b86-4224-4ec6-a732-108cbe9f768c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:28.852013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-25d24b86-4224-4ec6-a732-108cbe9f768c None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:28.855623 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-25d24b86-4224-4ec6-a732-108cbe9f768c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:28.865682 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9cc22-69dd-4ae9-bda9-6cad9725381c admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:28.878416 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 858/1703] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:28.889173 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7412b7-e6cb-42ca-a99c-e21137540bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:28.890321 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7412b7-e6cb-42ca-a99c-e21137540bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:28.891896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7412b7-e6cb-42ca-a99c-e21137540bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:28.892633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7412b7-e6cb-42ca-a99c-e21137540bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:28.904887 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7412b7-e6cb-42ca-a99c-e21137540bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:28.906748 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7412b7-e6cb-42ca-a99c-e21137540bf7 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:28.932100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 846/1704] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:28.937209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d24b86-4224-4ec6-a732-108cbe9f768c None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:28.950326 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d24b86-4224-4ec6-a732-108cbe9f768c None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:28.982912 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7412b7-e6cb-42ca-a99c-e21137540bf7 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:28.983885 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f855fb7-7068-49cd-a322-add48501d366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:28.990689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3a7412b7-e6cb-42ca-a99c-e21137540bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:28.992365 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f855fb7-7068-49cd-a322-add48501d366 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:28.995105 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f855fb7-7068-49cd-a322-add48501d366 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:28.998134 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f855fb7-7068-49cd-a322-add48501d366 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:29.007687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f855fb7-7068-49cd-a322-add48501d366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:29.016294 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f855fb7-7068-49cd-a322-add48501d366 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:29.064474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 859/1705] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:29.067699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f855fb7-7068-49cd-a322-add48501d366 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:29.117378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f855fb7-7068-49cd-a322-add48501d366 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:29.139878 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215be97-504e-425b-8510-8ee9a01384ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:29.141224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215be97-504e-425b-8510-8ee9a01384ae admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:29.142011 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215be97-504e-425b-8510-8ee9a01384ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:29.142564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215be97-504e-425b-8510-8ee9a01384ae admin admin] PATH_INFO: `/v3/projects/352fd14468284a729a7c183db081144a/users/7ffda534597d4afdbfb531221f743ea5/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:29.176351 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7412b7-e6cb-42ca-a99c-e21137540bf7 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:29.185169 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8637a70-32d0-411d-9a26-e086e5ce90bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:29.185913 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8637a70-32d0-411d-9a26-e086e5ce90bf service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:29.189641 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8637a70-32d0-411d-9a26-e086e5ce90bf service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:29.189641 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8637a70-32d0-411d-9a26-e086e5ce90bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:29.212821 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8637a70-32d0-411d-9a26-e086e5ce90bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:29.217416 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215be97-504e-425b-8510-8ee9a01384ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=352fd14468284a729a7c183db081144a, user_id=7ffda534597d4afdbfb531221f743ea5, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:29.224254 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8637a70-32d0-411d-9a26-e086e5ce90bf service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:29.232442 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215be97-504e-425b-8510-8ee9a01384ae admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:29.265207 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 847/1706] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:29.270726 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 860/1707] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:29 2022] PUT /identity/v3/projects/352fd14468284a729a7c183db081144a/users/7ffda534597d4afdbfb531221f743ea5/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:29.281598 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53081401-be69-4f9d-95e8-4fad1a890408 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:29.282112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53081401-be69-4f9d-95e8-4fad1a890408 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:29.282184 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53081401-be69-4f9d-95e8-4fad1a890408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:29.327109 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-53081401-be69-4f9d-95e8-4fad1a890408 None None] MFA Rules not processed for user `7ffda534597d4afdbfb531221f743ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:29.328700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-53081401-be69-4f9d-95e8-4fad1a890408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:29.523745 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215be97-504e-425b-8510-8ee9a01384ae admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:29.531668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 848/1708] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:29.665791 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215be97-504e-425b-8510-8ee9a01384ae admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:29.683535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1b0ba-4cd5-42cb-8a87-a1a914de73a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:29.684889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1b0ba-4cd5-42cb-8a87-a1a914de73a4 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:29.685425 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1b0ba-4cd5-42cb-8a87-a1a914de73a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:29.685911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1b0ba-4cd5-42cb-8a87-a1a914de73a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:29.686972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1b0ba-4cd5-42cb-8a87-a1a914de73a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:29.699085 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1b0ba-4cd5-42cb-8a87-a1a914de73a4 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:29.755560 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc942f-54e9-44eb-b2e0-70817106ce42 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:29.756267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc942f-54e9-44eb-b2e0-70817106ce42 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:29.756267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc942f-54e9-44eb-b2e0-70817106ce42 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:29.758353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 849/1709] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jul 19 20:48:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:48:29.780264 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 861/1710] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:29 2022] POST /identity/v3/projects => generated 383 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:48:29.784534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc942f-54e9-44eb-b2e0-70817106ce42 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:29.791602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09e60c-84c1-4728-9fd0-175b4e59d23e None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:29.793386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09e60c-84c1-4728-9fd0-175b4e59d23e None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:29.796708 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09e60c-84c1-4728-9fd0-175b4e59d23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:29.831646 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-ad09e60c-84c1-4728-9fd0-175b4e59d23e None None] MFA Rules not processed for user `04843ec31eb84585944c7a2b9cd1c0cb`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:29.833153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-ad09e60c-84c1-4728-9fd0-175b4e59d23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:29.949619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:29.965595 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc942f-54e9-44eb-b2e0-70817106ce42 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:29.975287 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916aa3b-e845-459d-9632-5d8d394972ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:29.975992 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916aa3b-e845-459d-9632-5d8d394972ac admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:29.976279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916aa3b-e845-459d-9632-5d8d394972ac admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:29.976556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916aa3b-e845-459d-9632-5d8d394972ac admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:29.979483 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916aa3b-e845-459d-9632-5d8d394972ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:29.982442 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916aa3b-e845-459d-9632-5d8d394972ac admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:30.039453 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 850/1711] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:29 2022] POST /identity/v3/users => generated 298 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:30.043209 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916aa3b-e845-459d-9632-5d8d394972ac admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:30.044973 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 862/1712] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jul 19 20:48:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:30.046576 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09e60c-84c1-4728-9fd0-175b4e59d23e None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:30.047344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-2916aa3b-e845-459d-9632-5d8d394972ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:30.065424 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:30.086208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09e60c-84c1-4728-9fd0-175b4e59d23e None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:30.088010 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916aa3b-e845-459d-9632-5d8d394972ac admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:30.102452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae01b8-35dc-4936-ba40-be9dbe1c936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:30.106402 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae01b8-35dc-4936-ba40-be9dbe1c936c admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:30.106691 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae01b8-35dc-4936-ba40-be9dbe1c936c admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:30.106979 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae01b8-35dc-4936-ba40-be9dbe1c936c admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:30.111097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e50fb-1261-47eb-9de2-9e2e1c57fc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:30.113335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e50fb-1261-47eb-9de2-9e2e1c57fc75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:30.113511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae01b8-35dc-4936-ba40-be9dbe1c936c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:30.115051 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae01b8-35dc-4936-ba40-be9dbe1c936c admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:30.115434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e50fb-1261-47eb-9de2-9e2e1c57fc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:30.115742 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e50fb-1261-47eb-9de2-9e2e1c57fc75 admin admin] PATH_INFO: `/v3/users/9ac645a9dd604d27814fd3b16bf4a2c4` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:30.122322 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e50fb-1261-47eb-9de2-9e2e1c57fc75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ac645a9dd604d27814fd3b16bf4a2c4)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:30.126140 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e50fb-1261-47eb-9de2-9e2e1c57fc75 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:30.143632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 863/1713] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:30.144536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae01b8-35dc-4936-ba40-be9dbe1c936c admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:30.154972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-8dae01b8-35dc-4936-ba40-be9dbe1c936c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:30.201617 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae01b8-35dc-4936-ba40-be9dbe1c936c admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:30.214515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58757031-e1f8-476a-8b80-aeb13ade664a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04843ec31eb84585944c7a2b9cd1c0cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:30.215213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58757031-e1f8-476a-8b80-aeb13ade664a service placement] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:30.215524 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58757031-e1f8-476a-8b80-aeb13ade664a service placement] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:30.215803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58757031-e1f8-476a-8b80-aeb13ade664a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:30.234010 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58757031-e1f8-476a-8b80-aeb13ade664a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:30.235868 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58757031-e1f8-476a-8b80-aeb13ade664a service placement] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:30.297837 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 864/1714] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:30.301275 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58757031-e1f8-476a-8b80-aeb13ade664a service placement] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:30.330689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-555e50fb-1261-47eb-9de2-9e2e1c57fc75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ac645a9dd604d27814fd3b16bf4a2c4'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:30.377618 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58757031-e1f8-476a-8b80-aeb13ade664a service placement] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:30.403479 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-555e50fb-1261-47eb-9de2-9e2e1c57fc75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ac645a9dd604d27814fd3b16bf4a2c4'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:30.412193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea163a4-d0fa-4d93-b0e6-3cdb590adbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:30.425962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea163a4-d0fa-4d93-b0e6-3cdb590adbfb admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:30.425962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea163a4-d0fa-4d93-b0e6-3cdb590adbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:30.428290 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea163a4-d0fa-4d93-b0e6-3cdb590adbfb admin admin] PATH_INFO: `/v3/projects/e36b7ab7524644d58be0061565832e60/users/2018635935f34c25a85780ceda1c2f9f/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:30.441592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-555e50fb-1261-47eb-9de2-9e2e1c57fc75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ac645a9dd604d27814fd3b16bf4a2c4'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:30.464892 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-555e50fb-1261-47eb-9de2-9e2e1c57fc75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ac645a9dd604d27814fd3b16bf4a2c4'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:30.466152 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-555e50fb-1261-47eb-9de2-9e2e1c57fc75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ac645a9dd604d27814fd3b16bf4a2c4'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:30.481049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea163a4-d0fa-4d93-b0e6-3cdb590adbfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e36b7ab7524644d58be0061565832e60, user_id=2018635935f34c25a85780ceda1c2f9f, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:30.482829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 851/1715] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:48:30 2022] DELETE /identity/v3/users/9ac645a9dd604d27814fd3b16bf4a2c4 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:30.485917 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea163a4-d0fa-4d93-b0e6-3cdb590adbfb admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:30.520927 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 865/1716] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:30 2022] PUT /identity/v3/projects/e36b7ab7524644d58be0061565832e60/users/2018635935f34c25a85780ceda1c2f9f/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:30.525044 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e50fb-1261-47eb-9de2-9e2e1c57fc75 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:30.534819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-555e50fb-1261-47eb-9de2-9e2e1c57fc75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:30.788830 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e50fb-1261-47eb-9de2-9e2e1c57fc75 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:31.039788 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da780ad-4651-4070-a5bc-fcc708b1cdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:31.040521 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da780ad-4651-4070-a5bc-fcc708b1cdc8 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:31.040804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da780ad-4651-4070-a5bc-fcc708b1cdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:31.041075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da780ad-4651-4070-a5bc-fcc708b1cdc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:31.041811 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da780ad-4651-4070-a5bc-fcc708b1cdc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:31.043470 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da780ad-4651-4070-a5bc-fcc708b1cdc8 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:31.073571 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 852/1717] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 546 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:31.074805 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea163a4-d0fa-4d93-b0e6-3cdb590adbfb admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:31.094542 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea163a4-d0fa-4d93-b0e6-3cdb590adbfb admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:31.107577 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3233d5-7f6a-43cb-836a-d292feeeb0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:31.108509 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3233d5-7f6a-43cb-836a-d292feeeb0ef admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:31.108791 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3233d5-7f6a-43cb-836a-d292feeeb0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:31.109068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3233d5-7f6a-43cb-836a-d292feeeb0ef admin admin] PATH_INFO: `/v3/projects/e36b7ab7524644d58be0061565832e60/users/2018635935f34c25a85780ceda1c2f9f/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:31.114465 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3233d5-7f6a-43cb-836a-d292feeeb0ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e36b7ab7524644d58be0061565832e60, user_id=2018635935f34c25a85780ceda1c2f9f, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:31.122833 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3233d5-7f6a-43cb-836a-d292feeeb0ef admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:31.166849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 866/1718] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:31 2022] PUT /identity/v3/projects/e36b7ab7524644d58be0061565832e60/users/2018635935f34c25a85780ceda1c2f9f/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:31.169433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba2ee2-0b4a-4944-8b1f-ac4d82b1c4c7 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:31.169726 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba2ee2-0b4a-4944-8b1f-ac4d82b1c4c7 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:31.170006 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba2ee2-0b4a-4944-8b1f-ac4d82b1c4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:31.194922 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:31.261439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-37ba2ee2-0b4a-4944-8b1f-ac4d82b1c4c7 None None] MFA Rules not processed for user `2018635935f34c25a85780ceda1c2f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:31.263021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-37ba2ee2-0b4a-4944-8b1f-ac4d82b1c4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:31.277157 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e0462-d4e6-4d22-8b57-96f6b7ddd33d None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:31.277634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e0462-d4e6-4d22-8b57-96f6b7ddd33d None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:31.277710 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e0462-d4e6-4d22-8b57-96f6b7ddd33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:31.354731 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-6d7e0462-d4e6-4d22-8b57-96f6b7ddd33d None None] MFA Rules not processed for user `c1a2b827eaad4e2784613fa4a54c2c44`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:31.360578 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-6d7e0462-d4e6-4d22-8b57-96f6b7ddd33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:31.483226 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 853/1719] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:31.496036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba2ee2-0b4a-4944-8b1f-ac4d82b1c4c7 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:31.501262 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-37ba2ee2-0b4a-4944-8b1f-ac4d82b1c4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:31.572054 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 867/1720] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 19 20:48:31.577035 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e0462-d4e6-4d22-8b57-96f6b7ddd33d None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:31.578144 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-6d7e0462-d4e6-4d22-8b57-96f6b7ddd33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:31.662786 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba2ee2-0b4a-4944-8b1f-ac4d82b1c4c7 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:31.677618 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388c192-c539-4510-8ee6-39ec3e424bcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:31.678361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388c192-c539-4510-8ee6-39ec3e424bcf service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:31.678647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388c192-c539-4510-8ee6-39ec3e424bcf service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:31.678928 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388c192-c539-4510-8ee6-39ec3e424bcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:31.699440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388c192-c539-4510-8ee6-39ec3e424bcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:31.701597 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388c192-c539-4510-8ee6-39ec3e424bcf service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:31.742507 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 854/1721] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:31.744708 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5a9d1-4327-4223-8850-9af2a0886912 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:31.749968 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5a9d1-4327-4223-8850-9af2a0886912 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:31.751340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5a9d1-4327-4223-8850-9af2a0886912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:31.799448 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e0462-d4e6-4d22-8b57-96f6b7ddd33d None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:31.809299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b47ce-e253-47b3-885c-82b9eab4d3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:31.810919 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b47ce-e253-47b3-885c-82b9eab4d3e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:31.811510 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b47ce-e253-47b3-885c-82b9eab4d3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:31.811628 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-a1e5a9d1-4327-4223-8850-9af2a0886912 None None] MFA Rules not processed for user `c1a2b827eaad4e2784613fa4a54c2c44`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:31.812133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b47ce-e253-47b3-885c-82b9eab4d3e8 admin admin] PATH_INFO: `/v3/projects/a9a128610eeb44ff9ff37e14c54b654d` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:31.812766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a1e5a9d1-4327-4223-8850-9af2a0886912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:31.814049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b47ce-e253-47b3-885c-82b9eab4d3e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a128610eeb44ff9ff37e14c54b654d)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:31.816573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b47ce-e253-47b3-885c-82b9eab4d3e8 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:31.839108 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 855/1722] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:31.851481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5a9d1-4327-4223-8850-9af2a0886912 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:31.853400 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a1e5a9d1-4327-4223-8850-9af2a0886912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:31.899065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:31.919282 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-701b47ce-e253-47b3-885c-82b9eab4d3e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a128610eeb44ff9ff37e14c54b654d', 'request_id': 'req-701b47ce-e253-47b3-885c-82b9eab4d3e8'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:31.935121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-701b47ce-e253-47b3-885c-82b9eab4d3e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a128610eeb44ff9ff37e14c54b654d', 'request_id': 'req-701b47ce-e253-47b3-885c-82b9eab4d3e8'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:31.956042 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-701b47ce-e253-47b3-885c-82b9eab4d3e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a128610eeb44ff9ff37e14c54b654d', 'request_id': 'req-701b47ce-e253-47b3-885c-82b9eab4d3e8'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:31.978835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-701b47ce-e253-47b3-885c-82b9eab4d3e8 admin admin] The token cache is being invalidate because project a9a128610eeb44ff9ff37e14c54b654d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:48:31.979492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-701b47ce-e253-47b3-885c-82b9eab4d3e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:31.980574 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-701b47ce-e253-47b3-885c-82b9eab4d3e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:31.984008 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 868/1723] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:48:31 2022] DELETE /identity/v3/projects/a9a128610eeb44ff9ff37e14c54b654d => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:31.984926 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b47ce-e253-47b3-885c-82b9eab4d3e8 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:31.989412 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-701b47ce-e253-47b3-885c-82b9eab4d3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:31.997124 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5a9d1-4327-4223-8850-9af2a0886912 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:32.025435 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:32.111332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b47ce-e253-47b3-885c-82b9eab4d3e8 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:32.119052 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd37d0-e482-4971-8acb-f9280f53b59f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:32.119743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd37d0-e482-4971-8acb-f9280f53b59f service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:32.121014 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd37d0-e482-4971-8acb-f9280f53b59f service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:32.121303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd37d0-e482-4971-8acb-f9280f53b59f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:32.125828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-cbdd37d0-e482-4971-8acb-f9280f53b59f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:32.135523 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeba8c2-574d-4421-a526-b1097bee9344 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:32.139151 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeba8c2-574d-4421-a526-b1097bee9344 service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:32.139671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeba8c2-574d-4421-a526-b1097bee9344 service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:32.140012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeba8c2-574d-4421-a526-b1097bee9344 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:32.144505 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-6aeba8c2-574d-4421-a526-b1097bee9344 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:32.237613 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeba8c2-574d-4421-a526-b1097bee9344 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:32.240981 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeba8c2-574d-4421-a526-b1097bee9344 service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:32.249592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd37d0-e482-4971-8acb-f9280f53b59f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:32.251195 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd37d0-e482-4971-8acb-f9280f53b59f service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:32.261964 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 856/1724] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:48:32.264037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeba8c2-574d-4421-a526-b1097bee9344 service nova] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:32.265748 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 869/1725] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:32.267625 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd37d0-e482-4971-8acb-f9280f53b59f service cinder] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:32.269132 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-cbdd37d0-e482-4971-8acb-f9280f53b59f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:32.273450 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-6aeba8c2-574d-4421-a526-b1097bee9344 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:32.440916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd37d0-e482-4971-8acb-f9280f53b59f service cinder] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:32.459832 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8607d49-6d84-4c18-a927-25cf0955c9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:32.460874 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8607d49-6d84-4c18-a927-25cf0955c9c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:32.461170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8607d49-6d84-4c18-a927-25cf0955c9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:32.461436 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8607d49-6d84-4c18-a927-25cf0955c9c1 admin admin] PATH_INFO: `/v3/projects/4e16ac974e1148bcb4703220a448e3bc` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:32.471814 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8607d49-6d84-4c18-a927-25cf0955c9c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e16ac974e1148bcb4703220a448e3bc)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:32.479580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8607d49-6d84-4c18-a927-25cf0955c9c1 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:32.485446 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeba8c2-574d-4421-a526-b1097bee9344 service nova] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:32.500794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6edc1-1ec6-4bd7-a790-d4f7a873859e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:32.502756 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6edc1-1ec6-4bd7-a790-d4f7a873859e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:32.503041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6edc1-1ec6-4bd7-a790-d4f7a873859e admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:32.505350 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6edc1-1ec6-4bd7-a790-d4f7a873859e admin admin] PATH_INFO: `/v3/users/1d2d929c51c5435891e6614acc095d97` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:32.510053 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6edc1-1ec6-4bd7-a790-d4f7a873859e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d2d929c51c5435891e6614acc095d97)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:32.512045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6edc1-1ec6-4bd7-a790-d4f7a873859e admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:32.568018 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:32.644234 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a8607d49-6d84-4c18-a927-25cf0955c9c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e16ac974e1148bcb4703220a448e3bc', 'request_id': 'req-a8607d49-6d84-4c18-a927-25cf0955c9c1'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:32.662327 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a8607d49-6d84-4c18-a927-25cf0955c9c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e16ac974e1148bcb4703220a448e3bc', 'request_id': 'req-a8607d49-6d84-4c18-a927-25cf0955c9c1'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:32.687067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a8607d49-6d84-4c18-a927-25cf0955c9c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e16ac974e1148bcb4703220a448e3bc', 'request_id': 'req-a8607d49-6d84-4c18-a927-25cf0955c9c1'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:32.697721 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-17a6edc1-1ec6-4bd7-a790-d4f7a873859e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d2d929c51c5435891e6614acc095d97'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:32.708395 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a8607d49-6d84-4c18-a927-25cf0955c9c1 admin admin] The token cache is being invalidate because project 4e16ac974e1148bcb4703220a448e3bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:48:32.708951 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a8607d49-6d84-4c18-a927-25cf0955c9c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:32.709869 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a8607d49-6d84-4c18-a927-25cf0955c9c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:32.714237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 870/1726] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:48:32 2022] DELETE /identity/v3/projects/4e16ac974e1148bcb4703220a448e3bc => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:32.718106 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-17a6edc1-1ec6-4bd7-a790-d4f7a873859e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d2d929c51c5435891e6614acc095d97'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:32.719018 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9d1a4-7b68-4fba-bab4-e4ac48f092df None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:32.719530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9d1a4-7b68-4fba-bab4-e4ac48f092df None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:32.719813 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9d1a4-7b68-4fba-bab4-e4ac48f092df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:32.730996 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:32.745745 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-17a6edc1-1ec6-4bd7-a790-d4f7a873859e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d2d929c51c5435891e6614acc095d97'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:32.762102 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-a5d9d1a4-7b68-4fba-bab4-e4ac48f092df None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:32.764020 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-17a6edc1-1ec6-4bd7-a790-d4f7a873859e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d2d929c51c5435891e6614acc095d97'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:32.764458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-a5d9d1a4-7b68-4fba-bab4-e4ac48f092df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:32.767793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-17a6edc1-1ec6-4bd7-a790-d4f7a873859e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d2d929c51c5435891e6614acc095d97'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:32.783680 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 857/1727] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:48:32 2022] DELETE /identity/v3/users/1d2d929c51c5435891e6614acc095d97 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:32.870639 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 871/1728] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:32.871806 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b907a-6f5b-4dfb-92e0-85e6c4b1d284 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:32.872085 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b907a-6f5b-4dfb-92e0-85e6c4b1d284 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:32.872364 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b907a-6f5b-4dfb-92e0-85e6c4b1d284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:32.948607 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-6f4b907a-6f5b-4dfb-92e0-85e6c4b1d284 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:32.950203 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-6f4b907a-6f5b-4dfb-92e0-85e6c4b1d284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:33.109379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 858/1729] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:33.116247 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9d1a4-7b68-4fba-bab4-e4ac48f092df None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:33.139604 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9d1a4-7b68-4fba-bab4-e4ac48f092df None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:33.155102 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b907a-6f5b-4dfb-92e0-85e6c4b1d284 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:33.155844 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-6f4b907a-6f5b-4dfb-92e0-85e6c4b1d284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:33.156565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebeeb05-e97e-4fbd-a87c-8a9ee4daab42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:33.157924 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebeeb05-e97e-4fbd-a87c-8a9ee4daab42 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:33.158349 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebeeb05-e97e-4fbd-a87c-8a9ee4daab42 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:33.159761 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebeeb05-e97e-4fbd-a87c-8a9ee4daab42 admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:33.161231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebeeb05-e97e-4fbd-a87c-8a9ee4daab42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:48:33.165970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebeeb05-e97e-4fbd-a87c-8a9ee4daab42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:33.174243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebeeb05-e97e-4fbd-a87c-8a9ee4daab42 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:33.178776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b907a-6f5b-4dfb-92e0-85e6c4b1d284 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:33.189718 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4749d-8638-46cc-a8e0-52ca96373ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:33.190557 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4749d-8638-46cc-a8e0-52ca96373ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:33.190841 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4749d-8638-46cc-a8e0-52ca96373ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:33.191118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4749d-8638-46cc-a8e0-52ca96373ff0 admin admin] PATH_INFO: `/v3/users/ad884726def746179dca1c2c0fef9a99` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:33.199331 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4749d-8638-46cc-a8e0-52ca96373ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad884726def746179dca1c2c0fef9a99)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:33.200898 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e4749d-8638-46cc-a8e0-52ca96373ff0 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:33.207843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 872/1730] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:48:33.209384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebeeb05-e97e-4fbd-a87c-8a9ee4daab42 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:33.252134 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebeeb05-e97e-4fbd-a87c-8a9ee4daab42 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:33.257808 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd4600-c7a0-46b5-b886-1cb0eb7f0fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:33.259729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd4600-c7a0-46b5-b886-1cb0eb7f0fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:33.260301 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd4600-c7a0-46b5-b886-1cb0eb7f0fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:33.262122 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd4600-c7a0-46b5-b886-1cb0eb7f0fc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:33.263392 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd4600-c7a0-46b5-b886-1cb0eb7f0fc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:33.266078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd4600-c7a0-46b5-b886-1cb0eb7f0fc5 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:33.308702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-f2e4749d-8638-46cc-a8e0-52ca96373ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad884726def746179dca1c2c0fef9a99'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:33.317001 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 873/1731] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:33 2022] POST /identity/v3/projects => generated 403 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:33.320616 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd4600-c7a0-46b5-b886-1cb0eb7f0fc5 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:33.324424 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-f2e4749d-8638-46cc-a8e0-52ca96373ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad884726def746179dca1c2c0fef9a99'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:33.343700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-f2e4749d-8638-46cc-a8e0-52ca96373ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad884726def746179dca1c2c0fef9a99'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:33.358898 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-f2e4749d-8638-46cc-a8e0-52ca96373ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad884726def746179dca1c2c0fef9a99'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:33.359576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-f2e4749d-8638-46cc-a8e0-52ca96373ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad884726def746179dca1c2c0fef9a99'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:33.369986 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 859/1732] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:48:33 2022] DELETE /identity/v3/users/ad884726def746179dca1c2c0fef9a99 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:33.377677 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30f5dd-feb5-44f1-b0e0-bb9dc2e8fb11 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:33.378834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30f5dd-feb5-44f1-b0e0-bb9dc2e8fb11 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:33.380743 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30f5dd-feb5-44f1-b0e0-bb9dc2e8fb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:33.412700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-7c30f5dd-feb5-44f1-b0e0-bb9dc2e8fb11 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:33.414085 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7c30f5dd-feb5-44f1-b0e0-bb9dc2e8fb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:33.470172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd4600-c7a0-46b5-b886-1cb0eb7f0fc5 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:33.492688 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:33.508874 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:33.538723 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 860/1733] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:33.581268 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30f5dd-feb5-44f1-b0e0-bb9dc2e8fb11 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:33.582932 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7c30f5dd-feb5-44f1-b0e0-bb9dc2e8fb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:33.631485 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcce35-98e4-4b81-8523-4f467521b2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:33.632187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcce35-98e4-4b81-8523-4f467521b2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:33.632464 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcce35-98e4-4b81-8523-4f467521b2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:33.632736 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcce35-98e4-4b81-8523-4f467521b2e6 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:33.633463 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcce35-98e4-4b81-8523-4f467521b2e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:33.649229 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcce35-98e4-4b81-8523-4f467521b2e6 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:33.703323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 874/1734] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:33 2022] POST /identity/v3/users => generated 302 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:33.707142 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff89d05-10b8-442e-9076-6ebda70607c5 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:33.707515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff89d05-10b8-442e-9076-6ebda70607c5 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:33.707833 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff89d05-10b8-442e-9076-6ebda70607c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:33.737871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30f5dd-feb5-44f1-b0e0-bb9dc2e8fb11 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:33.742544 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd54605-ecf2-48d9-bf47-973cd55453bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:33.744906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd54605-ecf2-48d9-bf47-973cd55453bd service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:33.745200 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd54605-ecf2-48d9-bf47-973cd55453bd service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:33.745504 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd54605-ecf2-48d9-bf47-973cd55453bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:33.764318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd54605-ecf2-48d9-bf47-973cd55453bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:33.766175 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd54605-ecf2-48d9-bf47-973cd55453bd service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:33.772629 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-1ff89d05-10b8-442e-9076-6ebda70607c5 None None] MFA Rules not processed for user `ceb44c6507d844b5a2e2b3ccfa64bdd2`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:33.774702 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-1ff89d05-10b8-442e-9076-6ebda70607c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:33.785897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 861/1735] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:33.787067 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd54605-ecf2-48d9-bf47-973cd55453bd service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:33.788650 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-8bd54605-ecf2-48d9-bf47-973cd55453bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:33.806836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd54605-ecf2-48d9-bf47-973cd55453bd service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:33.814094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aeeb3b-c650-41fe-8b05-02b366954953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:33.815149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aeeb3b-c650-41fe-8b05-02b366954953 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:33.815518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aeeb3b-c650-41fe-8b05-02b366954953 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:33.815802 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aeeb3b-c650-41fe-8b05-02b366954953 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:33.816548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aeeb3b-c650-41fe-8b05-02b366954953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:33.818374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aeeb3b-c650-41fe-8b05-02b366954953 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:33.846531 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 862/1736] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:33.850390 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958c6bb-263b-479d-9fd5-673fab7036d3 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:33.852519 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958c6bb-263b-479d-9fd5-673fab7036d3 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:33.853470 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958c6bb-263b-479d-9fd5-673fab7036d3 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:33.859783 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 863/1737] 10.222.0.77 () {54 vars in 912 bytes} [Tue Jul 19 20:48:33 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:48:33.864037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958c6bb-263b-479d-9fd5-673fab7036d3 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:33.896344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958c6bb-263b-479d-9fd5-673fab7036d3 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:33.911210 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8291419-42b3-47e4-8dda-52d5d478ad27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:33.912255 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8291419-42b3-47e4-8dda-52d5d478ad27 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:33.912551 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8291419-42b3-47e4-8dda-52d5d478ad27 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:33.912832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8291419-42b3-47e4-8dda-52d5d478ad27 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:33.913607 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8291419-42b3-47e4-8dda-52d5d478ad27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:33.915288 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8291419-42b3-47e4-8dda-52d5d478ad27 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:33.929381 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 864/1738] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:33.930771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc3e79-1218-46ea-bd79-df341daf45bf None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:33.931036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc3e79-1218-46ea-bd79-df341daf45bf None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:33.931374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc3e79-1218-46ea-bd79-df341daf45bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:33.969119 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 875/1739] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:33.969816 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff89d05-10b8-442e-9076-6ebda70607c5 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:33.972295 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-1ff89d05-10b8-442e-9076-6ebda70607c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:34.004583 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff89d05-10b8-442e-9076-6ebda70607c5 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:34.020893 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517dbd9-6b76-44a9-a041-3d9d4147d618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:34.022489 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517dbd9-6b76-44a9-a041-3d9d4147d618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:34.023079 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517dbd9-6b76-44a9-a041-3d9d4147d618 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:34.023657 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517dbd9-6b76-44a9-a041-3d9d4147d618 admin admin] PATH_INFO: `/v3/projects/16664960592647fabf5eb63daa8d763c` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:34.026062 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517dbd9-6b76-44a9-a041-3d9d4147d618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16664960592647fabf5eb63daa8d763c)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:34.030884 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517dbd9-6b76-44a9-a041-3d9d4147d618 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:34.082556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-b1fc3e79-1218-46ea-bd79-df341daf45bf None None] MFA Rules not processed for user `5b2c0f24d666462aa14ea4eee0592062`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:34.083942 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b1fc3e79-1218-46ea-bd79-df341daf45bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:34.104965 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 865/1740] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jul 19 20:48:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:34.105617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876baa0b-63b9-40a8-9ed5-090aeb24407e None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:34.105903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876baa0b-63b9-40a8-9ed5-090aeb24407e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:34.106179 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876baa0b-63b9-40a8-9ed5-090aeb24407e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:34.153931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-876baa0b-63b9-40a8-9ed5-090aeb24407e None None] MFA Rules not processed for user `4e8c2119269a4b79a880b4adf78c1dec`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:34.155604 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-876baa0b-63b9-40a8-9ed5-090aeb24407e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:34.229779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-8517dbd9-6b76-44a9-a041-3d9d4147d618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16664960592647fabf5eb63daa8d763c', 'request_id': 'req-8517dbd9-6b76-44a9-a041-3d9d4147d618'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:34.253753 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-8517dbd9-6b76-44a9-a041-3d9d4147d618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16664960592647fabf5eb63daa8d763c', 'request_id': 'req-8517dbd9-6b76-44a9-a041-3d9d4147d618'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:34.272667 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-8517dbd9-6b76-44a9-a041-3d9d4147d618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16664960592647fabf5eb63daa8d763c', 'request_id': 'req-8517dbd9-6b76-44a9-a041-3d9d4147d618'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:34.304127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-8517dbd9-6b76-44a9-a041-3d9d4147d618 admin admin] The token cache is being invalidate because project 16664960592647fabf5eb63daa8d763c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:48:34.304925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-8517dbd9-6b76-44a9-a041-3d9d4147d618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:34.308413 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-8517dbd9-6b76-44a9-a041-3d9d4147d618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:34.314916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 876/1741] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:48:33 2022] DELETE /identity/v3/projects/16664960592647fabf5eb63daa8d763c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:34.320528 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517dbd9-6b76-44a9-a041-3d9d4147d618 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:34.323933 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-8517dbd9-6b76-44a9-a041-3d9d4147d618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:34.352124 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 866/1742] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:34.353553 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c7b15-3141-46fb-b982-ddaefa465228 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:34.353844 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c7b15-3141-46fb-b982-ddaefa465228 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:34.354125 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c7b15-3141-46fb-b982-ddaefa465228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:34.395939 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-c72c7b15-3141-46fb-b982-ddaefa465228 None None] MFA Rules not processed for user `ceb44c6507d844b5a2e2b3ccfa64bdd2`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:34.397233 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c72c7b15-3141-46fb-b982-ddaefa465228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:34.419735 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:34.492655 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:34.528304 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 867/1743] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:34.529137 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c7b15-3141-46fb-b982-ddaefa465228 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:34.534360 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c72c7b15-3141-46fb-b982-ddaefa465228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:34.548562 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517dbd9-6b76-44a9-a041-3d9d4147d618 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:34.567868 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824799d-b029-4d8a-9414-1fef9d18a1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:34.568957 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824799d-b029-4d8a-9414-1fef9d18a1b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:34.569327 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824799d-b029-4d8a-9414-1fef9d18a1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:34.569436 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824799d-b029-4d8a-9414-1fef9d18a1b3 admin admin] PATH_INFO: `/v3/projects/46610073d4534cf3a265639a51dc3170/users/a6990a425b6945b6a7a1a3640d2a7321/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:34.607495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824799d-b029-4d8a-9414-1fef9d18a1b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46610073d4534cf3a265639a51dc3170, user_id=a6990a425b6945b6a7a1a3640d2a7321, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:34.610254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824799d-b029-4d8a-9414-1fef9d18a1b3 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:34.634375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 877/1744] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:34 2022] PUT /identity/v3/projects/46610073d4534cf3a265639a51dc3170/users/a6990a425b6945b6a7a1a3640d2a7321/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:34.635877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6073b5e-8bc0-4249-b5f4-4ba9b63afccf None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:34.638860 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6073b5e-8bc0-4249-b5f4-4ba9b63afccf None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:34.639305 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6073b5e-8bc0-4249-b5f4-4ba9b63afccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:34.674227 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c7b15-3141-46fb-b982-ddaefa465228 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:34.695062 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-e6073b5e-8bc0-4249-b5f4-4ba9b63afccf None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:34.697512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e6073b5e-8bc0-4249-b5f4-4ba9b63afccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:34.762036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ac123-fef9-4212-ba24-0dcd59b19efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:34.763020 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ac123-fef9-4212-ba24-0dcd59b19efd service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:34.763513 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ac123-fef9-4212-ba24-0dcd59b19efd service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:34.764007 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ac123-fef9-4212-ba24-0dcd59b19efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:34.768300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-492ac123-fef9-4212-ba24-0dcd59b19efd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:34.784643 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ac123-fef9-4212-ba24-0dcd59b19efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:34.786800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ac123-fef9-4212-ba24-0dcd59b19efd service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:34.788915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 878/1745] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:34.789624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6073b5e-8bc0-4249-b5f4-4ba9b63afccf None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:34.791722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e6073b5e-8bc0-4249-b5f4-4ba9b63afccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:34.813190 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 868/1746] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:34.814598 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ac123-fef9-4212-ba24-0dcd59b19efd service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:34.817631 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-492ac123-fef9-4212-ba24-0dcd59b19efd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:34.866765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ac123-fef9-4212-ba24-0dcd59b19efd service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:34.882509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d661ad5-c6fb-403d-bdab-388d74150daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:34.884852 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d661ad5-c6fb-403d-bdab-388d74150daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:34.885273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d661ad5-c6fb-403d-bdab-388d74150daa admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:34.888963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d661ad5-c6fb-403d-bdab-388d74150daa admin admin] PATH_INFO: `/v3/projects/fb774134acd348a0be749da7b29fb0b5` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:34.891562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d661ad5-c6fb-403d-bdab-388d74150daa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb774134acd348a0be749da7b29fb0b5)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:34.893848 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d661ad5-c6fb-403d-bdab-388d74150daa admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:34.941525 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6073b5e-8bc0-4249-b5f4-4ba9b63afccf None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:34.957516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2cf5c-1410-4e16-9701-aef4b0fb79a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:34.960291 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2cf5c-1410-4e16-9701-aef4b0fb79a8 service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:34.960291 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2cf5c-1410-4e16-9701-aef4b0fb79a8 service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:34.962871 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2cf5c-1410-4e16-9701-aef4b0fb79a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:34.979145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-3d661ad5-c6fb-403d-bdab-388d74150daa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb774134acd348a0be749da7b29fb0b5', 'request_id': 'req-3d661ad5-c6fb-403d-bdab-388d74150daa'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:34.993853 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-3d661ad5-c6fb-403d-bdab-388d74150daa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb774134acd348a0be749da7b29fb0b5', 'request_id': 'req-3d661ad5-c6fb-403d-bdab-388d74150daa'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:35.010639 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-3d661ad5-c6fb-403d-bdab-388d74150daa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb774134acd348a0be749da7b29fb0b5', 'request_id': 'req-3d661ad5-c6fb-403d-bdab-388d74150daa'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:35.034937 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-3d661ad5-c6fb-403d-bdab-388d74150daa admin admin] The token cache is being invalidate because project fb774134acd348a0be749da7b29fb0b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:48:35.035240 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-3d661ad5-c6fb-403d-bdab-388d74150daa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:35.037210 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-3d661ad5-c6fb-403d-bdab-388d74150daa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:35.039336 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 869/1747] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:48:34 2022] DELETE /identity/v3/projects/fb774134acd348a0be749da7b29fb0b5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:35.046457 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159b282-55e6-4b70-b220-73c7f2a02541 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:35.046746 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159b282-55e6-4b70-b220-73c7f2a02541 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:35.047035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159b282-55e6-4b70-b220-73c7f2a02541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:35.065559 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:35.101841 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2cf5c-1410-4e16-9701-aef4b0fb79a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:35.106340 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2cf5c-1410-4e16-9701-aef4b0fb79a8 service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:35.115938 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-8159b282-55e6-4b70-b220-73c7f2a02541 None None] MFA Rules not processed for user `a6990a425b6945b6a7a1a3640d2a7321`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:35.117188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-8159b282-55e6-4b70-b220-73c7f2a02541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:35.128575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 879/1748] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:35.129957 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68580e3b-beb0-4b31-80c8-a8a370688f88 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:35.130249 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68580e3b-beb0-4b31-80c8-a8a370688f88 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:35.130530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68580e3b-beb0-4b31-80c8-a8a370688f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:35.146564 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:35.185430 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-68580e3b-beb0-4b31-80c8-a8a370688f88 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:35.187941 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-68580e3b-beb0-4b31-80c8-a8a370688f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:35.228972 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 870/1749] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:35.232367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159b282-55e6-4b70-b220-73c7f2a02541 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:35.235391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-8159b282-55e6-4b70-b220-73c7f2a02541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:35.334362 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 880/1750] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:35.335342 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68580e3b-beb0-4b31-80c8-a8a370688f88 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:35.341857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-68580e3b-beb0-4b31-80c8-a8a370688f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:35.363375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68580e3b-beb0-4b31-80c8-a8a370688f88 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:35.379576 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431932ed-e08f-427c-9515-5704f53cbe2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:35.381420 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431932ed-e08f-427c-9515-5704f53cbe2f admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:35.381420 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431932ed-e08f-427c-9515-5704f53cbe2f admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:35.381420 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431932ed-e08f-427c-9515-5704f53cbe2f admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:35.381784 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431932ed-e08f-427c-9515-5704f53cbe2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:35.386673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431932ed-e08f-427c-9515-5704f53cbe2f admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:35.391006 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159b282-55e6-4b70-b220-73c7f2a02541 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:35.409167 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a76eb-ee16-43ad-be7b-8b8701c69129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:35.410196 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a76eb-ee16-43ad-be7b-8b8701c69129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:35.410979 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a76eb-ee16-43ad-be7b-8b8701c69129 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:35.411404 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a76eb-ee16-43ad-be7b-8b8701c69129 admin admin] PATH_INFO: `/v3/users/c28082a902294fe7aee0704e7ce2c308` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:35.413914 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a76eb-ee16-43ad-be7b-8b8701c69129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c28082a902294fe7aee0704e7ce2c308)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:35.416737 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a76eb-ee16-43ad-be7b-8b8701c69129 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:35.447380 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 881/1751] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:35 2022] POST /identity/v3/projects => generated 403 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:35.447380 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431932ed-e08f-427c-9515-5704f53cbe2f admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:35.545915 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-be0a76eb-ee16-43ad-be7b-8b8701c69129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c28082a902294fe7aee0704e7ce2c308'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:35.571788 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-be0a76eb-ee16-43ad-be7b-8b8701c69129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c28082a902294fe7aee0704e7ce2c308'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:35.620484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-be0a76eb-ee16-43ad-be7b-8b8701c69129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c28082a902294fe7aee0704e7ce2c308'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:35.639535 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-be0a76eb-ee16-43ad-be7b-8b8701c69129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c28082a902294fe7aee0704e7ce2c308'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:35.640659 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-be0a76eb-ee16-43ad-be7b-8b8701c69129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c28082a902294fe7aee0704e7ce2c308'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:35.686026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 871/1752] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:48:35 2022] DELETE /identity/v3/users/c28082a902294fe7aee0704e7ce2c308 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:35.686312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431932ed-e08f-427c-9515-5704f53cbe2f admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:35.687953 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a76eb-ee16-43ad-be7b-8b8701c69129 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:35.694482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-be0a76eb-ee16-43ad-be7b-8b8701c69129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:35.867133 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:35.890760 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165fdcf-118d-44c0-9ad7-0085eae3ad03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:35.893100 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165fdcf-118d-44c0-9ad7-0085eae3ad03 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:35.893403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165fdcf-118d-44c0-9ad7-0085eae3ad03 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:35.893721 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165fdcf-118d-44c0-9ad7-0085eae3ad03 admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:35.896028 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165fdcf-118d-44c0-9ad7-0085eae3ad03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:48:35.897485 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165fdcf-118d-44c0-9ad7-0085eae3ad03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:35.901810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165fdcf-118d-44c0-9ad7-0085eae3ad03 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:35.982180 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 882/1753] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 530 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:48:35.983477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165fdcf-118d-44c0-9ad7-0085eae3ad03 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:35.991113 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-2165fdcf-118d-44c0-9ad7-0085eae3ad03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:35.995837 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a76eb-ee16-43ad-be7b-8b8701c69129 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:36.007054 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:36.013637 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987f37a-10c0-42e5-b189-11ff264879ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:36.014380 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987f37a-10c0-42e5-b189-11ff264879ff service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:36.014664 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987f37a-10c0-42e5-b189-11ff264879ff service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:36.015010 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987f37a-10c0-42e5-b189-11ff264879ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:36.018084 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c987f37a-10c0-42e5-b189-11ff264879ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:36.019295 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165fdcf-118d-44c0-9ad7-0085eae3ad03 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:36.035552 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ba2b2-e4e4-4a99-9e12-4ceb85e26f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:36.036493 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ba2b2-e4e4-4a99-9e12-4ceb85e26f1a admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:36.036774 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ba2b2-e4e4-4a99-9e12-4ceb85e26f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:36.037044 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ba2b2-e4e4-4a99-9e12-4ceb85e26f1a admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:36.037822 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ba2b2-e4e4-4a99-9e12-4ceb85e26f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:36.041474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ba2b2-e4e4-4a99-9e12-4ceb85e26f1a admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:36.105594 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 883/1754] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:35 2022] POST /identity/v3/users => generated 308 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:36.107023 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ba2b2-e4e4-4a99-9e12-4ceb85e26f1a admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:36.108824 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-ea6ba2b2-e4e4-4a99-9e12-4ceb85e26f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:36.226371 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987f37a-10c0-42e5-b189-11ff264879ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:36.229610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987f37a-10c0-42e5-b189-11ff264879ff service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:36.257879 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 872/1755] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:36.262265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed2222-b6ea-42e2-a71f-6a333fd08a22 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:36.265710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed2222-b6ea-42e2-a71f-6a333fd08a22 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:36.266229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed2222-b6ea-42e2-a71f-6a333fd08a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:36.326787 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-0eed2222-b6ea-42e2-a71f-6a333fd08a22 None None] MFA Rules not processed for user `c1a2b827eaad4e2784613fa4a54c2c44`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:36.331253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-0eed2222-b6ea-42e2-a71f-6a333fd08a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:36.450498 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ba2b2-e4e4-4a99-9e12-4ceb85e26f1a admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:36.480092 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa283efe-ed54-4e33-9704-51eb0ea4e6dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04843ec31eb84585944c7a2b9cd1c0cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:36.480931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa283efe-ed54-4e33-9704-51eb0ea4e6dd service placement] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:36.481217 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa283efe-ed54-4e33-9704-51eb0ea4e6dd service placement] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:36.481497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa283efe-ed54-4e33-9704-51eb0ea4e6dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:36.486104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-aa283efe-ed54-4e33-9704-51eb0ea4e6dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:36.499292 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 873/1756] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:36.504666 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed2222-b6ea-42e2-a71f-6a333fd08a22 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:36.512176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-0eed2222-b6ea-42e2-a71f-6a333fd08a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:36.532585 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa283efe-ed54-4e33-9704-51eb0ea4e6dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:36.534515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa283efe-ed54-4e33-9704-51eb0ea4e6dd service placement] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:36.548379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed2222-b6ea-42e2-a71f-6a333fd08a22 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:36.558384 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7067102-8619-45d7-965e-a6bf490353e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:36.559420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7067102-8619-45d7-965e-a6bf490353e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:36.559810 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7067102-8619-45d7-965e-a6bf490353e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:36.561926 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7067102-8619-45d7-965e-a6bf490353e7 admin admin] PATH_INFO: `/v3/users/7ffda534597d4afdbfb531221f743ea5` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:36.564947 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7067102-8619-45d7-965e-a6bf490353e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ffda534597d4afdbfb531221f743ea5)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:36.567066 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7067102-8619-45d7-965e-a6bf490353e7 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:36.572157 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 884/1757] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:36.602690 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa283efe-ed54-4e33-9704-51eb0ea4e6dd service placement] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:36.612897 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-aa283efe-ed54-4e33-9704-51eb0ea4e6dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:36.685478 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa283efe-ed54-4e33-9704-51eb0ea4e6dd service placement] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:36.692966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-f7067102-8619-45d7-965e-a6bf490353e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ffda534597d4afdbfb531221f743ea5'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:36.698093 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b9beb-3481-4e09-a5de-0cc9f1bc071c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:36.698777 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b9beb-3481-4e09-a5de-0cc9f1bc071c admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:36.699063 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b9beb-3481-4e09-a5de-0cc9f1bc071c admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:36.700143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b9beb-3481-4e09-a5de-0cc9f1bc071c admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:36.700861 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b9beb-3481-4e09-a5de-0cc9f1bc071c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:36.702783 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b9beb-3481-4e09-a5de-0cc9f1bc071c admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:36.703207 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-f7067102-8619-45d7-965e-a6bf490353e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ffda534597d4afdbfb531221f743ea5'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:36.718224 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-f7067102-8619-45d7-965e-a6bf490353e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ffda534597d4afdbfb531221f743ea5'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:36.720647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:36.730828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-f7067102-8619-45d7-965e-a6bf490353e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ffda534597d4afdbfb531221f743ea5'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:36.733600 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-f7067102-8619-45d7-965e-a6bf490353e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ffda534597d4afdbfb531221f743ea5'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:36.750640 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 874/1758] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:48:36 2022] DELETE /identity/v3/users/7ffda534597d4afdbfb531221f743ea5 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:36.751905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7067102-8619-45d7-965e-a6bf490353e7 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:36.753870 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-f7067102-8619-45d7-965e-a6bf490353e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:36.772895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 885/1759] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:36 2022] POST /identity/v3/projects => generated 357 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:36.773909 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b9beb-3481-4e09-a5de-0cc9f1bc071c admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:36.781661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e96b9beb-3481-4e09-a5de-0cc9f1bc071c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:36.919303 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7067102-8619-45d7-965e-a6bf490353e7 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:36.924715 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b9beb-3481-4e09-a5de-0cc9f1bc071c admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:36.934677 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67576e-5109-4333-91dc-2bb82b800199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:36.935686 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67576e-5109-4333-91dc-2bb82b800199 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:36.936124 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67576e-5109-4333-91dc-2bb82b800199 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:36.936516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0267834-522a-4c0e-a567-5456ffa50a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:36.936764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67576e-5109-4333-91dc-2bb82b800199 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:36.937610 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0267834-522a-4c0e-a567-5456ffa50a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:36.937817 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67576e-5109-4333-91dc-2bb82b800199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:36.938065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0267834-522a-4c0e-a567-5456ffa50a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:36.938408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0267834-522a-4c0e-a567-5456ffa50a88 admin admin] PATH_INFO: `/v3/projects/f2e2e893440c471ebeec9e342306cda4` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:36.940081 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0267834-522a-4c0e-a567-5456ffa50a88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2e2e893440c471ebeec9e342306cda4)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:36.940918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67576e-5109-4333-91dc-2bb82b800199 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:36.942953 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0267834-522a-4c0e-a567-5456ffa50a88 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:36.966789 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 875/1760] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:36.971029 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b30a8d-65a9-47c5-997e-a3cfe9ced4db None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:36.975085 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b30a8d-65a9-47c5-997e-a3cfe9ced4db None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:36.975623 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b30a8d-65a9-47c5-997e-a3cfe9ced4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:37.018589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-53b30a8d-65a9-47c5-997e-a3cfe9ced4db None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:37.020410 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-53b30a8d-65a9-47c5-997e-a3cfe9ced4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:37.035121 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 876/1761] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:37.036814 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b30a8d-65a9-47c5-997e-a3cfe9ced4db None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:37.039099 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-53b30a8d-65a9-47c5-997e-a3cfe9ced4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:37.054531 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b30a8d-65a9-47c5-997e-a3cfe9ced4db None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:37.071119 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b0267834-522a-4c0e-a567-5456ffa50a88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2e2e893440c471ebeec9e342306cda4', 'request_id': 'req-b0267834-522a-4c0e-a567-5456ffa50a88'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:37.082328 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:37.100840 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b0267834-522a-4c0e-a567-5456ffa50a88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2e2e893440c471ebeec9e342306cda4', 'request_id': 'req-b0267834-522a-4c0e-a567-5456ffa50a88'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:37.137927 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b0267834-522a-4c0e-a567-5456ffa50a88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2e2e893440c471ebeec9e342306cda4', 'request_id': 'req-b0267834-522a-4c0e-a567-5456ffa50a88'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:37.160121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b0267834-522a-4c0e-a567-5456ffa50a88 admin admin] The token cache is being invalidate because project f2e2e893440c471ebeec9e342306cda4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:48:37.160851 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b0267834-522a-4c0e-a567-5456ffa50a88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:37.161907 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b0267834-522a-4c0e-a567-5456ffa50a88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:37.164399 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 886/1762] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:48:36 2022] DELETE /identity/v3/projects/f2e2e893440c471ebeec9e342306cda4 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:37.165494 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0267834-522a-4c0e-a567-5456ffa50a88 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:37.170608 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b0267834-522a-4c0e-a567-5456ffa50a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:37.221140 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848be092-f56a-48e6-8546-ca09da012f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:37.221342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848be092-f56a-48e6-8546-ca09da012f94 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:37.222941 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848be092-f56a-48e6-8546-ca09da012f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:37.223229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848be092-f56a-48e6-8546-ca09da012f94 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:37.227309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848be092-f56a-48e6-8546-ca09da012f94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:37.255225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848be092-f56a-48e6-8546-ca09da012f94 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:37.337707 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 877/1763] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:37 2022] POST /identity/v3/users => generated 279 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:37.337707 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848be092-f56a-48e6-8546-ca09da012f94 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:37.340400 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-848be092-f56a-48e6-8546-ca09da012f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:37.345267 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0267834-522a-4c0e-a567-5456ffa50a88 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:37.374744 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9a913-2e2a-435d-835a-1637a5ba441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:37.376110 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9a913-2e2a-435d-835a-1637a5ba441e admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:37.376399 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9a913-2e2a-435d-835a-1637a5ba441e admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:37.376677 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9a913-2e2a-435d-835a-1637a5ba441e admin admin] PATH_INFO: `/v3/projects/84856a6c37874be08882b939e404d2b2/users/e68afe9c609b45dbbb4d516501f57055/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:37.438302 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9a913-2e2a-435d-835a-1637a5ba441e admin admin] RBAC: Authorizing `identity:create_grant(project_id=84856a6c37874be08882b939e404d2b2, user_id=e68afe9c609b45dbbb4d516501f57055, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:37.443669 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9a913-2e2a-435d-835a-1637a5ba441e admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:37.466833 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 887/1764] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:37 2022] PUT /identity/v3/projects/84856a6c37874be08882b939e404d2b2/users/e68afe9c609b45dbbb4d516501f57055/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:37.468272 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae373c-4a23-46a3-abe0-474e9f997b04 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:37.468557 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae373c-4a23-46a3-abe0-474e9f997b04 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:37.468888 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae373c-4a23-46a3-abe0-474e9f997b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:37.524306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-1eae373c-4a23-46a3-abe0-474e9f997b04 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:37.528891 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-1eae373c-4a23-46a3-abe0-474e9f997b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:37.537211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848be092-f56a-48e6-8546-ca09da012f94 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:37.630368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:37.711629 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bd3ac-e442-40d4-ba66-772375eb16b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:37.714851 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bd3ac-e442-40d4-ba66-772375eb16b7 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:37.715457 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bd3ac-e442-40d4-ba66-772375eb16b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:37.715930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bd3ac-e442-40d4-ba66-772375eb16b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:37.721011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-662bd3ac-e442-40d4-ba66-772375eb16b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:37.734282 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 888/1765] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:37.735422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae373c-4a23-46a3-abe0-474e9f997b04 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:37.736792 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-1eae373c-4a23-46a3-abe0-474e9f997b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:37.751305 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae373c-4a23-46a3-abe0-474e9f997b04 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:37.758860 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71def52e-d7b4-4a9b-b3c3-884d5cd545af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:37.760120 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71def52e-d7b4-4a9b-b3c3-884d5cd545af admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:37.760509 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71def52e-d7b4-4a9b-b3c3-884d5cd545af admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:37.760940 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71def52e-d7b4-4a9b-b3c3-884d5cd545af admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:37.762059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71def52e-d7b4-4a9b-b3c3-884d5cd545af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:37.766445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71def52e-d7b4-4a9b-b3c3-884d5cd545af admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:37.796298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bd3ac-e442-40d4-ba66-772375eb16b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:37.798762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 889/1766] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:37.800333 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bd3ac-e442-40d4-ba66-772375eb16b7 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:37.800831 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84922d-1f78-48b4-ac8d-e5986e73e1ae None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:37.801126 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84922d-1f78-48b4-ac8d-e5986e73e1ae None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:37.801432 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84922d-1f78-48b4-ac8d-e5986e73e1ae None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:37.803570 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 890/1767] 10.222.0.77 () {54 vars in 912 bytes} [Tue Jul 19 20:48:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:48:37.805731 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84922d-1f78-48b4-ac8d-e5986e73e1ae None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:37.847069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84922d-1f78-48b4-ac8d-e5986e73e1ae None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:37.850034 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 878/1768] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:37.855433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8e90d-dc89-48ba-a221-eca152bbf434 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:37.855959 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8e90d-dc89-48ba-a221-eca152bbf434 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:37.856738 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e8e90d-dc89-48ba-a221-eca152bbf434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:37.864889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f969a-3949-4558-ab7d-cf9ebb6d87b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:37.866430 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f969a-3949-4558-ab7d-cf9ebb6d87b9 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:37.870700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f969a-3949-4558-ab7d-cf9ebb6d87b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:37.871286 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f969a-3949-4558-ab7d-cf9ebb6d87b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:37.872554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f969a-3949-4558-ab7d-cf9ebb6d87b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:37.875971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f969a-3949-4558-ab7d-cf9ebb6d87b9 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:37.923856 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-e9e8e90d-dc89-48ba-a221-eca152bbf434 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:37.925113 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e9e8e90d-dc89-48ba-a221-eca152bbf434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:37.926903 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 891/1769] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:37.932242 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f969a-3949-4558-ab7d-cf9ebb6d87b9 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:37.958038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 879/1770] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:37.961770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc777a3-2728-44f8-bbe3-02486a648cec None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:37.961770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc777a3-2728-44f8-bbe3-02486a648cec None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:37.961770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc777a3-2728-44f8-bbe3-02486a648cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:37.964753 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f969a-3949-4558-ab7d-cf9ebb6d87b9 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:37.981866 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544486d-2077-4136-a58c-aed408e834e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:37.982561 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544486d-2077-4136-a58c-aed408e834e8 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:37.986165 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544486d-2077-4136-a58c-aed408e834e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:37.986674 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544486d-2077-4136-a58c-aed408e834e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:37.988265 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544486d-2077-4136-a58c-aed408e834e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:37.993451 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544486d-2077-4136-a58c-aed408e834e8 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:38.016126 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-5fc777a3-2728-44f8-bbe3-02486a648cec None None] MFA Rules not processed for user `5b2c0f24d666462aa14ea4eee0592062`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:38.017450 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-5fc777a3-2728-44f8-bbe3-02486a648cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:38.030509 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 892/1771] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:38.030509 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544486d-2077-4136-a58c-aed408e834e8 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:38.045500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 880/1772] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jul 19 20:48:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:38.046371 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc777a3-2728-44f8-bbe3-02486a648cec None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:38.057729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544486d-2077-4136-a58c-aed408e834e8 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:38.074122 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f812c-1e39-409e-bf52-2f2e1d590ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:38.075945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc777a3-2728-44f8-bbe3-02486a648cec None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:38.076100 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f812c-1e39-409e-bf52-2f2e1d590ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:38.076353 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f812c-1e39-409e-bf52-2f2e1d590ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:38.076637 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f812c-1e39-409e-bf52-2f2e1d590ed2 admin admin] PATH_INFO: `/v3/projects/84856a6c37874be08882b939e404d2b2/users/e68afe9c609b45dbbb4d516501f57055/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:38.084645 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f812c-1e39-409e-bf52-2f2e1d590ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84856a6c37874be08882b939e404d2b2, user_id=e68afe9c609b45dbbb4d516501f57055, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:38.089249 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a2e6d-69cd-4df7-aa4b-d63763780e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:38.089937 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a2e6d-69cd-4df7-aa4b-d63763780e46 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:38.090942 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f812c-1e39-409e-bf52-2f2e1d590ed2 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:38.095078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a2e6d-69cd-4df7-aa4b-d63763780e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:38.095678 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a2e6d-69cd-4df7-aa4b-d63763780e46 admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:38.096389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a2e6d-69cd-4df7-aa4b-d63763780e46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:48:38.096706 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a2e6d-69cd-4df7-aa4b-d63763780e46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:38.100184 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a2e6d-69cd-4df7-aa4b-d63763780e46 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:38.128577 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 893/1773] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:38 2022] PUT /identity/v3/projects/84856a6c37874be08882b939e404d2b2/users/e68afe9c609b45dbbb4d516501f57055/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:38.129597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f812c-1e39-409e-bf52-2f2e1d590ed2 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:38.142786 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 881/1774] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:48:38.144280 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a2e6d-69cd-4df7-aa4b-d63763780e46 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:38.152001 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a17a2e6d-69cd-4df7-aa4b-d63763780e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:38.188545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a2e6d-69cd-4df7-aa4b-d63763780e46 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:38.213445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:38.348233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f812c-1e39-409e-bf52-2f2e1d590ed2 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:38.377840 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118aa73-c7a9-4bbb-b363-99b0a9c117cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:38.378882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118aa73-c7a9-4bbb-b363-99b0a9c117cb admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:38.381722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118aa73-c7a9-4bbb-b363-99b0a9c117cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:38.381877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118aa73-c7a9-4bbb-b363-99b0a9c117cb admin admin] PATH_INFO: `/v3/projects/b99ee5c978604197a594027fc6c0ef30/users/0647a9fe0e5d401cab913507d995bafd/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:38.427096 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aa28d-1bd1-401c-b021-cecabee4ba63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:38.427514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aa28d-1bd1-401c-b021-cecabee4ba63 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:38.427797 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aa28d-1bd1-401c-b021-cecabee4ba63 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:38.428074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aa28d-1bd1-401c-b021-cecabee4ba63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:38.437402 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118aa73-c7a9-4bbb-b363-99b0a9c117cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b99ee5c978604197a594027fc6c0ef30, user_id=0647a9fe0e5d401cab913507d995bafd, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:38.441038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118aa73-c7a9-4bbb-b363-99b0a9c117cb admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:38.453445 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461aa28d-1bd1-401c-b021-cecabee4ba63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:38.464315 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461aa28d-1bd1-401c-b021-cecabee4ba63 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:38.480120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 882/1775] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:38.481603 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42ab71-d23d-4790-a4e7-e65333fe757c None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:38.481771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42ab71-d23d-4790-a4e7-e65333fe757c None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:38.482794 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 894/1776] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:38 2022] PUT /identity/v3/projects/b99ee5c978604197a594027fc6c0ef30/users/0647a9fe0e5d401cab913507d995bafd/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:38.486299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118aa73-c7a9-4bbb-b363-99b0a9c117cb admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:38.492584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42ab71-d23d-4790-a4e7-e65333fe757c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:38.604732 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-5b42ab71-d23d-4790-a4e7-e65333fe757c None None] MFA Rules not processed for user `e68afe9c609b45dbbb4d516501f57055`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:38.605988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-5b42ab71-d23d-4790-a4e7-e65333fe757c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:38.757829 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118aa73-c7a9-4bbb-b363-99b0a9c117cb admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:38.764143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b868bf-6ea7-4b43-9e55-98c69904aee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:38.765351 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b868bf-6ea7-4b43-9e55-98c69904aee5 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:38.765703 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b868bf-6ea7-4b43-9e55-98c69904aee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:38.766056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b868bf-6ea7-4b43-9e55-98c69904aee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:38.773111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b868bf-6ea7-4b43-9e55-98c69904aee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:38.775883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b868bf-6ea7-4b43-9e55-98c69904aee5 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:38.810628 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 895/1777] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:38 2022] POST /identity/v3/projects => generated 369 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:38.813166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5f9ae-e3be-48a0-8379-184c47dffeed None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:38.813166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5f9ae-e3be-48a0-8379-184c47dffeed None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:38.813368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5f9ae-e3be-48a0-8379-184c47dffeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:38.833764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 883/1778] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:38 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:38.835080 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42ab71-d23d-4790-a4e7-e65333fe757c None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:38.858720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42ab71-d23d-4790-a4e7-e65333fe757c None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:38.871238 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-1ad5f9ae-e3be-48a0-8379-184c47dffeed None None] MFA Rules not processed for user `0647a9fe0e5d401cab913507d995bafd`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:38.873150 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-1ad5f9ae-e3be-48a0-8379-184c47dffeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:38.943531 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:38.977998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 896/1779] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:38 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:38.979306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5f9ae-e3be-48a0-8379-184c47dffeed None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:38.980898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-1ad5f9ae-e3be-48a0-8379-184c47dffeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:39.012287 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94569547-9d83-4912-9ffe-e283f606b596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:39.019243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94569547-9d83-4912-9ffe-e283f606b596 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:39.019873 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94569547-9d83-4912-9ffe-e283f606b596 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:39.020380 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94569547-9d83-4912-9ffe-e283f606b596 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:39.024526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:39.025011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94569547-9d83-4912-9ffe-e283f606b596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:39.027491 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94569547-9d83-4912-9ffe-e283f606b596 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:39.062869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 884/1780] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:38 2022] POST /identity/v3/users => generated 285 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:39.063963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94569547-9d83-4912-9ffe-e283f606b596 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:39.083791 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94569547-9d83-4912-9ffe-e283f606b596 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:39.090719 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56afd4-468f-4ad9-bc63-5ed2573ab1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:39.091203 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56afd4-468f-4ad9-bc63-5ed2573ab1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:39.091609 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56afd4-468f-4ad9-bc63-5ed2573ab1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:39.092004 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56afd4-468f-4ad9-bc63-5ed2573ab1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:39.092858 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56afd4-468f-4ad9-bc63-5ed2573ab1a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:39.094940 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56afd4-468f-4ad9-bc63-5ed2573ab1a8 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:39.135293 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5f9ae-e3be-48a0-8379-184c47dffeed None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:39.145359 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784eca6f-d9d6-4f59-941f-d051147e6c6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:39.146278 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784eca6f-d9d6-4f59-941f-d051147e6c6f service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:39.146710 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784eca6f-d9d6-4f59-941f-d051147e6c6f service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:39.147159 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784eca6f-d9d6-4f59-941f-d051147e6c6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:39.193496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 885/1781] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:39 2022] POST /identity/v3/projects => generated 355 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:39.194064 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56afd4-468f-4ad9-bc63-5ed2573ab1a8 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:39.259385 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784eca6f-d9d6-4f59-941f-d051147e6c6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:39.263460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784eca6f-d9d6-4f59-941f-d051147e6c6f service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:39.294237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 897/1782] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:38 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:39.295496 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784eca6f-d9d6-4f59-941f-d051147e6c6f service cinder] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:39.331579 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784eca6f-d9d6-4f59-941f-d051147e6c6f service cinder] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:39.553562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56afd4-468f-4ad9-bc63-5ed2573ab1a8 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:39.567695 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f2036-9665-41a5-a7e1-f3443dc69275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:39.595356 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f2036-9665-41a5-a7e1-f3443dc69275 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:39.595680 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f2036-9665-41a5-a7e1-f3443dc69275 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:39.598329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f2036-9665-41a5-a7e1-f3443dc69275 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:39.599020 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f2036-9665-41a5-a7e1-f3443dc69275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:39.613012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f2036-9665-41a5-a7e1-f3443dc69275 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:39.618902 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ffed5-0041-4641-aca8-000a397b5da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:39.624278 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ffed5-0041-4641-aca8-000a397b5da6 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:39.624571 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ffed5-0041-4641-aca8-000a397b5da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:39.631810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ffed5-0041-4641-aca8-000a397b5da6 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:39.640409 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 886/1783] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:39.641975 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f2036-9665-41a5-a7e1-f3443dc69275 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:39.643145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ffed5-0041-4641-aca8-000a397b5da6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:39.661080 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ffed5-0041-4641-aca8-000a397b5da6 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:39.694900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f2036-9665-41a5-a7e1-f3443dc69275 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:39.707999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 898/1784] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:39 2022] POST /identity/v3/users => generated 284 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:39.708982 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ffed5-0041-4641-aca8-000a397b5da6 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:39.716595 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402db38f-4969-42f4-b71c-644124a14ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:39.717288 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402db38f-4969-42f4-b71c-644124a14ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:39.717573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402db38f-4969-42f4-b71c-644124a14ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:39.721390 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402db38f-4969-42f4-b71c-644124a14ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:39.722214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402db38f-4969-42f4-b71c-644124a14ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:39.730267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402db38f-4969-42f4-b71c-644124a14ea3 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:39.732112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ffed5-0041-4641-aca8-000a397b5da6 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:39.742805 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d330b7-ba4b-4cf9-8034-0d23fdf43afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:39.744505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d330b7-ba4b-4cf9-8034-0d23fdf43afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:39.744934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d330b7-ba4b-4cf9-8034-0d23fdf43afa admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:39.745403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d330b7-ba4b-4cf9-8034-0d23fdf43afa admin admin] PATH_INFO: `/v3/users/a6990a425b6945b6a7a1a3640d2a7321` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:39.747389 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d330b7-ba4b-4cf9-8034-0d23fdf43afa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6990a425b6945b6a7a1a3640d2a7321)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:39.749794 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d330b7-ba4b-4cf9-8034-0d23fdf43afa admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:39.771826 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 887/1785] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:39.772783 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402db38f-4969-42f4-b71c-644124a14ea3 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:39.807608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402db38f-4969-42f4-b71c-644124a14ea3 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:39.822803 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a68092-ce8e-4ff1-a401-02316689d08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:39.823848 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a68092-ce8e-4ff1-a401-02316689d08f admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:39.824083 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a68092-ce8e-4ff1-a401-02316689d08f admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:39.824357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a68092-ce8e-4ff1-a401-02316689d08f admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:39.825097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a68092-ce8e-4ff1-a401-02316689d08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:39.833707 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a68092-ce8e-4ff1-a401-02316689d08f admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:39.866821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e5d330b7-ba4b-4cf9-8034-0d23fdf43afa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6990a425b6945b6a7a1a3640d2a7321'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:39.875305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 888/1786] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:39.876023 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a68092-ce8e-4ff1-a401-02316689d08f admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:39.885911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:39.900166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a68092-ce8e-4ff1-a401-02316689d08f admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:39.906408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e5d330b7-ba4b-4cf9-8034-0d23fdf43afa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6990a425b6945b6a7a1a3640d2a7321'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:39.914667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8f673-1064-489e-bce0-11a96b38f1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:39.918793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8f673-1064-489e-bce0-11a96b38f1d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:39.919077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8f673-1064-489e-bce0-11a96b38f1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:39.919683 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8f673-1064-489e-bce0-11a96b38f1d3 admin admin] PATH_INFO: `/v3/projects/c4005127a8694b2ea8d4fa603c265a34/users/b95e16f0fa6d4aee9c95a913372fc465/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:39.934641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e5d330b7-ba4b-4cf9-8034-0d23fdf43afa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6990a425b6945b6a7a1a3640d2a7321'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:39.935723 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e5d330b7-ba4b-4cf9-8034-0d23fdf43afa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6990a425b6945b6a7a1a3640d2a7321'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:39.945969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e5d330b7-ba4b-4cf9-8034-0d23fdf43afa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6990a425b6945b6a7a1a3640d2a7321'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:39.956461 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 899/1787] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:48:39 2022] DELETE /identity/v3/users/a6990a425b6945b6a7a1a3640d2a7321 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:39.958209 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8f673-1064-489e-bce0-11a96b38f1d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4005127a8694b2ea8d4fa603c265a34, user_id=b95e16f0fa6d4aee9c95a913372fc465, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:39.959734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d330b7-ba4b-4cf9-8034-0d23fdf43afa admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:39.961771 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e5d330b7-ba4b-4cf9-8034-0d23fdf43afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:39.964930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd8f673-1064-489e-bce0-11a96b38f1d3 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:40.000512 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 889/1788] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:39 2022] PUT /identity/v3/projects/c4005127a8694b2ea8d4fa603c265a34/users/b95e16f0fa6d4aee9c95a913372fc465/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:40.000512 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8f673-1064-489e-bce0-11a96b38f1d3 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:40.000512 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-4bd8f673-1064-489e-bce0-11a96b38f1d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:40.115674 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:40.133746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d330b7-ba4b-4cf9-8034-0d23fdf43afa admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:40.148863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8f673-1064-489e-bce0-11a96b38f1d3 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:40.151788 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857edceb-198c-499d-b95e-70c21c54f8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:40.152772 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857edceb-198c-499d-b95e-70c21c54f8e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:40.154826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857edceb-198c-499d-b95e-70c21c54f8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:40.154964 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a98167-8964-46af-a7ce-f1f0d887c7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:40.155350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857edceb-198c-499d-b95e-70c21c54f8e0 admin admin] PATH_INFO: `/v3/projects/352fd14468284a729a7c183db081144a` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:40.156156 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a98167-8964-46af-a7ce-f1f0d887c7fd admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:40.156469 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a98167-8964-46af-a7ce-f1f0d887c7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:40.156749 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a98167-8964-46af-a7ce-f1f0d887c7fd admin admin] PATH_INFO: `/v3/projects/313efbb69fb34a008ce618b269773f29/users/bb513893f1f24b87bfb40b05de52abe2/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:40.162138 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857edceb-198c-499d-b95e-70c21c54f8e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=352fd14468284a729a7c183db081144a)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:40.169486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857edceb-198c-499d-b95e-70c21c54f8e0 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:40.185947 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a98167-8964-46af-a7ce-f1f0d887c7fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=313efbb69fb34a008ce618b269773f29, user_id=bb513893f1f24b87bfb40b05de52abe2, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:40.189943 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a98167-8964-46af-a7ce-f1f0d887c7fd admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:40.218904 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 890/1789] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:39 2022] PUT /identity/v3/projects/313efbb69fb34a008ce618b269773f29/users/bb513893f1f24b87bfb40b05de52abe2/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:40.218904 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311d561-161f-42d9-8439-67022622145d None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:40.219359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311d561-161f-42d9-8439-67022622145d None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:40.219480 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311d561-161f-42d9-8439-67022622145d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:40.256393 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-c311d561-161f-42d9-8439-67022622145d None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:40.257913 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c311d561-161f-42d9-8439-67022622145d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:40.294171 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-857edceb-198c-499d-b95e-70c21c54f8e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '352fd14468284a729a7c183db081144a', 'request_id': 'req-857edceb-198c-499d-b95e-70c21c54f8e0'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:40.306270 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-857edceb-198c-499d-b95e-70c21c54f8e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '352fd14468284a729a7c183db081144a', 'request_id': 'req-857edceb-198c-499d-b95e-70c21c54f8e0'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:40.319537 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-857edceb-198c-499d-b95e-70c21c54f8e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '352fd14468284a729a7c183db081144a', 'request_id': 'req-857edceb-198c-499d-b95e-70c21c54f8e0'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:40.342836 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-857edceb-198c-499d-b95e-70c21c54f8e0 admin admin] The token cache is being invalidate because project 352fd14468284a729a7c183db081144a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:48:40.343967 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-857edceb-198c-499d-b95e-70c21c54f8e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:40.344753 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-857edceb-198c-499d-b95e-70c21c54f8e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:40.367945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 900/1790] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:48:39 2022] DELETE /identity/v3/projects/352fd14468284a729a7c183db081144a => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:40.370827 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84054572-e0e2-4672-9132-7796f1571bbc None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:40.371115 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84054572-e0e2-4672-9132-7796f1571bbc None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:40.371422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84054572-e0e2-4672-9132-7796f1571bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:40.427757 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 891/1791] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:40.429780 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76ce8e-a760-4b65-b19f-8dba27e95154 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:40.430571 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76ce8e-a760-4b65-b19f-8dba27e95154 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:40.431188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76ce8e-a760-4b65-b19f-8dba27e95154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:40.462023 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-bf76ce8e-a760-4b65-b19f-8dba27e95154 None None] MFA Rules not processed for user `4e8c2119269a4b79a880b4adf78c1dec`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:40.464107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-bf76ce8e-a760-4b65-b19f-8dba27e95154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:40.464288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-84054572-e0e2-4672-9132-7796f1571bbc None None] MFA Rules not processed for user `b95e16f0fa6d4aee9c95a913372fc465`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:40.467544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-84054572-e0e2-4672-9132-7796f1571bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:40.580113 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:40.598434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 892/1792] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:40.600575 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76ce8e-a760-4b65-b19f-8dba27e95154 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:40.602390 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-bf76ce8e-a760-4b65-b19f-8dba27e95154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:40.611831 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 901/1793] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:40.612821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84054572-e0e2-4672-9132-7796f1571bbc None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:40.614195 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-84054572-e0e2-4672-9132-7796f1571bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:40.666993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76ce8e-a760-4b65-b19f-8dba27e95154 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:40.675936 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd2d51-6a35-42a0-af82-862983fac4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:40.676986 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd2d51-6a35-42a0-af82-862983fac4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:40.677501 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd2d51-6a35-42a0-af82-862983fac4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:40.677979 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd2d51-6a35-42a0-af82-862983fac4b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:40.679856 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd2d51-6a35-42a0-af82-862983fac4b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:40.682424 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd2d51-6a35-42a0-af82-862983fac4b4 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:40.693184 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84054572-e0e2-4672-9132-7796f1571bbc None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:40.697540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 893/1794] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:40.702946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd2d51-6a35-42a0-af82-862983fac4b4 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:40.705342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d5dd2d51-6a35-42a0-af82-862983fac4b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:40.711976 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e18ae6-0a1c-431c-a592-addad221044e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:40.713591 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e18ae6-0a1c-431c-a592-addad221044e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:40.713893 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e18ae6-0a1c-431c-a592-addad221044e admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:40.714175 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e18ae6-0a1c-431c-a592-addad221044e admin admin] PATH_INFO: `/v3/users/2018635935f34c25a85780ceda1c2f9f` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:40.716833 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e18ae6-0a1c-431c-a592-addad221044e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2018635935f34c25a85780ceda1c2f9f)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:40.723454 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e18ae6-0a1c-431c-a592-addad221044e admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:40.849543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-71e18ae6-0a1c-431c-a592-addad221044e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2018635935f34c25a85780ceda1c2f9f'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:40.868005 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-71e18ae6-0a1c-431c-a592-addad221044e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2018635935f34c25a85780ceda1c2f9f'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:40.904474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-71e18ae6-0a1c-431c-a592-addad221044e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2018635935f34c25a85780ceda1c2f9f'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:40.905235 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-71e18ae6-0a1c-431c-a592-addad221044e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2018635935f34c25a85780ceda1c2f9f'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:40.926107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd2d51-6a35-42a0-af82-862983fac4b4 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:40.933976 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-71e18ae6-0a1c-431c-a592-addad221044e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2018635935f34c25a85780ceda1c2f9f'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:40.948092 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02fa17-637d-4b75-845e-3c7fc49cede9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:40.949895 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02fa17-637d-4b75-845e-3c7fc49cede9 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:40.953226 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02fa17-637d-4b75-845e-3c7fc49cede9 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:40.957285 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02fa17-637d-4b75-845e-3c7fc49cede9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:40.958614 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 902/1795] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:48:40 2022] DELETE /identity/v3/users/2018635935f34c25a85780ceda1c2f9f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:40.962523 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e18ae6-0a1c-431c-a592-addad221044e admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:40.964165 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-71e18ae6-0a1c-431c-a592-addad221044e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:40.973796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ba02fa17-637d-4b75-845e-3c7fc49cede9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:41.038343 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02fa17-637d-4b75-845e-3c7fc49cede9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:41.042797 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02fa17-637d-4b75-845e-3c7fc49cede9 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:41.115723 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 894/1796] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:41.118063 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02fa17-637d-4b75-845e-3c7fc49cede9 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:41.131427 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ba02fa17-637d-4b75-845e-3c7fc49cede9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:41.193043 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e18ae6-0a1c-431c-a592-addad221044e admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:41.206118 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeac27a-40e0-43dd-bcb3-2a0a6d662953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:41.208829 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeac27a-40e0-43dd-bcb3-2a0a6d662953 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:41.210288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeac27a-40e0-43dd-bcb3-2a0a6d662953 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:41.210612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeac27a-40e0-43dd-bcb3-2a0a6d662953 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:41.212717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02fa17-637d-4b75-845e-3c7fc49cede9 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:41.213741 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeac27a-40e0-43dd-bcb3-2a0a6d662953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:41.217787 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeac27a-40e0-43dd-bcb3-2a0a6d662953 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:41.238378 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a0e12-50ac-4ed8-9d23-a10cf725cd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:41.258823 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a0e12-50ac-4ed8-9d23-a10cf725cd9d admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:41.262463 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a0e12-50ac-4ed8-9d23-a10cf725cd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:41.264589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a0e12-50ac-4ed8-9d23-a10cf725cd9d admin admin] PATH_INFO: `/v3/projects/313efbb69fb34a008ce618b269773f29/users/bb513893f1f24b87bfb40b05de52abe2/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:41.272809 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a0e12-50ac-4ed8-9d23-a10cf725cd9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=313efbb69fb34a008ce618b269773f29, user_id=bb513893f1f24b87bfb40b05de52abe2, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:41.284915 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6a0e12-50ac-4ed8-9d23-a10cf725cd9d admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:41.295764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 903/1797] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:40 2022] POST /identity/v3/projects => generated 369 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:41.296271 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeac27a-40e0-43dd-bcb3-2a0a6d662953 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:41.301385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:41.333451 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 895/1798] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:41 2022] PUT /identity/v3/projects/313efbb69fb34a008ce618b269773f29/users/bb513893f1f24b87bfb40b05de52abe2/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:41.360317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b1ea9-641f-483a-9f89-86894f390168 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:41.364853 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b1ea9-641f-483a-9f89-86894f390168 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:41.365986 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b1ea9-641f-483a-9f89-86894f390168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:41.480095 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:41.497746 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-3b1b1ea9-641f-483a-9f89-86894f390168 None None] MFA Rules not processed for user `bb513893f1f24b87bfb40b05de52abe2`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:41.500930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3b1b1ea9-641f-483a-9f89-86894f390168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:41.518702 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeac27a-40e0-43dd-bcb3-2a0a6d662953 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:41.637663 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 896/1799] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:41 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:41.664936 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b1ea9-641f-483a-9f89-86894f390168 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:41.666451 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3b1b1ea9-641f-483a-9f89-86894f390168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:41.679541 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2f88a-a246-4528-9328-6f5e796ef1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:41.680286 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2f88a-a246-4528-9328-6f5e796ef1f8 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:41.681196 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2f88a-a246-4528-9328-6f5e796ef1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:41.682712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2f88a-a246-4528-9328-6f5e796ef1f8 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:41.684619 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2f88a-a246-4528-9328-6f5e796ef1f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:41.689325 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2f88a-a246-4528-9328-6f5e796ef1f8 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:41.733956 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 904/1800] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:41 2022] POST /identity/v3/users => generated 291 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:48:41.736440 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2f88a-a246-4528-9328-6f5e796ef1f8 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:41.766812 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2f88a-a246-4528-9328-6f5e796ef1f8 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:41.779159 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b1ea9-641f-483a-9f89-86894f390168 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:41.797148 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f01cd-69ed-4dbc-baad-0500a894bff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:41.797859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f01cd-69ed-4dbc-baad-0500a894bff1 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:41.798149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f01cd-69ed-4dbc-baad-0500a894bff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:41.798308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea571c3b-16ef-4297-92b5-2527ab7d3664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:41.798432 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f01cd-69ed-4dbc-baad-0500a894bff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:41.799024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea571c3b-16ef-4297-92b5-2527ab7d3664 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:41.799518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea571c3b-16ef-4297-92b5-2527ab7d3664 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:41.799834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea571c3b-16ef-4297-92b5-2527ab7d3664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:41.803065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f01cd-69ed-4dbc-baad-0500a894bff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:41.807944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f01cd-69ed-4dbc-baad-0500a894bff1 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:41.813653 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea571c3b-16ef-4297-92b5-2527ab7d3664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:41.817523 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea571c3b-16ef-4297-92b5-2527ab7d3664 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:41.832937 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 905/1801] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:41.838121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f01cd-69ed-4dbc-baad-0500a894bff1 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:41.852007 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 897/1802] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:41 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:48:41.861699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f01cd-69ed-4dbc-baad-0500a894bff1 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:41.875719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35a889-bb59-4391-98d6-ce59e22728e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:41.878952 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35a889-bb59-4391-98d6-ce59e22728e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:41.879285 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35a889-bb59-4391-98d6-ce59e22728e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:41.881808 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35a889-bb59-4391-98d6-ce59e22728e6 admin admin] PATH_INFO: `/v3/projects/a793008284b348d0949c98bd30d034a9/users/eb661303671f4b0db166e3cea1635aa1/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:41.939994 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35a889-bb59-4391-98d6-ce59e22728e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a793008284b348d0949c98bd30d034a9, user_id=eb661303671f4b0db166e3cea1635aa1, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:41.946063 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35a889-bb59-4391-98d6-ce59e22728e6 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:41.971644 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea571c3b-16ef-4297-92b5-2527ab7d3664 service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:41.980661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 906/1803] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:41 2022] PUT /identity/v3/projects/a793008284b348d0949c98bd30d034a9/users/eb661303671f4b0db166e3cea1635aa1/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:41.981766 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35a889-bb59-4391-98d6-ce59e22728e6 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:41.990152 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea571c3b-16ef-4297-92b5-2527ab7d3664 service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:42.194415 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76774e2-f33f-43ab-ad1d-b4e6fb239e9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:42.195462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76774e2-f33f-43ab-ad1d-b4e6fb239e9e service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:42.196121 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76774e2-f33f-43ab-ad1d-b4e6fb239e9e service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:42.197211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76774e2-f33f-43ab-ad1d-b4e6fb239e9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:42.199538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c76774e2-f33f-43ab-ad1d-b4e6fb239e9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:42.267790 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35a889-bb59-4391-98d6-ce59e22728e6 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:42.284606 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:42.288131 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac803db-cc1f-4c35-b3e5-9fdce5f72465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:42.291401 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac803db-cc1f-4c35-b3e5-9fdce5f72465 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:42.291783 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac803db-cc1f-4c35-b3e5-9fdce5f72465 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:42.292484 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac803db-cc1f-4c35-b3e5-9fdce5f72465 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:42.294198 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac803db-cc1f-4c35-b3e5-9fdce5f72465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:42.299918 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac803db-cc1f-4c35-b3e5-9fdce5f72465 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:42.328832 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 907/1804] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:42.329834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac803db-cc1f-4c35-b3e5-9fdce5f72465 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:42.332113 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-2ac803db-cc1f-4c35-b3e5-9fdce5f72465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:42.344937 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76774e2-f33f-43ab-ad1d-b4e6fb239e9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:42.346612 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76774e2-f33f-43ab-ad1d-b4e6fb239e9e service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:42.353584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac803db-cc1f-4c35-b3e5-9fdce5f72465 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:42.363741 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 898/1805] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:41 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:48:42.365633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c71b86-55aa-4166-8863-f9c34d23faca None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:42.365793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c71b86-55aa-4166-8863-f9c34d23faca None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:42.366234 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c71b86-55aa-4166-8863-f9c34d23faca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:42.378971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af47c9-171c-4cd2-ab1d-143d12587e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:42.386205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af47c9-171c-4cd2-ab1d-143d12587e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:42.386463 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af47c9-171c-4cd2-ab1d-143d12587e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:42.386743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af47c9-171c-4cd2-ab1d-143d12587e8c admin admin] PATH_INFO: `/v3/projects/e36b7ab7524644d58be0061565832e60` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:42.393401 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af47c9-171c-4cd2-ab1d-143d12587e8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e36b7ab7524644d58be0061565832e60)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:42.400197 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af47c9-171c-4cd2-ab1d-143d12587e8c admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:42.590316 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-38c71b86-55aa-4166-8863-f9c34d23faca None None] MFA Rules not processed for user `c8f314167aa94d81955ac761a5a28504`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:42.592741 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-38c71b86-55aa-4166-8863-f9c34d23faca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:42.607642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:42.647533 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-92af47c9-171c-4cd2-ab1d-143d12587e8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e36b7ab7524644d58be0061565832e60', 'request_id': 'req-92af47c9-171c-4cd2-ab1d-143d12587e8c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:42.684831 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-92af47c9-171c-4cd2-ab1d-143d12587e8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e36b7ab7524644d58be0061565832e60', 'request_id': 'req-92af47c9-171c-4cd2-ab1d-143d12587e8c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:42.710884 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-92af47c9-171c-4cd2-ab1d-143d12587e8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e36b7ab7524644d58be0061565832e60', 'request_id': 'req-92af47c9-171c-4cd2-ab1d-143d12587e8c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:42.761674 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-92af47c9-171c-4cd2-ab1d-143d12587e8c admin admin] The token cache is being invalidate because project e36b7ab7524644d58be0061565832e60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:48:42.766437 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-92af47c9-171c-4cd2-ab1d-143d12587e8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:42.770067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-92af47c9-171c-4cd2-ab1d-143d12587e8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:42.781099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 908/1806] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:48:42 2022] DELETE /identity/v3/projects/e36b7ab7524644d58be0061565832e60 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:42.786349 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af47c9-171c-4cd2-ab1d-143d12587e8c admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:42.793771 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-92af47c9-171c-4cd2-ab1d-143d12587e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:42.875243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 899/1807] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jul 19 20:48:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:42.877131 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cf1b4-8493-48f0-b457-ab5e114f5544 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:42.877572 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cf1b4-8493-48f0-b457-ab5e114f5544 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:42.878094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0cf1b4-8493-48f0-b457-ab5e114f5544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:42.955096 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-1a0cf1b4-8493-48f0-b457-ab5e114f5544 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:42.965604 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-1a0cf1b4-8493-48f0-b457-ab5e114f5544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:43.006298 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af47c9-171c-4cd2-ab1d-143d12587e8c admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:43.020381 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9e8a4-c647-42e9-8457-0af0a23b28aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:43.022237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9e8a4-c647-42e9-8457-0af0a23b28aa admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:43.022692 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9e8a4-c647-42e9-8457-0af0a23b28aa admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:43.023604 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9e8a4-c647-42e9-8457-0af0a23b28aa admin admin] PATH_INFO: `/v3/projects/a793008284b348d0949c98bd30d034a9/users/eb661303671f4b0db166e3cea1635aa1/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:43.032159 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9e8a4-c647-42e9-8457-0af0a23b28aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a793008284b348d0949c98bd30d034a9, user_id=eb661303671f4b0db166e3cea1635aa1, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:43.046210 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f9e8a4-c647-42e9-8457-0af0a23b28aa admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:43.089794 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 909/1808] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:42 2022] PUT /identity/v3/projects/a793008284b348d0949c98bd30d034a9/users/eb661303671f4b0db166e3cea1635aa1/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:43.099046 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c831e1-eb96-44e8-acec-65eb8c9af951 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:43.099498 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c831e1-eb96-44e8-acec-65eb8c9af951 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:43.099900 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c831e1-eb96-44e8-acec-65eb8c9af951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:43.165327 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-c1c831e1-eb96-44e8-acec-65eb8c9af951 None None] MFA Rules not processed for user `eb661303671f4b0db166e3cea1635aa1`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:43.166505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-c1c831e1-eb96-44e8-acec-65eb8c9af951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:43.208912 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 900/1809] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:43.213726 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cf1b4-8493-48f0-b457-ab5e114f5544 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:43.221447 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-1a0cf1b4-8493-48f0-b457-ab5e114f5544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:43.332164 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:43.380008 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 910/1810] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:43 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:48:43.383524 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98d043-52c8-45bb-b9b4-e039666d00d1 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:43.383524 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98d043-52c8-45bb-b9b4-e039666d00d1 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:43.383836 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98d043-52c8-45bb-b9b4-e039666d00d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:43.426579 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0cf1b4-8493-48f0-b457-ab5e114f5544 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:43.436006 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-ca98d043-52c8-45bb-b9b4-e039666d00d1 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:43.437332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-ca98d043-52c8-45bb-b9b4-e039666d00d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:43.524712 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62ea24-d493-434f-8465-0f366ddf362d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7987846276ad4ccd90899128ceb1354e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:43.525711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62ea24-d493-434f-8465-0f366ddf362d service swift] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:43.526004 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62ea24-d493-434f-8465-0f366ddf362d service swift] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:43.526304 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62ea24-d493-434f-8465-0f366ddf362d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:43.612447 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62ea24-d493-434f-8465-0f366ddf362d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:43.612447 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62ea24-d493-434f-8465-0f366ddf362d service swift] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:43.614368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:43.630663 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 901/1811] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jul 19 20:48:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 20:48:43.647865 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62ea24-d493-434f-8465-0f366ddf362d service swift] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:43.653842 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-cd62ea24-d493-434f-8465-0f366ddf362d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:43.678964 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 911/1812] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:43.685921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98d043-52c8-45bb-b9b4-e039666d00d1 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:43.709663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98d043-52c8-45bb-b9b4-e039666d00d1 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:43.734456 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2218f5-c46b-4168-a8ae-f68e216477bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:43.735523 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2218f5-c46b-4168-a8ae-f68e216477bf admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:43.735957 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2218f5-c46b-4168-a8ae-f68e216477bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:43.736383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2218f5-c46b-4168-a8ae-f68e216477bf admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:43.737296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2218f5-c46b-4168-a8ae-f68e216477bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:48:43.739570 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2218f5-c46b-4168-a8ae-f68e216477bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:43.741385 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2218f5-c46b-4168-a8ae-f68e216477bf admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:43.776313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 912/1813] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:48:43.780258 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2218f5-c46b-4168-a8ae-f68e216477bf admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:43.806023 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2218f5-c46b-4168-a8ae-f68e216477bf admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:43.826263 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39c2a3-139f-4046-a518-4ca03b08b685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:43.826937 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39c2a3-139f-4046-a518-4ca03b08b685 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:43.827222 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39c2a3-139f-4046-a518-4ca03b08b685 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:43.827722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39c2a3-139f-4046-a518-4ca03b08b685 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:43.828439 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39c2a3-139f-4046-a518-4ca03b08b685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:43.830638 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39c2a3-139f-4046-a518-4ca03b08b685 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:43.860967 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62ea24-d493-434f-8465-0f366ddf362d service swift] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:43.871533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e27255-792e-401a-b551-331bc1dbd08e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:43.872089 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e27255-792e-401a-b551-331bc1dbd08e service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:43.872377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e27255-792e-401a-b551-331bc1dbd08e service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:43.872709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e27255-792e-401a-b551-331bc1dbd08e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:43.916647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e27255-792e-401a-b551-331bc1dbd08e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:43.918102 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e27255-792e-401a-b551-331bc1dbd08e service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:43.921495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 913/1814] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:43 2022] POST /identity/v3/projects => generated 407 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:43.931767 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39c2a3-139f-4046-a518-4ca03b08b685 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:43.936622 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 902/1815] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:43 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:44.072355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e27255-792e-401a-b551-331bc1dbd08e service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:44.078955 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-56e27255-792e-401a-b551-331bc1dbd08e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:44.099109 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39c2a3-139f-4046-a518-4ca03b08b685 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:44.113241 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bc9b7-00b1-4d4c-b322-e799ab533010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:44.115716 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bc9b7-00b1-4d4c-b322-e799ab533010 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:44.116254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bc9b7-00b1-4d4c-b322-e799ab533010 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:44.119817 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703bc9b7-00b1-4d4c-b322-e799ab533010 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:44.122403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703bc9b7-00b1-4d4c-b322-e799ab533010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:44.126391 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703bc9b7-00b1-4d4c-b322-e799ab533010 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:44.146777 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e27255-792e-401a-b551-331bc1dbd08e service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:44.186768 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11356948-83a3-4b6d-8a9a-66acf23a4cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:44.194153 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11356948-83a3-4b6d-8a9a-66acf23a4cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:44.194703 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11356948-83a3-4b6d-8a9a-66acf23a4cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:44.198926 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11356948-83a3-4b6d-8a9a-66acf23a4cd8 admin admin] PATH_INFO: `/v3/users/0617f9a3c9ff4de481f43596527811b3` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:44.201390 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 914/1816] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:43 2022] POST /identity/v3/users => generated 304 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:44.203190 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11356948-83a3-4b6d-8a9a-66acf23a4cd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0617f9a3c9ff4de481f43596527811b3)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:44.204029 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bc9b7-00b1-4d4c-b322-e799ab533010 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:44.218227 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11356948-83a3-4b6d-8a9a-66acf23a4cd8 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:44.274261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:44.401760 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703bc9b7-00b1-4d4c-b322-e799ab533010 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:44.413144 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-11356948-83a3-4b6d-8a9a-66acf23a4cd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0617f9a3c9ff4de481f43596527811b3'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:44.436906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-11356948-83a3-4b6d-8a9a-66acf23a4cd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0617f9a3c9ff4de481f43596527811b3'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:44.443724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3d613-ec66-4f2a-b4a3-9a0050efe110 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:44.445013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3d613-ec66-4f2a-b4a3-9a0050efe110 service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:44.445633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3d613-ec66-4f2a-b4a3-9a0050efe110 service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:44.446888 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3d613-ec66-4f2a-b4a3-9a0050efe110 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:44.453365 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-c6d3d613-ec66-4f2a-b4a3-9a0050efe110 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:44.478432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-11356948-83a3-4b6d-8a9a-66acf23a4cd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0617f9a3c9ff4de481f43596527811b3'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:44.490801 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-11356948-83a3-4b6d-8a9a-66acf23a4cd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0617f9a3c9ff4de481f43596527811b3'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:44.491763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-11356948-83a3-4b6d-8a9a-66acf23a4cd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0617f9a3c9ff4de481f43596527811b3'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:44.517061 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 903/1817] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:48:44 2022] DELETE /identity/v3/users/0617f9a3c9ff4de481f43596527811b3 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:48:44.520128 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11356948-83a3-4b6d-8a9a-66acf23a4cd8 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:44.524415 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-11356948-83a3-4b6d-8a9a-66acf23a4cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:44.696841 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:44.712914 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3d613-ec66-4f2a-b4a3-9a0050efe110 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:44.714449 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3d613-ec66-4f2a-b4a3-9a0050efe110 service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:44.737847 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11356948-83a3-4b6d-8a9a-66acf23a4cd8 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:44.753392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33151b-9cd9-4c70-9c4e-c77401081ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:44.754158 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33151b-9cd9-4c70-9c4e-c77401081ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:44.754500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33151b-9cd9-4c70-9c4e-c77401081ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:44.754843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33151b-9cd9-4c70-9c4e-c77401081ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:44.756170 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33151b-9cd9-4c70-9c4e-c77401081ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:44.757589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 915/1818] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:44.759108 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21449f-effe-4fd2-b8d5-868dc2e70bd3 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:44.759437 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21449f-effe-4fd2-b8d5-868dc2e70bd3 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:44.759720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21449f-effe-4fd2-b8d5-868dc2e70bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:44.760512 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33151b-9cd9-4c70-9c4e-c77401081ac7 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:44.799282 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 904/1819] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:44.800297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33151b-9cd9-4c70-9c4e-c77401081ac7 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:44.830623 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33151b-9cd9-4c70-9c4e-c77401081ac7 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:44.848767 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-9f21449f-effe-4fd2-b8d5-868dc2e70bd3 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:44.851120 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9f21449f-effe-4fd2-b8d5-868dc2e70bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:44.853436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34297423-12de-4bd4-958d-fa2f84d15790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:44.854993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34297423-12de-4bd4-958d-fa2f84d15790 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:44.855935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34297423-12de-4bd4-958d-fa2f84d15790 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:44.856373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34297423-12de-4bd4-958d-fa2f84d15790 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:44.859398 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34297423-12de-4bd4-958d-fa2f84d15790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:44.863086 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34297423-12de-4bd4-958d-fa2f84d15790 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:44.876357 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 916/1820] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:44.891627 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21449f-effe-4fd2-b8d5-868dc2e70bd3 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:44.899393 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 905/1821] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:44.905286 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21449f-effe-4fd2-b8d5-868dc2e70bd3 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:44.922377 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f1647-6aff-4d99-b70e-64f4ecf053fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:44.923780 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f1647-6aff-4d99-b70e-64f4ecf053fc admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:44.926797 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f1647-6aff-4d99-b70e-64f4ecf053fc admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:44.926797 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f1647-6aff-4d99-b70e-64f4ecf053fc admin admin] PATH_INFO: `/v3/projects/261c36f7fb894e1ab4516a65b4f7e1d3/users/a31c0b64f2e14e3d82ea5367474f504e/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:44.957519 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34297423-12de-4bd4-958d-fa2f84d15790 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:44.960602 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-34297423-12de-4bd4-958d-fa2f84d15790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:44.979423 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f1647-6aff-4d99-b70e-64f4ecf053fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=261c36f7fb894e1ab4516a65b4f7e1d3, user_id=a31c0b64f2e14e3d82ea5367474f504e, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:44.995928 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f1647-6aff-4d99-b70e-64f4ecf053fc admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:45.063966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 917/1822] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:44 2022] PUT /identity/v3/projects/261c36f7fb894e1ab4516a65b4f7e1d3/users/a31c0b64f2e14e3d82ea5367474f504e/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:45.065857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f1647-6aff-4d99-b70e-64f4ecf053fc admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:45.068479 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b35f1647-6aff-4d99-b70e-64f4ecf053fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:45.276082 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34297423-12de-4bd4-958d-fa2f84d15790 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:45.309363 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f1647-6aff-4d99-b70e-64f4ecf053fc admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:45.325220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c3395-6fdf-4103-adea-e434e29530b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:45.331680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c3395-6fdf-4103-adea-e434e29530b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:45.331986 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c3395-6fdf-4103-adea-e434e29530b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:45.332274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c3395-6fdf-4103-adea-e434e29530b9 admin admin] PATH_INFO: `/v3/projects/46610073d4534cf3a265639a51dc3170` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:45.356036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c3395-6fdf-4103-adea-e434e29530b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46610073d4534cf3a265639a51dc3170)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:45.359835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c3395-6fdf-4103-adea-e434e29530b9 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:45.438436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:45.536532 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dc5eb-88ab-47d8-9619-2348ef8d4be2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:45.537237 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dc5eb-88ab-47d8-9619-2348ef8d4be2 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:45.537509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dc5eb-88ab-47d8-9619-2348ef8d4be2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:45.537784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dc5eb-88ab-47d8-9619-2348ef8d4be2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:45.547062 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a79c3395-6fdf-4103-adea-e434e29530b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46610073d4534cf3a265639a51dc3170', 'request_id': 'req-a79c3395-6fdf-4103-adea-e434e29530b9'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:45.576129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a79c3395-6fdf-4103-adea-e434e29530b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46610073d4534cf3a265639a51dc3170', 'request_id': 'req-a79c3395-6fdf-4103-adea-e434e29530b9'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:45.590432 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a79c3395-6fdf-4103-adea-e434e29530b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46610073d4534cf3a265639a51dc3170', 'request_id': 'req-a79c3395-6fdf-4103-adea-e434e29530b9'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:45.622808 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9dc5eb-88ab-47d8-9619-2348ef8d4be2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:45.628987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a79c3395-6fdf-4103-adea-e434e29530b9 admin admin] The token cache is being invalidate because project 46610073d4534cf3a265639a51dc3170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:48:45.629346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a79c3395-6fdf-4103-adea-e434e29530b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:45.631823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a79c3395-6fdf-4103-adea-e434e29530b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:45.653842 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 918/1823] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:48:45 2022] DELETE /identity/v3/projects/46610073d4534cf3a265639a51dc3170 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:45.656149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94460481-e3fe-4184-bcf9-087854a56c15 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:45.656428 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94460481-e3fe-4184-bcf9-087854a56c15 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:45.656698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94460481-e3fe-4184-bcf9-087854a56c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:45.688688 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9dc5eb-88ab-47d8-9619-2348ef8d4be2 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:45.756493 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 906/1824] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 799 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:45.760557 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dc5eb-88ab-47d8-9619-2348ef8d4be2 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:45.801094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-94460481-e3fe-4184-bcf9-087854a56c15 None None] MFA Rules not processed for user `a31c0b64f2e14e3d82ea5367474f504e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:45.816808 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dc5eb-88ab-47d8-9619-2348ef8d4be2 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:45.823674 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-94460481-e3fe-4184-bcf9-087854a56c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:45.982854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:46.100631 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 919/1825] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:45 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:46.103131 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94460481-e3fe-4184-bcf9-087854a56c15 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:46.111558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-94460481-e3fe-4184-bcf9-087854a56c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:46.195516 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facddf73-7f0f-4a01-919d-5dd3ed18cf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:46.201973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facddf73-7f0f-4a01-919d-5dd3ed18cf05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:46.202411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facddf73-7f0f-4a01-919d-5dd3ed18cf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:46.202657 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facddf73-7f0f-4a01-919d-5dd3ed18cf05 admin admin] PATH_INFO: `/v3/users/e68afe9c609b45dbbb4d516501f57055` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:46.213863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facddf73-7f0f-4a01-919d-5dd3ed18cf05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e68afe9c609b45dbbb4d516501f57055)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:46.228025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facddf73-7f0f-4a01-919d-5dd3ed18cf05 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:46.423368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94460481-e3fe-4184-bcf9-087854a56c15 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:46.443689 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141c2ab-be40-485e-971d-22594d51536a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:46.447401 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141c2ab-be40-485e-971d-22594d51536a admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:46.447979 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141c2ab-be40-485e-971d-22594d51536a admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:46.450211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141c2ab-be40-485e-971d-22594d51536a admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:46.451600 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141c2ab-be40-485e-971d-22594d51536a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:46.459978 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141c2ab-be40-485e-971d-22594d51536a admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:46.561641 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-facddf73-7f0f-4a01-919d-5dd3ed18cf05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e68afe9c609b45dbbb4d516501f57055'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:46.613585 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 920/1826] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:46 2022] POST /identity/v3/projects => generated 407 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:46.614962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141c2ab-be40-485e-971d-22594d51536a admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:46.619323 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-facddf73-7f0f-4a01-919d-5dd3ed18cf05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e68afe9c609b45dbbb4d516501f57055'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:46.698082 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-facddf73-7f0f-4a01-919d-5dd3ed18cf05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e68afe9c609b45dbbb4d516501f57055'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:46.722635 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-facddf73-7f0f-4a01-919d-5dd3ed18cf05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e68afe9c609b45dbbb4d516501f57055'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:46.724706 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-facddf73-7f0f-4a01-919d-5dd3ed18cf05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e68afe9c609b45dbbb4d516501f57055'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:46.785871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 907/1827] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:48:45 2022] DELETE /identity/v3/users/e68afe9c609b45dbbb4d516501f57055 => generated 0 bytes in 1023 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:46.913937 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e8e05-a33b-48ca-a81b-83c7935e172a None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:46.913937 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e8e05-a33b-48ca-a81b-83c7935e172a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:46.914412 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e8e05-a33b-48ca-a81b-83c7935e172a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:47.033363 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-e15e8e05-a33b-48ca-a81b-83c7935e172a None None] MFA Rules not processed for user `5b2c0f24d666462aa14ea4eee0592062`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:47.050280 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e15e8e05-a33b-48ca-a81b-83c7935e172a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:47.080306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141c2ab-be40-485e-971d-22594d51536a admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:47.311977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 908/1828] 10.222.0.81 () {58 vars in 1015 bytes} [Tue Jul 19 20:48:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:47.529250 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213927b-a0d8-4564-93e2-9036b2d4fe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:47.537785 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213927b-a0d8-4564-93e2-9036b2d4fe70 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:47.538150 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213927b-a0d8-4564-93e2-9036b2d4fe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:47.545096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213927b-a0d8-4564-93e2-9036b2d4fe70 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:47.551884 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213927b-a0d8-4564-93e2-9036b2d4fe70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:47.565767 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213927b-a0d8-4564-93e2-9036b2d4fe70 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:47.662572 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e8e05-a33b-48ca-a81b-83c7935e172a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:47.679131 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e15e8e05-a33b-48ca-a81b-83c7935e172a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:47.679131 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:47.705778 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e8e05-a33b-48ca-a81b-83c7935e172a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:47.719867 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 921/1829] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:46 2022] POST /identity/v3/users => generated 310 bytes in 1106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:47.724800 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213927b-a0d8-4564-93e2-9036b2d4fe70 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:47.725708 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fb701-e8be-4a43-8130-7f0fcb0d32aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:47.726395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fb701-e8be-4a43-8130-7f0fcb0d32aa service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:47.732237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-6213927b-a0d8-4564-93e2-9036b2d4fe70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:47.733689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fb701-e8be-4a43-8130-7f0fcb0d32aa service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:47.734093 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fb701-e8be-4a43-8130-7f0fcb0d32aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:47.775761 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213927b-a0d8-4564-93e2-9036b2d4fe70 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:47.796696 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe7c21-bbe3-4c58-98d3-de864c24d945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:47.797014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108fb701-e8be-4a43-8130-7f0fcb0d32aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:47.797701 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe7c21-bbe3-4c58-98d3-de864c24d945 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:47.798240 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe7c21-bbe3-4c58-98d3-de864c24d945 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:47.798387 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108fb701-e8be-4a43-8130-7f0fcb0d32aa service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:47.798693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe7c21-bbe3-4c58-98d3-de864c24d945 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:47.799705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe7c21-bbe3-4c58-98d3-de864c24d945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:47.802178 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe7c21-bbe3-4c58-98d3-de864c24d945 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:47.804474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:47.820895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 922/1830] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:47.824954 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe7c21-bbe3-4c58-98d3-de864c24d945 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:47.844167 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe7c21-bbe3-4c58-98d3-de864c24d945 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:47.850392 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ea456-496f-47ca-b0ab-fc4d11dc615f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:47.851520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ea456-496f-47ca-b0ab-fc4d11dc615f admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:47.851831 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ea456-496f-47ca-b0ab-fc4d11dc615f admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:47.852144 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ea456-496f-47ca-b0ab-fc4d11dc615f admin admin] PATH_INFO: `/v3/projects/348e2134424e42a291a8d8e45feb4e22/users/b3dec83d0eca4c85a55f6b9056da5557/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:47.856753 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 909/1831] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:47.876173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ea456-496f-47ca-b0ab-fc4d11dc615f admin admin] RBAC: Authorizing `identity:create_grant(project_id=348e2134424e42a291a8d8e45feb4e22, user_id=b3dec83d0eca4c85a55f6b9056da5557, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:47.879789 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ea456-496f-47ca-b0ab-fc4d11dc615f admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:47.932708 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 923/1832] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:47 2022] PUT /identity/v3/projects/348e2134424e42a291a8d8e45feb4e22/users/b3dec83d0eca4c85a55f6b9056da5557/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:48:47.937851 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fb701-e8be-4a43-8130-7f0fcb0d32aa service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:47.960284 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fb701-e8be-4a43-8130-7f0fcb0d32aa service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:48.116334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c68421-451b-4e46-9e22-02597b634c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:48.117041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c68421-451b-4e46-9e22-02597b634c30 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:48.117327 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c68421-451b-4e46-9e22-02597b634c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:48.118112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c68421-451b-4e46-9e22-02597b634c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:48.120499 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c68421-451b-4e46-9e22-02597b634c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:48.123891 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c68421-451b-4e46-9e22-02597b634c30 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:48.154135 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 910/1833] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:48.155934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ea456-496f-47ca-b0ab-fc4d11dc615f admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:48.167945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ea456-496f-47ca-b0ab-fc4d11dc615f admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:48.184141 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1925a53-3d27-4cec-b06e-433a66579508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:48.188043 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1925a53-3d27-4cec-b06e-433a66579508 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:48.188589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1925a53-3d27-4cec-b06e-433a66579508 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:48.189024 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1925a53-3d27-4cec-b06e-433a66579508 admin admin] PATH_INFO: `/v3/projects/348e2134424e42a291a8d8e45feb4e22/users/b3dec83d0eca4c85a55f6b9056da5557/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:48.191946 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1925a53-3d27-4cec-b06e-433a66579508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=348e2134424e42a291a8d8e45feb4e22, user_id=b3dec83d0eca4c85a55f6b9056da5557, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:48.194616 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1925a53-3d27-4cec-b06e-433a66579508 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:48.208955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 924/1834] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:48 2022] PUT /identity/v3/projects/348e2134424e42a291a8d8e45feb4e22/users/b3dec83d0eca4c85a55f6b9056da5557/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:48:48.219719 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747a4a0-330d-4837-87aa-14c0c90b6424 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:48.220032 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747a4a0-330d-4837-87aa-14c0c90b6424 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:48.220314 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747a4a0-330d-4837-87aa-14c0c90b6424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:48.290242 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-1747a4a0-330d-4837-87aa-14c0c90b6424 None None] MFA Rules not processed for user `b3dec83d0eca4c85a55f6b9056da5557`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:48.296002 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-1747a4a0-330d-4837-87aa-14c0c90b6424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:48.372832 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1925a53-3d27-4cec-b06e-433a66579508 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:48.374895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-f1925a53-3d27-4cec-b06e-433a66579508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:48.571922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1925a53-3d27-4cec-b06e-433a66579508 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:48.583846 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1343c-cba3-46db-8a6e-6866b563fdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:48.592254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1343c-cba3-46db-8a6e-6866b563fdb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:48.592639 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1343c-cba3-46db-8a6e-6866b563fdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:48.597256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1343c-cba3-46db-8a6e-6866b563fdb6 admin admin] PATH_INFO: `/v3/projects/f1f248ce7d2145bfa1b7f364f754d254` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:48.602822 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1343c-cba3-46db-8a6e-6866b563fdb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1f248ce7d2145bfa1b7f364f754d254)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:48.607970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af1343c-cba3-46db-8a6e-6866b563fdb6 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:48.637802 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 911/1835] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:48 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:48:48.660660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747a4a0-330d-4837-87aa-14c0c90b6424 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:48.666540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-1747a4a0-330d-4837-87aa-14c0c90b6424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:48.772924 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9af1343c-cba3-46db-8a6e-6866b563fdb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1f248ce7d2145bfa1b7f364f754d254', 'request_id': 'req-9af1343c-cba3-46db-8a6e-6866b563fdb6'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:48.792908 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9af1343c-cba3-46db-8a6e-6866b563fdb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1f248ce7d2145bfa1b7f364f754d254', 'request_id': 'req-9af1343c-cba3-46db-8a6e-6866b563fdb6'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:48.815329 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9af1343c-cba3-46db-8a6e-6866b563fdb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1f248ce7d2145bfa1b7f364f754d254', 'request_id': 'req-9af1343c-cba3-46db-8a6e-6866b563fdb6'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:48.844442 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9af1343c-cba3-46db-8a6e-6866b563fdb6 admin admin] The token cache is being invalidate because project f1f248ce7d2145bfa1b7f364f754d254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:48:48.845001 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9af1343c-cba3-46db-8a6e-6866b563fdb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:48.846065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9af1343c-cba3-46db-8a6e-6866b563fdb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:48.850863 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 925/1836] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:48:48 2022] DELETE /identity/v3/projects/f1f248ce7d2145bfa1b7f364f754d254 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:48.852057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1343c-cba3-46db-8a6e-6866b563fdb6 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:48.856515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9af1343c-cba3-46db-8a6e-6866b563fdb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:48.921246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747a4a0-330d-4837-87aa-14c0c90b6424 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:48.960929 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:48.965852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:49.012282 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af1343c-cba3-46db-8a6e-6866b563fdb6 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:49.021893 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a3379-0957-473f-8fae-b8b4d1ea2d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:49.022812 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a3379-0957-473f-8fae-b8b4d1ea2d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:49.023098 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a3379-0957-473f-8fae-b8b4d1ea2d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:49.025286 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a3379-0957-473f-8fae-b8b4d1ea2d53 admin admin] PATH_INFO: `/v3/users/df56c0591f5444b8bfd99b02691ce5c1` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:49.028200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a3379-0957-473f-8fae-b8b4d1ea2d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df56c0591f5444b8bfd99b02691ce5c1)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:49.030171 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a3379-0957-473f-8fae-b8b4d1ea2d53 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:49.034213 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f59571b-8a9d-4447-9759-70e42ab56899 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:49.035658 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59571b-8a9d-4447-9759-70e42ab56899 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:49.035948 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59571b-8a9d-4447-9759-70e42ab56899 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:49.036449 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59571b-8a9d-4447-9759-70e42ab56899 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:49.040387 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-5f59571b-8a9d-4447-9759-70e42ab56899 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:49.147762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b68a3379-0957-473f-8fae-b8b4d1ea2d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df56c0591f5444b8bfd99b02691ce5c1'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:49.169350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b68a3379-0957-473f-8fae-b8b4d1ea2d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df56c0591f5444b8bfd99b02691ce5c1'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:49.217163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b68a3379-0957-473f-8fae-b8b4d1ea2d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df56c0591f5444b8bfd99b02691ce5c1'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:49.220141 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b68a3379-0957-473f-8fae-b8b4d1ea2d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df56c0591f5444b8bfd99b02691ce5c1'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:49.240754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b68a3379-0957-473f-8fae-b8b4d1ea2d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df56c0591f5444b8bfd99b02691ce5c1'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:49.246681 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59571b-8a9d-4447-9759-70e42ab56899 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:49.248185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f59571b-8a9d-4447-9759-70e42ab56899 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:49.264141 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 926/1837] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:48:48 2022] DELETE /identity/v3/users/df56c0591f5444b8bfd99b02691ce5c1 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:49.265165 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a3379-0957-473f-8fae-b8b4d1ea2d53 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:49.268328 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b68a3379-0957-473f-8fae-b8b4d1ea2d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:49.285578 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 912/1838] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:48 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:49.499573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a3379-0957-473f-8fae-b8b4d1ea2d53 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:49.512995 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0e665-5f65-4fa6-b9f5-9077ef0740f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:49.515726 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0e665-5f65-4fa6-b9f5-9077ef0740f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:49.516518 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0e665-5f65-4fa6-b9f5-9077ef0740f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:49.516854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0e665-5f65-4fa6-b9f5-9077ef0740f7 admin admin] PATH_INFO: `/v3/projects/84856a6c37874be08882b939e404d2b2` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:49.522443 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0e665-5f65-4fa6-b9f5-9077ef0740f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84856a6c37874be08882b939e404d2b2)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:49.527605 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0e665-5f65-4fa6-b9f5-9077ef0740f7 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:49.681427 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-cbb0e665-5f65-4fa6-b9f5-9077ef0740f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84856a6c37874be08882b939e404d2b2', 'request_id': 'req-cbb0e665-5f65-4fa6-b9f5-9077ef0740f7'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:49.698964 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-cbb0e665-5f65-4fa6-b9f5-9077ef0740f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84856a6c37874be08882b939e404d2b2', 'request_id': 'req-cbb0e665-5f65-4fa6-b9f5-9077ef0740f7'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:49.714489 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-cbb0e665-5f65-4fa6-b9f5-9077ef0740f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84856a6c37874be08882b939e404d2b2', 'request_id': 'req-cbb0e665-5f65-4fa6-b9f5-9077ef0740f7'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:49.743300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:49.758341 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-cbb0e665-5f65-4fa6-b9f5-9077ef0740f7 admin admin] The token cache is being invalidate because project 84856a6c37874be08882b939e404d2b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:48:49.759248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-cbb0e665-5f65-4fa6-b9f5-9077ef0740f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:49.761182 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-cbb0e665-5f65-4fa6-b9f5-9077ef0740f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:49.767423 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 927/1839] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:48:49 2022] DELETE /identity/v3/projects/84856a6c37874be08882b939e404d2b2 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:49.772196 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62008d90-4b06-4002-9fed-29c0f108a9d8 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:49.772798 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62008d90-4b06-4002-9fed-29c0f108a9d8 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:49.772798 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62008d90-4b06-4002-9fed-29c0f108a9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:49.827225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-62008d90-4b06-4002-9fed-29c0f108a9d8 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:49.832475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-62008d90-4b06-4002-9fed-29c0f108a9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:50.099603 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0e665-5f65-4fa6-b9f5-9077ef0740f7 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:50.106433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-cbb0e665-5f65-4fa6-b9f5-9077ef0740f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:50.154565 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 913/1840] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:48:50.170964 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00911e-9bf7-4a38-ac12-08dde4a71c64 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:50.171342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00911e-9bf7-4a38-ac12-08dde4a71c64 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:50.171667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d00911e-9bf7-4a38-ac12-08dde4a71c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:50.202109 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-3d00911e-9bf7-4a38-ac12-08dde4a71c64 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:50.205746 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3d00911e-9bf7-4a38-ac12-08dde4a71c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:50.214764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0e665-5f65-4fa6-b9f5-9077ef0740f7 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:50.231291 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 914/1841] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:50.235056 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00911e-9bf7-4a38-ac12-08dde4a71c64 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:50.238400 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac0711-61fc-4f9f-aad4-82694d869cc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:50.241485 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac0711-61fc-4f9f-aad4-82694d869cc2 service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:50.243529 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac0711-61fc-4f9f-aad4-82694d869cc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:50.246200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac0711-61fc-4f9f-aad4-82694d869cc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:50.250770 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-bfac0711-61fc-4f9f-aad4-82694d869cc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:50.271377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d00911e-9bf7-4a38-ac12-08dde4a71c64 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:50.292251 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b3b14-eaae-433f-ab6e-91a791c06f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:50.295055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b3b14-eaae-433f-ab6e-91a791c06f22 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:50.311446 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b3b14-eaae-433f-ab6e-91a791c06f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:50.312684 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b3b14-eaae-433f-ab6e-91a791c06f22 admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:50.313488 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b3b14-eaae-433f-ab6e-91a791c06f22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:48:50.313806 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b3b14-eaae-433f-ab6e-91a791c06f22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:50.315507 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b3b14-eaae-433f-ab6e-91a791c06f22 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:50.361375 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 915/1842] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:48:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:48:50.362388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b3b14-eaae-433f-ab6e-91a791c06f22 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:50.408564 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b3b14-eaae-433f-ab6e-91a791c06f22 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:50.425106 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735f08b-d012-4364-b718-e0b40e78c208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:50.427107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735f08b-d012-4364-b718-e0b40e78c208 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:50.429000 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735f08b-d012-4364-b718-e0b40e78c208 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:50.432149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735f08b-d012-4364-b718-e0b40e78c208 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:50.432967 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735f08b-d012-4364-b718-e0b40e78c208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:50.439077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735f08b-d012-4364-b718-e0b40e78c208 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:50.456256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac0711-61fc-4f9f-aad4-82694d869cc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:50.460132 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac0711-61fc-4f9f-aad4-82694d869cc2 service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:50.486996 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 928/1843] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:50 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:50.543884 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 916/1844] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:50 2022] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:50.548388 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac0711-61fc-4f9f-aad4-82694d869cc2 service cinder] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:50.573805 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac0711-61fc-4f9f-aad4-82694d869cc2 service cinder] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:50.618873 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c1b3f-4af0-45fe-a892-b2968db8a815 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:50.619288 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c1b3f-4af0-45fe-a892-b2968db8a815 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:50.619673 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c1b3f-4af0-45fe-a892-b2968db8a815 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:50.622846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 917/1845] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jul 19 20:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:48:50.645740 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c0918-9a8e-42f9-8ea6-9488817ff957 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:50.646254 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c0918-9a8e-42f9-8ea6-9488817ff957 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:50.646642 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c0918-9a8e-42f9-8ea6-9488817ff957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:50.686835 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-227c0918-9a8e-42f9-8ea6-9488817ff957 None None] MFA Rules not processed for user `6dbbb8f7b3f2449fb9c64ca3815b6c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:50.688078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-227c0918-9a8e-42f9-8ea6-9488817ff957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:50.809362 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:50.832268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de847c-17ee-46de-853e-3a4a8478d419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:50.834448 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de847c-17ee-46de-853e-3a4a8478d419 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:50.834914 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de847c-17ee-46de-853e-3a4a8478d419 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:50.835315 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de847c-17ee-46de-853e-3a4a8478d419 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:50.836258 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de847c-17ee-46de-853e-3a4a8478d419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:50.850517 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de847c-17ee-46de-853e-3a4a8478d419 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:50.943944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 929/1846] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:50 2022] POST /identity/v3/users => generated 286 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:50.945107 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de847c-17ee-46de-853e-3a4a8478d419 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:50.995869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 918/1847] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jul 19 20:48:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:48:50.998265 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de847c-17ee-46de-853e-3a4a8478d419 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:51.034138 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a7304-0db3-4c75-87fd-b371beb061c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:51.034138 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a7304-0db3-4c75-87fd-b371beb061c4 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:51.034138 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a7304-0db3-4c75-87fd-b371beb061c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:51.034138 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a7304-0db3-4c75-87fd-b371beb061c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:51.034696 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a7304-0db3-4c75-87fd-b371beb061c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:51.037106 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2a7304-0db3-4c75-87fd-b371beb061c4 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:51.091741 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 930/1848] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:51.095998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c0918-9a8e-42f9-8ea6-9488817ff957 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:51.119038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c0918-9a8e-42f9-8ea6-9488817ff957 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:51.124721 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1141b0-b225-4317-a3a7-9a396e3e428e None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:51.125130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1141b0-b225-4317-a3a7-9a396e3e428e None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:51.125272 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1141b0-b225-4317-a3a7-9a396e3e428e None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:51.127221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 931/1849] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jul 19 20:48:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:48:51.136140 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f6954-6b29-4f39-a0be-bffba4664502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:51.136999 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f6954-6b29-4f39-a0be-bffba4664502 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:51.137395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f6954-6b29-4f39-a0be-bffba4664502 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:51.137926 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f6954-6b29-4f39-a0be-bffba4664502 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:51.140293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f6954-6b29-4f39-a0be-bffba4664502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:51.144090 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f6954-6b29-4f39-a0be-bffba4664502 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:51.183438 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1141b0-b225-4317-a3a7-9a396e3e428e None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:51.188205 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 919/1850] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:51.190194 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be4265-0b85-48b7-94a5-9396e4f00dc5 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:51.196684 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be4265-0b85-48b7-94a5-9396e4f00dc5 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:51.197295 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be4265-0b85-48b7-94a5-9396e4f00dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:51.224751 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1141b0-b225-4317-a3a7-9a396e3e428e None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:51.249432 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a6780-eb5b-448c-a7f4-d3401c2128ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:51.252384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a6780-eb5b-448c-a7f4-d3401c2128ab admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:51.253080 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a6780-eb5b-448c-a7f4-d3401c2128ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:51.254103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a6780-eb5b-448c-a7f4-d3401c2128ab admin admin] PATH_INFO: `/v3/projects/10ddac9a84304145b026a8c2bd1b73ca/users/31ee555ac5f449438a5349ab4eac07fa/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:51.276262 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-65be4265-0b85-48b7-94a5-9396e4f00dc5 None None] MFA Rules not processed for user `6dbbb8f7b3f2449fb9c64ca3815b6c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:51.284844 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-65be4265-0b85-48b7-94a5-9396e4f00dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:51.310246 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a6780-eb5b-448c-a7f4-d3401c2128ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ddac9a84304145b026a8c2bd1b73ca, user_id=31ee555ac5f449438a5349ab4eac07fa, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:51.313445 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 920/1851] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jul 19 20:48:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:51.317330 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a6780-eb5b-448c-a7f4-d3401c2128ab admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:51.397794 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 932/1852] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:51 2022] PUT /identity/v3/projects/10ddac9a84304145b026a8c2bd1b73ca/users/31ee555ac5f449438a5349ab4eac07fa/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:51.413005 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d89d2-005e-404d-8ead-d3fc98a8efcd None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:51.413296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d89d2-005e-404d-8ead-d3fc98a8efcd None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:51.413583 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d89d2-005e-404d-8ead-d3fc98a8efcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:51.508286 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-a40d89d2-005e-404d-8ead-d3fc98a8efcd None None] MFA Rules not processed for user `31ee555ac5f449438a5349ab4eac07fa`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:51.509603 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a40d89d2-005e-404d-8ead-d3fc98a8efcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:51.738900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 921/1853] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:51.744155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a6780-eb5b-448c-a7f4-d3401c2128ab admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:51.768093 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:51.855885 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a6780-eb5b-448c-a7f4-d3401c2128ab admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:51.862268 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d89d2-005e-404d-8ead-d3fc98a8efcd None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:51.863937 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a40d89d2-005e-404d-8ead-d3fc98a8efcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:51.868715 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773b72c-5bd1-450d-8c78-b81bca88a842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:51.870303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773b72c-5bd1-450d-8c78-b81bca88a842 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:51.870675 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773b72c-5bd1-450d-8c78-b81bca88a842 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:51.871020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773b72c-5bd1-450d-8c78-b81bca88a842 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:51.871949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773b72c-5bd1-450d-8c78-b81bca88a842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:51.874421 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773b72c-5bd1-450d-8c78-b81bca88a842 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:51.895422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d89d2-005e-404d-8ead-d3fc98a8efcd None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:51.915583 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66d24c-9ab8-4a78-837e-5fa479794249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:51.916804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66d24c-9ab8-4a78-837e-5fa479794249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:51.917268 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66d24c-9ab8-4a78-837e-5fa479794249 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:51.917754 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66d24c-9ab8-4a78-837e-5fa479794249 admin admin] PATH_INFO: `/v3/users/b95e16f0fa6d4aee9c95a913372fc465` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:51.923477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66d24c-9ab8-4a78-837e-5fa479794249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b95e16f0fa6d4aee9c95a913372fc465)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:51.936340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e66d24c-9ab8-4a78-837e-5fa479794249 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:51.955233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 933/1854] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:51 2022] POST /identity/v3/projects => generated 369 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:51.958322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773b72c-5bd1-450d-8c78-b81bca88a842 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:52.045920 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2e66d24c-9ab8-4a78-837e-5fa479794249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b95e16f0fa6d4aee9c95a913372fc465'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:52.064202 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2e66d24c-9ab8-4a78-837e-5fa479794249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b95e16f0fa6d4aee9c95a913372fc465'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:52.087278 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2e66d24c-9ab8-4a78-837e-5fa479794249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b95e16f0fa6d4aee9c95a913372fc465'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:52.095400 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773b72c-5bd1-450d-8c78-b81bca88a842 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:52.103694 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2e66d24c-9ab8-4a78-837e-5fa479794249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b95e16f0fa6d4aee9c95a913372fc465'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:52.104698 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2e66d24c-9ab8-4a78-837e-5fa479794249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b95e16f0fa6d4aee9c95a913372fc465'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:52.109018 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c59c4-d1c6-44a3-a9e5-ef19ea8ea72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:52.110442 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c59c4-d1c6-44a3-a9e5-ef19ea8ea72a admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:52.110762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c59c4-d1c6-44a3-a9e5-ef19ea8ea72a admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:52.111167 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c59c4-d1c6-44a3-a9e5-ef19ea8ea72a admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:52.111995 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c59c4-d1c6-44a3-a9e5-ef19ea8ea72a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:52.115175 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c59c4-d1c6-44a3-a9e5-ef19ea8ea72a admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:52.116818 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 922/1855] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:48:51 2022] DELETE /identity/v3/users/b95e16f0fa6d4aee9c95a913372fc465 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:48:52.118629 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66d24c-9ab8-4a78-837e-5fa479794249 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:52.122033 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-2e66d24c-9ab8-4a78-837e-5fa479794249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:52.166878 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:52.176604 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 934/1856] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:51 2022] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:52.177662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319236d-6809-472d-9bca-69547090eae1 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:52.178067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319236d-6809-472d-9bca-69547090eae1 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:52.178385 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319236d-6809-472d-9bca-69547090eae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:52.206929 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-a319236d-6809-472d-9bca-69547090eae1 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:52.208749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-a319236d-6809-472d-9bca-69547090eae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:52.307315 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66d24c-9ab8-4a78-837e-5fa479794249 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:52.315685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48623e53-7422-4b2b-a0ab-0b3ad572868d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:52.316908 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48623e53-7422-4b2b-a0ab-0b3ad572868d service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:52.317271 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48623e53-7422-4b2b-a0ab-0b3ad572868d service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:52.319289 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48623e53-7422-4b2b-a0ab-0b3ad572868d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:52.333679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-48623e53-7422-4b2b-a0ab-0b3ad572868d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:52.393492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 935/1857] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:52.393492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319236d-6809-472d-9bca-69547090eae1 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:52.394080 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48623e53-7422-4b2b-a0ab-0b3ad572868d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:52.394580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-a319236d-6809-472d-9bca-69547090eae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:52.394918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48623e53-7422-4b2b-a0ab-0b3ad572868d service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:52.409667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 923/1858] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:52.411108 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48623e53-7422-4b2b-a0ab-0b3ad572868d service nova] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:52.412858 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-48623e53-7422-4b2b-a0ab-0b3ad572868d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:52.430134 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48623e53-7422-4b2b-a0ab-0b3ad572868d service nova] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:52.432856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319236d-6809-472d-9bca-69547090eae1 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:52.445458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e7dec-3422-4115-8c88-af40e24dc843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:52.449155 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce650b5a-b589-4b70-99a7-68f0d3123b30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:52.449774 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e7dec-3422-4115-8c88-af40e24dc843 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:52.449970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce650b5a-b589-4b70-99a7-68f0d3123b30 service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:52.450405 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e7dec-3422-4115-8c88-af40e24dc843 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:52.450851 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e7dec-3422-4115-8c88-af40e24dc843 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:52.451887 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e7dec-3422-4115-8c88-af40e24dc843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:52.452004 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce650b5a-b589-4b70-99a7-68f0d3123b30 service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:52.452232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce650b5a-b589-4b70-99a7-68f0d3123b30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:52.457466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e7dec-3422-4115-8c88-af40e24dc843 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:52.459817 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ce650b5a-b589-4b70-99a7-68f0d3123b30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:52.473299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 936/1859] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:52.474619 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e7dec-3422-4115-8c88-af40e24dc843 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:52.476870 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-661e7dec-3422-4115-8c88-af40e24dc843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:52.492212 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e7dec-3422-4115-8c88-af40e24dc843 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:52.500847 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce594d60-2300-4106-8839-6ad7a3cb97f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:52.502576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce650b5a-b589-4b70-99a7-68f0d3123b30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:52.503826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce594d60-2300-4106-8839-6ad7a3cb97f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:52.506138 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce594d60-2300-4106-8839-6ad7a3cb97f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:52.506607 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce594d60-2300-4106-8839-6ad7a3cb97f4 admin admin] PATH_INFO: `/v3/projects/8fa153e212a444d5be4eef61860ba73e` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:52.508138 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce650b5a-b589-4b70-99a7-68f0d3123b30 service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:52.509930 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce594d60-2300-4106-8839-6ad7a3cb97f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa153e212a444d5be4eef61860ba73e)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:52.513521 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce594d60-2300-4106-8839-6ad7a3cb97f4 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:52.537932 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 924/1860] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:52.538880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce650b5a-b589-4b70-99a7-68f0d3123b30 service nova] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:52.541042 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ce650b5a-b589-4b70-99a7-68f0d3123b30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:52.561298 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:52.681153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ce594d60-2300-4106-8839-6ad7a3cb97f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa153e212a444d5be4eef61860ba73e', 'request_id': 'req-ce594d60-2300-4106-8839-6ad7a3cb97f4'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:52.696816 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ce594d60-2300-4106-8839-6ad7a3cb97f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa153e212a444d5be4eef61860ba73e', 'request_id': 'req-ce594d60-2300-4106-8839-6ad7a3cb97f4'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:52.704411 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ce594d60-2300-4106-8839-6ad7a3cb97f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa153e212a444d5be4eef61860ba73e', 'request_id': 'req-ce594d60-2300-4106-8839-6ad7a3cb97f4'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:52.719632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ce594d60-2300-4106-8839-6ad7a3cb97f4 admin admin] The token cache is being invalidate because project 8fa153e212a444d5be4eef61860ba73e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:48:52.719945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ce594d60-2300-4106-8839-6ad7a3cb97f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:52.720694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ce594d60-2300-4106-8839-6ad7a3cb97f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:52.725838 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce650b5a-b589-4b70-99a7-68f0d3123b30 service nova] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:52.726219 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 937/1861] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:48:52 2022] DELETE /identity/v3/projects/8fa153e212a444d5be4eef61860ba73e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:52.728406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce594d60-2300-4106-8839-6ad7a3cb97f4 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:52.730633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-ce594d60-2300-4106-8839-6ad7a3cb97f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:52.855690 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce594d60-2300-4106-8839-6ad7a3cb97f4 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:52.861853 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b3b6f-a244-4ca7-bcb5-da17ba5ec8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:52.864086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b3b6f-a244-4ca7-bcb5-da17ba5ec8a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:52.864546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b3b6f-a244-4ca7-bcb5-da17ba5ec8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:52.864962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b3b6f-a244-4ca7-bcb5-da17ba5ec8a0 admin admin] PATH_INFO: `/v3/projects/06db0669b51344f594c923eea6462932/users/8b282d37f116406f871bf743ca63cf3c/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:52.866769 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4beb4-9485-40b0-9a01-e0864efb53b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:52.867553 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4beb4-9485-40b0-9a01-e0864efb53b0 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:52.868396 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4beb4-9485-40b0-9a01-e0864efb53b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:52.868687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4beb4-9485-40b0-9a01-e0864efb53b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:52.870746 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-17c4beb4-9485-40b0-9a01-e0864efb53b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:52.903070 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4beb4-9485-40b0-9a01-e0864efb53b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:52.904569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c4beb4-9485-40b0-9a01-e0864efb53b0 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:52.907005 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b3b6f-a244-4ca7-bcb5-da17ba5ec8a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06db0669b51344f594c923eea6462932, user_id=8b282d37f116406f871bf743ca63cf3c, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:52.910680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b3b6f-a244-4ca7-bcb5-da17ba5ec8a0 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:52.929777 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 925/1862] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:52.931765 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32be38-8c8f-42b2-ac6f-c5825dd688dd None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:52.932060 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32be38-8c8f-42b2-ac6f-c5825dd688dd None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:52.932334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32be38-8c8f-42b2-ac6f-c5825dd688dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:52.941395 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 938/1863] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:52 2022] PUT /identity/v3/projects/06db0669b51344f594c923eea6462932/users/8b282d37f116406f871bf743ca63cf3c/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:52.945721 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b3b6f-a244-4ca7-bcb5-da17ba5ec8a0 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:53.043352 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-5b32be38-8c8f-42b2-ac6f-c5825dd688dd None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:53.044597 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-5b32be38-8c8f-42b2-ac6f-c5825dd688dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:53.139239 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b3b6f-a244-4ca7-bcb5-da17ba5ec8a0 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:53.175650 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de069e89-9a7d-4e4d-9106-501af7747e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:53.177478 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de069e89-9a7d-4e4d-9106-501af7747e38 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:53.182396 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de069e89-9a7d-4e4d-9106-501af7747e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:53.182921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de069e89-9a7d-4e4d-9106-501af7747e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:53.184604 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de069e89-9a7d-4e4d-9106-501af7747e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:53.190735 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:53.203144 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de069e89-9a7d-4e4d-9106-501af7747e38 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:53.241884 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 939/1864] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:53.244688 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de069e89-9a7d-4e4d-9106-501af7747e38 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:53.266251 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 926/1865] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:53.272534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974d6d5-888b-4cef-ba2e-ae5e9284bf58 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:53.272947 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974d6d5-888b-4cef-ba2e-ae5e9284bf58 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:53.273823 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974d6d5-888b-4cef-ba2e-ae5e9284bf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:53.281534 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de069e89-9a7d-4e4d-9106-501af7747e38 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:53.295079 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a649b-55a7-4d6a-9f38-b8340fdef0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:53.299800 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a649b-55a7-4d6a-9f38-b8340fdef0cf admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:53.300000 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a649b-55a7-4d6a-9f38-b8340fdef0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:53.300317 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a649b-55a7-4d6a-9f38-b8340fdef0cf admin admin] PATH_INFO: `/v3/projects/06db0669b51344f594c923eea6462932/users/8b282d37f116406f871bf743ca63cf3c/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:53.308459 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a649b-55a7-4d6a-9f38-b8340fdef0cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=06db0669b51344f594c923eea6462932, user_id=8b282d37f116406f871bf743ca63cf3c, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:53.317275 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a649b-55a7-4d6a-9f38-b8340fdef0cf admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:53.327820 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-1974d6d5-888b-4cef-ba2e-ae5e9284bf58 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:53.332647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-1974d6d5-888b-4cef-ba2e-ae5e9284bf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:53.334789 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:53.349189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 940/1866] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:53 2022] PUT /identity/v3/projects/06db0669b51344f594c923eea6462932/users/8b282d37f116406f871bf743ca63cf3c/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:53.364007 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d8f63-d99b-4ed9-bf81-9afa038e87a8 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:53.364007 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d8f63-d99b-4ed9-bf81-9afa038e87a8 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:53.367649 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d8f63-d99b-4ed9-bf81-9afa038e87a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:53.433137 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-d97d8f63-d99b-4ed9-bf81-9afa038e87a8 None None] MFA Rules not processed for user `8b282d37f116406f871bf743ca63cf3c`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:53.435004 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-d97d8f63-d99b-4ed9-bf81-9afa038e87a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:53.534563 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 927/1867] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:53.541803 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974d6d5-888b-4cef-ba2e-ae5e9284bf58 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:53.572033 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974d6d5-888b-4cef-ba2e-ae5e9284bf58 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:53.592776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24abf8-86bd-40ae-bde8-7c0a6a38d626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:53.594490 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24abf8-86bd-40ae-bde8-7c0a6a38d626 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:53.594983 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24abf8-86bd-40ae-bde8-7c0a6a38d626 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:53.595507 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24abf8-86bd-40ae-bde8-7c0a6a38d626 admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:53.598589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24abf8-86bd-40ae-bde8-7c0a6a38d626 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:48:53.599159 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24abf8-86bd-40ae-bde8-7c0a6a38d626 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:53.607666 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24abf8-86bd-40ae-bde8-7c0a6a38d626 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:53.631828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 941/1868] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:53 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:48:53.638814 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 928/1869] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:48:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:48:53.645274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d8f63-d99b-4ed9-bf81-9afa038e87a8 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:53.664003 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24abf8-86bd-40ae-bde8-7c0a6a38d626 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:53.666251 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-9e24abf8-86bd-40ae-bde8-7c0a6a38d626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:53.683580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d8f63-d99b-4ed9-bf81-9afa038e87a8 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:53.695045 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7528c-a478-4cfe-b20f-614e8f77ca02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:53.695761 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7528c-a478-4cfe-b20f-614e8f77ca02 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:53.696198 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7528c-a478-4cfe-b20f-614e8f77ca02 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:53.696609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7528c-a478-4cfe-b20f-614e8f77ca02 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:53.697293 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7528c-a478-4cfe-b20f-614e8f77ca02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:53.707678 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7528c-a478-4cfe-b20f-614e8f77ca02 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:53.773452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 942/1870] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:53 2022] POST /identity/v3/projects => generated 389 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:53.781200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7528c-a478-4cfe-b20f-614e8f77ca02 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:53.872209 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24abf8-86bd-40ae-bde8-7c0a6a38d626 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:53.952292 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7528c-a478-4cfe-b20f-614e8f77ca02 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:53.961188 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fdf00-a472-4fb0-b015-2bced45e1d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:53.962226 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fdf00-a472-4fb0-b015-2bced45e1d57 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:53.962674 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fdf00-a472-4fb0-b015-2bced45e1d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:53.963097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fdf00-a472-4fb0-b015-2bced45e1d57 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:53.964055 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4fdf00-a472-4fb0-b015-2bced45e1d57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:53.966215 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4fdf00-a472-4fb0-b015-2bced45e1d57 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:54.002603 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 943/1871] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:53 2022] POST /identity/v3/users => generated 295 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:54.006587 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0efab6-38f1-42bd-aeae-c9c3c4b1d55e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:54.006851 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fdf00-a472-4fb0-b015-2bced45e1d57 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:54.007505 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0efab6-38f1-42bd-aeae-c9c3c4b1d55e service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:54.007827 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0efab6-38f1-42bd-aeae-c9c3c4b1d55e service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:54.008233 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0efab6-38f1-42bd-aeae-c9c3c4b1d55e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:54.049204 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fdf00-a472-4fb0-b015-2bced45e1d57 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:54.062491 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82282489-5e58-494f-898d-fc489913eec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:54.064400 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82282489-5e58-494f-898d-fc489913eec0 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:54.065124 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82282489-5e58-494f-898d-fc489913eec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:54.066040 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82282489-5e58-494f-898d-fc489913eec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:54.067114 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82282489-5e58-494f-898d-fc489913eec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:54.069561 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82282489-5e58-494f-898d-fc489913eec0 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:54.094594 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 944/1872] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:54.096489 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82282489-5e58-494f-898d-fc489913eec0 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:54.100344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:54.123911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82282489-5e58-494f-898d-fc489913eec0 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:54.130800 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1e8d9-2fb4-4b54-9f6f-c9cd4fc38bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:54.131516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1e8d9-2fb4-4b54-9f6f-c9cd4fc38bde admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:54.131903 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1e8d9-2fb4-4b54-9f6f-c9cd4fc38bde admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:54.132170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1e8d9-2fb4-4b54-9f6f-c9cd4fc38bde admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:54.134122 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1e8d9-2fb4-4b54-9f6f-c9cd4fc38bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:54.136079 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1e8d9-2fb4-4b54-9f6f-c9cd4fc38bde admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:54.152113 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0efab6-38f1-42bd-aeae-c9c3c4b1d55e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:54.154039 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0efab6-38f1-42bd-aeae-c9c3c4b1d55e service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:54.166107 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 945/1873] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:54.168563 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1e8d9-2fb4-4b54-9f6f-c9cd4fc38bde admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:54.177406 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 929/1874] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:53 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:48:54.188900 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1e8d9-2fb4-4b54-9f6f-c9cd4fc38bde admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:54.198408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8054c-5f26-4d4b-a5d4-1ca80b9f1875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:54.200093 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8054c-5f26-4d4b-a5d4-1ca80b9f1875 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:54.200523 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8054c-5f26-4d4b-a5d4-1ca80b9f1875 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:54.200776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8054c-5f26-4d4b-a5d4-1ca80b9f1875 admin admin] PATH_INFO: `/v3/projects/26455b76afb04917a8f80b5e9e707a93/users/788a06d79cd24be8a00200ddb72c99bd/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:54.230969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8054c-5f26-4d4b-a5d4-1ca80b9f1875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26455b76afb04917a8f80b5e9e707a93, user_id=788a06d79cd24be8a00200ddb72c99bd, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:54.236114 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8054c-5f26-4d4b-a5d4-1ca80b9f1875 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:54.268175 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 946/1875] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:54 2022] PUT /identity/v3/projects/26455b76afb04917a8f80b5e9e707a93/users/788a06d79cd24be8a00200ddb72c99bd/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:54.283116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130369eb-be10-4239-a502-70b6bb5adda4 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:54.283495 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130369eb-be10-4239-a502-70b6bb5adda4 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:54.283744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130369eb-be10-4239-a502-70b6bb5adda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:54.347879 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-130369eb-be10-4239-a502-70b6bb5adda4 None None] MFA Rules not processed for user `788a06d79cd24be8a00200ddb72c99bd`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:54.349123 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-130369eb-be10-4239-a502-70b6bb5adda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:54.561371 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 930/1876] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:54.568360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8054c-5f26-4d4b-a5d4-1ca80b9f1875 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:54.588800 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:54.769791 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8054c-5f26-4d4b-a5d4-1ca80b9f1875 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:54.782929 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8154c2-8fc4-482f-999d-84195503155b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:54.786449 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8154c2-8fc4-482f-999d-84195503155b admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:54.786914 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8154c2-8fc4-482f-999d-84195503155b admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:54.787292 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8154c2-8fc4-482f-999d-84195503155b admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:54.788267 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8154c2-8fc4-482f-999d-84195503155b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:54.794981 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8154c2-8fc4-482f-999d-84195503155b admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:54.884930 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 947/1877] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:54 2022] POST /identity/v3/projects => generated 387 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:54.889192 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130369eb-be10-4239-a502-70b6bb5adda4 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:54.916332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130369eb-be10-4239-a502-70b6bb5adda4 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:55.112637 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678eb03-cc62-4c22-8e22-f99658d1be26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:55.114359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678eb03-cc62-4c22-8e22-f99658d1be26 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:55.114693 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678eb03-cc62-4c22-8e22-f99658d1be26 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:55.114985 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678eb03-cc62-4c22-8e22-f99658d1be26 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:55.115806 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678eb03-cc62-4c22-8e22-f99658d1be26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:55.125850 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678eb03-cc62-4c22-8e22-f99658d1be26 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:55.188232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 931/1878] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:54 2022] POST /identity/v3/users => generated 300 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:55.192156 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8154c2-8fc4-482f-999d-84195503155b admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:55.212458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8154c2-8fc4-482f-999d-84195503155b admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:55.222722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a82ef-6918-49c6-9628-00891ecbb819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:55.224022 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a82ef-6918-49c6-9628-00891ecbb819 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:55.224548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a82ef-6918-49c6-9628-00891ecbb819 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:55.225142 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a82ef-6918-49c6-9628-00891ecbb819 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:55.226430 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a82ef-6918-49c6-9628-00891ecbb819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:55.232598 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a82ef-6918-49c6-9628-00891ecbb819 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:55.259713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 948/1879] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:55.266368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678eb03-cc62-4c22-8e22-f99658d1be26 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:55.303538 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a82ef-6918-49c6-9628-00891ecbb819 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:55.306106 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-653a82ef-6918-49c6-9628-00891ecbb819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:55.328091 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678eb03-cc62-4c22-8e22-f99658d1be26 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:55.344856 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd071d-5cd4-48ca-8043-4eddec26fbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:55.345824 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd071d-5cd4-48ca-8043-4eddec26fbcb admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:55.346111 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd071d-5cd4-48ca-8043-4eddec26fbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:55.346387 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd071d-5cd4-48ca-8043-4eddec26fbcb admin admin] PATH_INFO: `/v3/projects/b363022181954311aa4be403588d61a1/users/9c4e6d4499cb4b78b160adb8740e8991/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:55.350608 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a82ef-6918-49c6-9628-00891ecbb819 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:55.369589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d13dc-e6f9-4d7b-8aae-edd11c4af252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:55.372394 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d13dc-e6f9-4d7b-8aae-edd11c4af252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:55.374190 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d13dc-e6f9-4d7b-8aae-edd11c4af252 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:55.375288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d13dc-e6f9-4d7b-8aae-edd11c4af252 admin admin] PATH_INFO: `/v3/projects/c4005127a8694b2ea8d4fa603c265a34` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:55.380614 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d13dc-e6f9-4d7b-8aae-edd11c4af252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4005127a8694b2ea8d4fa603c265a34)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:55.390388 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d13dc-e6f9-4d7b-8aae-edd11c4af252 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:55.411483 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd071d-5cd4-48ca-8043-4eddec26fbcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b363022181954311aa4be403588d61a1, user_id=9c4e6d4499cb4b78b160adb8740e8991, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:55.422296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd071d-5cd4-48ca-8043-4eddec26fbcb admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:55.510562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 932/1880] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:55 2022] PUT /identity/v3/projects/b363022181954311aa4be403588d61a1/users/9c4e6d4499cb4b78b160adb8740e8991/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:55.515086 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd071d-5cd4-48ca-8043-4eddec26fbcb admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:55.557794 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-fb7d13dc-e6f9-4d7b-8aae-edd11c4af252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4005127a8694b2ea8d4fa603c265a34', 'request_id': 'req-fb7d13dc-e6f9-4d7b-8aae-edd11c4af252'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:55.573258 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-fb7d13dc-e6f9-4d7b-8aae-edd11c4af252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4005127a8694b2ea8d4fa603c265a34', 'request_id': 'req-fb7d13dc-e6f9-4d7b-8aae-edd11c4af252'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:55.585887 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-fb7d13dc-e6f9-4d7b-8aae-edd11c4af252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4005127a8694b2ea8d4fa603c265a34', 'request_id': 'req-fb7d13dc-e6f9-4d7b-8aae-edd11c4af252'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:55.607466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-fb7d13dc-e6f9-4d7b-8aae-edd11c4af252 admin admin] The token cache is being invalidate because project c4005127a8694b2ea8d4fa603c265a34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:48:55.607819 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-fb7d13dc-e6f9-4d7b-8aae-edd11c4af252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:55.608485 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-fb7d13dc-e6f9-4d7b-8aae-edd11c4af252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:55.613764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 949/1881] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:48:55 2022] DELETE /identity/v3/projects/c4005127a8694b2ea8d4fa603c265a34 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:48:55.619365 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d13dc-e6f9-4d7b-8aae-edd11c4af252 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:55.622045 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-fb7d13dc-e6f9-4d7b-8aae-edd11c4af252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:55.646830 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:55.724536 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd071d-5cd4-48ca-8043-4eddec26fbcb admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:55.752370 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d13dc-e6f9-4d7b-8aae-edd11c4af252 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:55.760737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227fc66-7a1f-4314-8c2c-c9cde4978b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:55.762069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227fc66-7a1f-4314-8c2c-c9cde4978b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:55.762715 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227fc66-7a1f-4314-8c2c-c9cde4978b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:55.763104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227fc66-7a1f-4314-8c2c-c9cde4978b08 admin admin] PATH_INFO: `/v3/users/31ee555ac5f449438a5349ab4eac07fa` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:55.764803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227fc66-7a1f-4314-8c2c-c9cde4978b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31ee555ac5f449438a5349ab4eac07fa)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:55.767599 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227fc66-7a1f-4314-8c2c-c9cde4978b08 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:55.774547 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:55.837854 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97cce1-00ea-4177-b438-3566d1e58c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:55.839221 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97cce1-00ea-4177-b438-3566d1e58c2c admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:55.839733 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97cce1-00ea-4177-b438-3566d1e58c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:55.840200 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97cce1-00ea-4177-b438-3566d1e58c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:55.841523 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97cce1-00ea-4177-b438-3566d1e58c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:55.845342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97cce1-00ea-4177-b438-3566d1e58c2c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:55.878882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 933/1882] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:48:55.878882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97cce1-00ea-4177-b438-3566d1e58c2c admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:55.883222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-2a97cce1-00ea-4177-b438-3566d1e58c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:55.890535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-3227fc66-7a1f-4314-8c2c-c9cde4978b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31ee555ac5f449438a5349ab4eac07fa'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:55.912178 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-3227fc66-7a1f-4314-8c2c-c9cde4978b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31ee555ac5f449438a5349ab4eac07fa'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:55.941156 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97cce1-00ea-4177-b438-3566d1e58c2c admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:55.951788 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698a605-5ad6-49a4-becf-27a62efee666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:55.952685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698a605-5ad6-49a4-becf-27a62efee666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:55.952969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698a605-5ad6-49a4-becf-27a62efee666 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:55.953245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698a605-5ad6-49a4-becf-27a62efee666 admin admin] PATH_INFO: `/v3/users/eb661303671f4b0db166e3cea1635aa1` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:55.954346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-3227fc66-7a1f-4314-8c2c-c9cde4978b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31ee555ac5f449438a5349ab4eac07fa'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:55.955412 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698a605-5ad6-49a4-becf-27a62efee666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb661303671f4b0db166e3cea1635aa1)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:55.955958 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-3227fc66-7a1f-4314-8c2c-c9cde4978b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31ee555ac5f449438a5349ab4eac07fa'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:55.959560 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698a605-5ad6-49a4-becf-27a62efee666 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:55.970832 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-3227fc66-7a1f-4314-8c2c-c9cde4978b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31ee555ac5f449438a5349ab4eac07fa'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:55.987691 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 950/1883] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:48:55 2022] DELETE /identity/v3/users/31ee555ac5f449438a5349ab4eac07fa => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:55.988646 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227fc66-7a1f-4314-8c2c-c9cde4978b08 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:55.992660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-3227fc66-7a1f-4314-8c2c-c9cde4978b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:56.080480 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2698a605-5ad6-49a4-becf-27a62efee666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb661303671f4b0db166e3cea1635aa1'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:56.092853 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2698a605-5ad6-49a4-becf-27a62efee666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb661303671f4b0db166e3cea1635aa1'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:56.113262 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2698a605-5ad6-49a4-becf-27a62efee666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb661303671f4b0db166e3cea1635aa1'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:56.124671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227fc66-7a1f-4314-8c2c-c9cde4978b08 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:56.125275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2698a605-5ad6-49a4-becf-27a62efee666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb661303671f4b0db166e3cea1635aa1'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:56.127186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2698a605-5ad6-49a4-becf-27a62efee666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb661303671f4b0db166e3cea1635aa1'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:56.137676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2319754-6ad4-4f3c-a13d-4da2d9398114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:56.138762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2319754-6ad4-4f3c-a13d-4da2d9398114 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:56.139145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2319754-6ad4-4f3c-a13d-4da2d9398114 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:56.139521 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2319754-6ad4-4f3c-a13d-4da2d9398114 admin admin] PATH_INFO: `/v3/projects/b363022181954311aa4be403588d61a1/users/9c4e6d4499cb4b78b160adb8740e8991/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:56.141867 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2319754-6ad4-4f3c-a13d-4da2d9398114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b363022181954311aa4be403588d61a1, user_id=9c4e6d4499cb4b78b160adb8740e8991, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:56.144889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2319754-6ad4-4f3c-a13d-4da2d9398114 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:56.161944 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 934/1884] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:48:55 2022] DELETE /identity/v3/users/eb661303671f4b0db166e3cea1635aa1 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:56.163581 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47482798-86e8-47ab-88c2-66352c5b6909 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:56.163935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47482798-86e8-47ab-88c2-66352c5b6909 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:56.164226 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47482798-86e8-47ab-88c2-66352c5b6909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:56.171491 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 951/1885] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:55 2022] PUT /identity/v3/projects/b363022181954311aa4be403588d61a1/users/9c4e6d4499cb4b78b160adb8740e8991/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:56.188172 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-47482798-86e8-47ab-88c2-66352c5b6909 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:56.188895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125a1e3-19d4-406d-a5b0-c67dd407ba35 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:56.189188 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125a1e3-19d4-406d-a5b0-c67dd407ba35 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:56.189473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125a1e3-19d4-406d-a5b0-c67dd407ba35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:56.189913 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-47482798-86e8-47ab-88c2-66352c5b6909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:56.263490 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:56.296846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 935/1886] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:56.320805 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-9125a1e3-19d4-406d-a5b0-c67dd407ba35 None None] MFA Rules not processed for user `9c4e6d4499cb4b78b160adb8740e8991`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:56.321787 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47482798-86e8-47ab-88c2-66352c5b6909 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:56.322569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9125a1e3-19d4-406d-a5b0-c67dd407ba35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:56.323007 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-47482798-86e8-47ab-88c2-66352c5b6909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:56.536385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47482798-86e8-47ab-88c2-66352c5b6909 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:56.539724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 952/1887] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:56.549286 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125a1e3-19d4-406d-a5b0-c67dd407ba35 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:56.550729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9125a1e3-19d4-406d-a5b0-c67dd407ba35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:56.560830 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:56.565768 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a126f-43af-48d8-93bd-abd03dbc62c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:56.567204 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a126f-43af-48d8-93bd-abd03dbc62c2 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:56.567893 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a126f-43af-48d8-93bd-abd03dbc62c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:56.568436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a126f-43af-48d8-93bd-abd03dbc62c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:56.595555 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a126f-43af-48d8-93bd-abd03dbc62c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:56.598364 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a126f-43af-48d8-93bd-abd03dbc62c2 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:56.625721 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 936/1888] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:56.720319 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125a1e3-19d4-406d-a5b0-c67dd407ba35 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:56.724741 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ad483-b636-4aed-a42e-7835abd94e6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:56.725428 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ad483-b636-4aed-a42e-7835abd94e6c service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:56.725713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ad483-b636-4aed-a42e-7835abd94e6c service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:56.727610 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ad483-b636-4aed-a42e-7835abd94e6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:56.737271 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ad483-b636-4aed-a42e-7835abd94e6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:56.739226 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ad483-b636-4aed-a42e-7835abd94e6c service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:56.757235 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 953/1889] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:48:56.950994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a126f-43af-48d8-93bd-abd03dbc62c2 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:56.954991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-fb2a126f-43af-48d8-93bd-abd03dbc62c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:57.004666 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a126f-43af-48d8-93bd-abd03dbc62c2 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:57.012726 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10f288-ef7a-4c32-88ef-8780df364204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:57.014581 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10f288-ef7a-4c32-88ef-8780df364204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:57.015155 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10f288-ef7a-4c32-88ef-8780df364204 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:57.016222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10f288-ef7a-4c32-88ef-8780df364204 admin admin] PATH_INFO: `/v3/users/788a06d79cd24be8a00200ddb72c99bd` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:57.018508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10f288-ef7a-4c32-88ef-8780df364204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=788a06d79cd24be8a00200ddb72c99bd)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:57.021077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10f288-ef7a-4c32-88ef-8780df364204 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:57.107774 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-df10f288-ef7a-4c32-88ef-8780df364204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '788a06d79cd24be8a00200ddb72c99bd'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:57.155280 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-df10f288-ef7a-4c32-88ef-8780df364204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '788a06d79cd24be8a00200ddb72c99bd'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:57.194255 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-df10f288-ef7a-4c32-88ef-8780df364204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '788a06d79cd24be8a00200ddb72c99bd'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:57.203731 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ad483-b636-4aed-a42e-7835abd94e6c service cinder] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:57.210960 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-ab6ad483-b636-4aed-a42e-7835abd94e6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:57.213935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-df10f288-ef7a-4c32-88ef-8780df364204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '788a06d79cd24be8a00200ddb72c99bd'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:57.215457 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-df10f288-ef7a-4c32-88ef-8780df364204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '788a06d79cd24be8a00200ddb72c99bd'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:57.235703 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 937/1890] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:48:56 2022] DELETE /identity/v3/users/788a06d79cd24be8a00200ddb72c99bd => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:57.241206 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10f288-ef7a-4c32-88ef-8780df364204 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:57.244394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-df10f288-ef7a-4c32-88ef-8780df364204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:57.285553 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ad483-b636-4aed-a42e-7835abd94e6c service cinder] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:57.463204 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10f288-ef7a-4c32-88ef-8780df364204 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:57.478075 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85433762-3361-4688-a9d2-d9fb8f277c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:57.478996 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85433762-3361-4688-a9d2-d9fb8f277c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:57.479300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85433762-3361-4688-a9d2-d9fb8f277c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:57.479589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85433762-3361-4688-a9d2-d9fb8f277c9a admin admin] PATH_INFO: `/v3/projects/a793008284b348d0949c98bd30d034a9` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:57.484221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85433762-3361-4688-a9d2-d9fb8f277c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a793008284b348d0949c98bd30d034a9)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:57.486653 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85433762-3361-4688-a9d2-d9fb8f277c9a admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:57.488849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c831c-4b21-4758-b6b4-0eabce145519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:57.489841 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c831c-4b21-4758-b6b4-0eabce145519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:57.490128 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c831c-4b21-4758-b6b4-0eabce145519 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:57.490422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c831c-4b21-4758-b6b4-0eabce145519 admin admin] PATH_INFO: `/v3/projects/10ddac9a84304145b026a8c2bd1b73ca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:57.502960 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c831c-4b21-4758-b6b4-0eabce145519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ddac9a84304145b026a8c2bd1b73ca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:57.505335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c831c-4b21-4758-b6b4-0eabce145519 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:57.508409 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:57.624201 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-85433762-3361-4688-a9d2-d9fb8f277c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a793008284b348d0949c98bd30d034a9', 'request_id': 'req-85433762-3361-4688-a9d2-d9fb8f277c9a'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:57.635797 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-85433762-3361-4688-a9d2-d9fb8f277c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a793008284b348d0949c98bd30d034a9', 'request_id': 'req-85433762-3361-4688-a9d2-d9fb8f277c9a'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:57.651851 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-85433762-3361-4688-a9d2-d9fb8f277c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a793008284b348d0949c98bd30d034a9', 'request_id': 'req-85433762-3361-4688-a9d2-d9fb8f277c9a'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:57.690175 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-85433762-3361-4688-a9d2-d9fb8f277c9a admin admin] The token cache is being invalidate because project a793008284b348d0949c98bd30d034a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:48:57.690476 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-85433762-3361-4688-a9d2-d9fb8f277c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:57.691698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-85433762-3361-4688-a9d2-d9fb8f277c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:57.693009 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b53c831c-4b21-4758-b6b4-0eabce145519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ddac9a84304145b026a8c2bd1b73ca', 'request_id': 'req-b53c831c-4b21-4758-b6b4-0eabce145519'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:57.701581 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 954/1891] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:48:57 2022] DELETE /identity/v3/projects/a793008284b348d0949c98bd30d034a9 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:57.704962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53529be-7354-4c6c-a563-ab38bb7cda46 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:57.705225 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53529be-7354-4c6c-a563-ab38bb7cda46 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:57.705464 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53529be-7354-4c6c-a563-ab38bb7cda46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:57.741300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b53c831c-4b21-4758-b6b4-0eabce145519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ddac9a84304145b026a8c2bd1b73ca', 'request_id': 'req-b53c831c-4b21-4758-b6b4-0eabce145519'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:57.765480 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-f53529be-7354-4c6c-a563-ab38bb7cda46 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:57.782651 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b53c831c-4b21-4758-b6b4-0eabce145519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ddac9a84304145b026a8c2bd1b73ca', 'request_id': 'req-b53c831c-4b21-4758-b6b4-0eabce145519'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:57.783479 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-f53529be-7354-4c6c-a563-ab38bb7cda46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:57.821547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b53c831c-4b21-4758-b6b4-0eabce145519 admin admin] The token cache is being invalidate because project 10ddac9a84304145b026a8c2bd1b73ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:48:57.821880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b53c831c-4b21-4758-b6b4-0eabce145519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:57.842657 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b53c831c-4b21-4758-b6b4-0eabce145519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:57.847421 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 938/1892] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:48:57 2022] DELETE /identity/v3/projects/10ddac9a84304145b026a8c2bd1b73ca => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:57.849867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8166d55-aede-4a91-9701-daca87b3733f None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:57.850161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8166d55-aede-4a91-9701-daca87b3733f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:57.853227 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8166d55-aede-4a91-9701-daca87b3733f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:57.888739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:57.941075 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-d8166d55-aede-4a91-9701-daca87b3733f None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:57.944950 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d8166d55-aede-4a91-9701-daca87b3733f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:57.965225 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 955/1893] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:57.971942 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 939/1894] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:57.973842 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8166d55-aede-4a91-9701-daca87b3733f None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:57.975704 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53529be-7354-4c6c-a563-ab38bb7cda46 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:57.980055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d8166d55-aede-4a91-9701-daca87b3733f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:57.980753 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-f53529be-7354-4c6c-a563-ab38bb7cda46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:58.000083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53529be-7354-4c6c-a563-ab38bb7cda46 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:58.011675 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351af5d4-7c47-4f45-9f07-b6ee07b2831c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:58.013217 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af5d4-7c47-4f45-9f07-b6ee07b2831c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:58.013727 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af5d4-7c47-4f45-9f07-b6ee07b2831c admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:58.014007 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af5d4-7c47-4f45-9f07-b6ee07b2831c admin admin] PATH_INFO: `/v3/users/8b282d37f116406f871bf743ca63cf3c` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:58.016019 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351af5d4-7c47-4f45-9f07-b6ee07b2831c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b282d37f116406f871bf743ca63cf3c)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:58.019772 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351af5d4-7c47-4f45-9f07-b6ee07b2831c admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:58.105693 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8166d55-aede-4a91-9701-daca87b3733f None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:58.116644 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c0bbc-7945-486a-a64e-93cfab3b01ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:58.118353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c0bbc-7945-486a-a64e-93cfab3b01ef service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:58.118969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c0bbc-7945-486a-a64e-93cfab3b01ef service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:58.119479 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c0bbc-7945-486a-a64e-93cfab3b01ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:58.127511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-351af5d4-7c47-4f45-9f07-b6ee07b2831c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b282d37f116406f871bf743ca63cf3c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:58.138509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c0bbc-7945-486a-a64e-93cfab3b01ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:58.140572 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c0bbc-7945-486a-a64e-93cfab3b01ef service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:58.143480 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-351af5d4-7c47-4f45-9f07-b6ee07b2831c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b282d37f116406f871bf743ca63cf3c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:58.159373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 940/1895] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:58.161069 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bd57d-1488-4d1e-b68d-28ee2ab93b26 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:58.161470 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bd57d-1488-4d1e-b68d-28ee2ab93b26 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:58.161774 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bd57d-1488-4d1e-b68d-28ee2ab93b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:58.166709 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-351af5d4-7c47-4f45-9f07-b6ee07b2831c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b282d37f116406f871bf743ca63cf3c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:58.167556 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-351af5d4-7c47-4f45-9f07-b6ee07b2831c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b282d37f116406f871bf743ca63cf3c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:58.179856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-351af5d4-7c47-4f45-9f07-b6ee07b2831c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b282d37f116406f871bf743ca63cf3c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:58.188917 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 956/1896] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:48:57 2022] DELETE /identity/v3/users/8b282d37f116406f871bf743ca63cf3c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:58.189918 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351af5d4-7c47-4f45-9f07-b6ee07b2831c admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:58.192493 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-351af5d4-7c47-4f45-9f07-b6ee07b2831c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:58.196632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-425bd57d-1488-4d1e-b68d-28ee2ab93b26 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:58.198050 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-425bd57d-1488-4d1e-b68d-28ee2ab93b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:58.278607 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351af5d4-7c47-4f45-9f07-b6ee07b2831c admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:58.294428 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c02c16-b84f-4d9d-b4c7-88e90ca2cb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:58.295414 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c02c16-b84f-4d9d-b4c7-88e90ca2cb2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:58.295835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c02c16-b84f-4d9d-b4c7-88e90ca2cb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:58.295966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c02c16-b84f-4d9d-b4c7-88e90ca2cb2f admin admin] PATH_INFO: `/v3/users/a31c0b64f2e14e3d82ea5367474f504e` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:58.297376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c02c16-b84f-4d9d-b4c7-88e90ca2cb2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a31c0b64f2e14e3d82ea5367474f504e)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:58.299689 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c02c16-b84f-4d9d-b4c7-88e90ca2cb2f admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:58.301459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 941/1897] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:58.308013 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bd57d-1488-4d1e-b68d-28ee2ab93b26 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:58.324530 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bd57d-1488-4d1e-b68d-28ee2ab93b26 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:58.331669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25570bbf-d205-4ee7-ab0c-3d48480b974d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:58.332424 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25570bbf-d205-4ee7-ab0c-3d48480b974d admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:58.332903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25570bbf-d205-4ee7-ab0c-3d48480b974d admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:58.333274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25570bbf-d205-4ee7-ab0c-3d48480b974d admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:58.334159 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25570bbf-d205-4ee7-ab0c-3d48480b974d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:48:58.334544 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25570bbf-d205-4ee7-ab0c-3d48480b974d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:58.337811 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25570bbf-d205-4ee7-ab0c-3d48480b974d admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:58.353988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 942/1898] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:48:58.358987 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25570bbf-d205-4ee7-ab0c-3d48480b974d admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:58.361234 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-46c02c16-b84f-4d9d-b4c7-88e90ca2cb2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a31c0b64f2e14e3d82ea5367474f504e'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:58.364304 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:58.370987 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25570bbf-d205-4ee7-ab0c-3d48480b974d admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:58.376205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-46c02c16-b84f-4d9d-b4c7-88e90ca2cb2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a31c0b64f2e14e3d82ea5367474f504e'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:58.379366 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81eb6c1-a277-4216-86b8-47f43edf91a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:58.380230 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81eb6c1-a277-4216-86b8-47f43edf91a3 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:58.380636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81eb6c1-a277-4216-86b8-47f43edf91a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:58.380985 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81eb6c1-a277-4216-86b8-47f43edf91a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:58.382040 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81eb6c1-a277-4216-86b8-47f43edf91a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:58.385312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81eb6c1-a277-4216-86b8-47f43edf91a3 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:58.394824 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-46c02c16-b84f-4d9d-b4c7-88e90ca2cb2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a31c0b64f2e14e3d82ea5367474f504e'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:58.395810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-46c02c16-b84f-4d9d-b4c7-88e90ca2cb2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a31c0b64f2e14e3d82ea5367474f504e'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:58.402949 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:58.405434 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-46c02c16-b84f-4d9d-b4c7-88e90ca2cb2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a31c0b64f2e14e3d82ea5367474f504e'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:58.414216 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 957/1899] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:48:58 2022] DELETE /identity/v3/users/a31c0b64f2e14e3d82ea5367474f504e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:58.421004 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8f22f-6ad6-4831-ba5e-2022ed8b9718 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:58.423806 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8f22f-6ad6-4831-ba5e-2022ed8b9718 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:58.424279 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8f22f-6ad6-4831-ba5e-2022ed8b9718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:58.435212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 943/1900] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:58 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:58.436559 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81eb6c1-a277-4216-86b8-47f43edf91a3 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:58.440605 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a81eb6c1-a277-4216-86b8-47f43edf91a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:58.463702 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-3aa8f22f-6ad6-4831-ba5e-2022ed8b9718 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:58.464953 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-3aa8f22f-6ad6-4831-ba5e-2022ed8b9718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:58.557464 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 958/1901] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:48:58.567825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8f22f-6ad6-4831-ba5e-2022ed8b9718 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:58.572014 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-3aa8f22f-6ad6-4831-ba5e-2022ed8b9718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:58.591959 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81eb6c1-a277-4216-86b8-47f43edf91a3 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:58.599185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2e860-69b2-4848-872a-888b336b6d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:58.600470 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2e860-69b2-4848-872a-888b336b6d9c admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:58.601273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2e860-69b2-4848-872a-888b336b6d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:58.601498 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2e860-69b2-4848-872a-888b336b6d9c admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:58.602889 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2e860-69b2-4848-872a-888b336b6d9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:58.605830 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2e860-69b2-4848-872a-888b336b6d9c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:58.647312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 944/1902] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:58 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:58.648136 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2e860-69b2-4848-872a-888b336b6d9c admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:58.652160 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-95a2e860-69b2-4848-872a-888b336b6d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:58.666064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8f22f-6ad6-4831-ba5e-2022ed8b9718 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:58.666233 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2e860-69b2-4848-872a-888b336b6d9c admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:58.669959 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedec2d-b529-4100-a749-19db43c400de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:58.670627 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedec2d-b529-4100-a749-19db43c400de service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:58.670807 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515f674-803c-49bb-bef0-336e346e9731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:58.670919 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedec2d-b529-4100-a749-19db43c400de service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:58.671181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedec2d-b529-4100-a749-19db43c400de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:58.671994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515f674-803c-49bb-bef0-336e346e9731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:58.672278 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515f674-803c-49bb-bef0-336e346e9731 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:58.672553 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515f674-803c-49bb-bef0-336e346e9731 admin admin] PATH_INFO: `/v3/projects/26455b76afb04917a8f80b5e9e707a93` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:58.673806 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515f674-803c-49bb-bef0-336e346e9731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26455b76afb04917a8f80b5e9e707a93)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:58.675735 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515f674-803c-49bb-bef0-336e346e9731 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:58.683374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedec2d-b529-4100-a749-19db43c400de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:58.685986 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedec2d-b529-4100-a749-19db43c400de service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:58.697559 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 959/1903] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:48:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:48:58.698408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedec2d-b529-4100-a749-19db43c400de service neutron] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:58.699766 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-8aedec2d-b529-4100-a749-19db43c400de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:58.715957 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedec2d-b529-4100-a749-19db43c400de service neutron] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:58.720980 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5e2b6-ef50-4920-be13-9f240a82bd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:58.721968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5e2b6-ef50-4920-be13-9f240a82bd45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:58.722320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5e2b6-ef50-4920-be13-9f240a82bd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:58.722696 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5e2b6-ef50-4920-be13-9f240a82bd45 admin admin] PATH_INFO: `/v3/projects/06db0669b51344f594c923eea6462932` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:58.724647 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5e2b6-ef50-4920-be13-9f240a82bd45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06db0669b51344f594c923eea6462932)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:58.726247 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5e2b6-ef50-4920-be13-9f240a82bd45 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:58.742557 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-7515f674-803c-49bb-bef0-336e346e9731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26455b76afb04917a8f80b5e9e707a93', 'request_id': 'req-7515f674-803c-49bb-bef0-336e346e9731'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:58.752871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-7515f674-803c-49bb-bef0-336e346e9731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26455b76afb04917a8f80b5e9e707a93', 'request_id': 'req-7515f674-803c-49bb-bef0-336e346e9731'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:58.764478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-7515f674-803c-49bb-bef0-336e346e9731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26455b76afb04917a8f80b5e9e707a93', 'request_id': 'req-7515f674-803c-49bb-bef0-336e346e9731'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:58.783468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-7515f674-803c-49bb-bef0-336e346e9731 admin admin] The token cache is being invalidate because project 26455b76afb04917a8f80b5e9e707a93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:48:58.783809 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-7515f674-803c-49bb-bef0-336e346e9731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:58.784819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-7515f674-803c-49bb-bef0-336e346e9731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:58.788069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e4a5e2b6-ef50-4920-be13-9f240a82bd45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06db0669b51344f594c923eea6462932', 'request_id': 'req-e4a5e2b6-ef50-4920-be13-9f240a82bd45'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:58.788252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 945/1904] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:48:58 2022] DELETE /identity/v3/projects/26455b76afb04917a8f80b5e9e707a93 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:58.789122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515f674-803c-49bb-bef0-336e346e9731 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:58.791623 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7515f674-803c-49bb-bef0-336e346e9731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:58.801652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e4a5e2b6-ef50-4920-be13-9f240a82bd45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06db0669b51344f594c923eea6462932', 'request_id': 'req-e4a5e2b6-ef50-4920-be13-9f240a82bd45'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:58.812342 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e4a5e2b6-ef50-4920-be13-9f240a82bd45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06db0669b51344f594c923eea6462932', 'request_id': 'req-e4a5e2b6-ef50-4920-be13-9f240a82bd45'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:58.817165 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:58.832588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e4a5e2b6-ef50-4920-be13-9f240a82bd45 admin admin] The token cache is being invalidate because project 06db0669b51344f594c923eea6462932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:48:58.833222 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e4a5e2b6-ef50-4920-be13-9f240a82bd45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:58.834552 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e4a5e2b6-ef50-4920-be13-9f240a82bd45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:58.838004 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 960/1905] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:48:58 2022] DELETE /identity/v3/projects/06db0669b51344f594c923eea6462932 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:58.839488 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5e2b6-ef50-4920-be13-9f240a82bd45 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:58.843350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e4a5e2b6-ef50-4920-be13-9f240a82bd45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:58.938909 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515f674-803c-49bb-bef0-336e346e9731 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:58.946461 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5e2b6-ef50-4920-be13-9f240a82bd45 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:58.947036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0304dc-2f04-4b36-a9a1-17723bf3ada4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:58.947782 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0304dc-2f04-4b36-a9a1-17723bf3ada4 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:58.948066 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0304dc-2f04-4b36-a9a1-17723bf3ada4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:58.948343 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0304dc-2f04-4b36-a9a1-17723bf3ada4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:58.949082 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0304dc-2f04-4b36-a9a1-17723bf3ada4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:58.950697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0304dc-2f04-4b36-a9a1-17723bf3ada4 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:58.951439 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ef5bc-0cce-4e7d-848b-0fe163c42350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:58.952436 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ef5bc-0cce-4e7d-848b-0fe163c42350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:58.952796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ef5bc-0cce-4e7d-848b-0fe163c42350 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:58.953488 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ef5bc-0cce-4e7d-848b-0fe163c42350 admin admin] PATH_INFO: `/v3/users/9c4e6d4499cb4b78b160adb8740e8991` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:58.954405 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ef5bc-0cce-4e7d-848b-0fe163c42350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c4e6d4499cb4b78b160adb8740e8991)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:58.956485 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ef5bc-0cce-4e7d-848b-0fe163c42350 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:58.963297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 946/1906] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:58.964821 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e891b3-f38c-4747-8aa2-0252f05e8f97 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:58.965184 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e891b3-f38c-4747-8aa2-0252f05e8f97 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:58.966286 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e891b3-f38c-4747-8aa2-0252f05e8f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:58.975162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:58.987445 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-52e891b3-f38c-4747-8aa2-0252f05e8f97 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:58.989176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-52e891b3-f38c-4747-8aa2-0252f05e8f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:59.000596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 947/1907] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:59.001684 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e891b3-f38c-4747-8aa2-0252f05e8f97 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:59.003505 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-52e891b3-f38c-4747-8aa2-0252f05e8f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:59.020837 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e891b3-f38c-4747-8aa2-0252f05e8f97 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:59.027303 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee178759-8bd9-4644-9a02-ed075c9d6186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:59.028580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee178759-8bd9-4644-9a02-ed075c9d6186 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:59.029069 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee178759-8bd9-4644-9a02-ed075c9d6186 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:59.029426 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee178759-8bd9-4644-9a02-ed075c9d6186 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:59.030869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee178759-8bd9-4644-9a02-ed075c9d6186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:59.033097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee178759-8bd9-4644-9a02-ed075c9d6186 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:59.051533 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-c46ef5bc-0cce-4e7d-848b-0fe163c42350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c4e6d4499cb4b78b160adb8740e8991'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:59.060439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 948/1908] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:59.060439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6c9e7-9582-40bc-b42e-d4403996b35e None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:59.060439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6c9e7-9582-40bc-b42e-d4403996b35e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:59.060439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6c9e7-9582-40bc-b42e-d4403996b35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:59.069385 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-c46ef5bc-0cce-4e7d-848b-0fe163c42350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c4e6d4499cb4b78b160adb8740e8991'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:59.081984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-abc6c9e7-9582-40bc-b42e-d4403996b35e None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:59.083454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-abc6c9e7-9582-40bc-b42e-d4403996b35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:59.094422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 949/1909] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:59.095425 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6c9e7-9582-40bc-b42e-d4403996b35e None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:59.099872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-c46ef5bc-0cce-4e7d-848b-0fe163c42350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c4e6d4499cb4b78b160adb8740e8991'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:59.103160 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-c46ef5bc-0cce-4e7d-848b-0fe163c42350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c4e6d4499cb4b78b160adb8740e8991'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:59.105883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6c9e7-9582-40bc-b42e-d4403996b35e None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:59.111299 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d028d5b-dedd-433f-bb57-b133b7933208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:59.112311 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d028d5b-dedd-433f-bb57-b133b7933208 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:59.112662 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d028d5b-dedd-433f-bb57-b133b7933208 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:59.113001 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d028d5b-dedd-433f-bb57-b133b7933208 admin admin] PATH_INFO: `/v3/projects/5b7a9c3d0d9b4ef9bd6db164d33bcc6a/users/6df21630d6a24eefb71226012b0981bc/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:59.118414 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-c46ef5bc-0cce-4e7d-848b-0fe163c42350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c4e6d4499cb4b78b160adb8740e8991'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:59.131410 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 961/1910] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:48:58 2022] DELETE /identity/v3/users/9c4e6d4499cb4b78b160adb8740e8991 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:59.132925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d028d5b-dedd-433f-bb57-b133b7933208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b7a9c3d0d9b4ef9bd6db164d33bcc6a, user_id=6df21630d6a24eefb71226012b0981bc, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:59.134055 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ef5bc-0cce-4e7d-848b-0fe163c42350 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:59.135988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-c46ef5bc-0cce-4e7d-848b-0fe163c42350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:59.136379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d028d5b-dedd-433f-bb57-b133b7933208 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:59.156283 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 950/1911] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:59 2022] PUT /identity/v3/projects/5b7a9c3d0d9b4ef9bd6db164d33bcc6a/users/6df21630d6a24eefb71226012b0981bc/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:59.169199 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44216119-e4cb-4323-b469-24866244b590 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:59.169546 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44216119-e4cb-4323-b469-24866244b590 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:59.169897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44216119-e4cb-4323-b469-24866244b590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:59.218466 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-44216119-e4cb-4323-b469-24866244b590 None None] MFA Rules not processed for user `6df21630d6a24eefb71226012b0981bc`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:48:59.219739 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-44216119-e4cb-4323-b469-24866244b590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:59.299026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ef5bc-0cce-4e7d-848b-0fe163c42350 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:59.320336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:59.326686 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 951/1912] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:48:59.327970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44216119-e4cb-4323-b469-24866244b590 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:59.330427 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-44216119-e4cb-4323-b469-24866244b590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:59.406478 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0553e3c-76d8-495f-ae43-9ef7c522105a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:59.407393 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0553e3c-76d8-495f-ae43-9ef7c522105a admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:59.407734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0553e3c-76d8-495f-ae43-9ef7c522105a admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:59.408017 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0553e3c-76d8-495f-ae43-9ef7c522105a admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:59.408773 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0553e3c-76d8-495f-ae43-9ef7c522105a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:48:59.409129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0553e3c-76d8-495f-ae43-9ef7c522105a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:59.411932 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0553e3c-76d8-495f-ae43-9ef7c522105a admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:59.432735 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 962/1913] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:48:59.433902 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0553e3c-76d8-495f-ae43-9ef7c522105a admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:59.443839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44216119-e4cb-4323-b469-24866244b590 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:59.451410 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b5e1f-5da8-4829-bb59-a2f786be4763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:59.452518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b5e1f-5da8-4829-bb59-a2f786be4763 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:59.453079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b5e1f-5da8-4829-bb59-a2f786be4763 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:59.453227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0553e3c-76d8-495f-ae43-9ef7c522105a admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:59.453926 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b5e1f-5da8-4829-bb59-a2f786be4763 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:59.455327 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b5e1f-5da8-4829-bb59-a2f786be4763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:59.457996 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b5e1f-5da8-4829-bb59-a2f786be4763 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:59.468716 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569e719-ff6c-4816-8c32-f162cb5d8ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:59.469966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569e719-ff6c-4816-8c32-f162cb5d8ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:59.470421 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569e719-ff6c-4816-8c32-f162cb5d8ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:59.470859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569e719-ff6c-4816-8c32-f162cb5d8ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:59.471822 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569e719-ff6c-4816-8c32-f162cb5d8ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:59.474852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569e719-ff6c-4816-8c32-f162cb5d8ae6 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:59.502595 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 952/1914] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:59 2022] POST /identity/v3/projects => generated 387 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:59.504457 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b5e1f-5da8-4829-bb59-a2f786be4763 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:59.516449 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 963/1915] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:48:59 2022] POST /identity/v3/projects => generated 369 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:59.522104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569e719-ff6c-4816-8c32-f162cb5d8ae6 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:59.556826 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:59.611413 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569e719-ff6c-4816-8c32-f162cb5d8ae6 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:59.619381 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a4f5b-5953-4360-9e95-39bcf9138013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:59.620807 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a4f5b-5953-4360-9e95-39bcf9138013 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:59.621300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a4f5b-5953-4360-9e95-39bcf9138013 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:59.621812 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a4f5b-5953-4360-9e95-39bcf9138013 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:59.623623 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a4f5b-5953-4360-9e95-39bcf9138013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:59.625942 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a4f5b-5953-4360-9e95-39bcf9138013 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:59.639778 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b5e1f-5da8-4829-bb59-a2f786be4763 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:59.669713 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67496c85-d5ae-47ee-b9ed-98a9337d8f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:59.671468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67496c85-d5ae-47ee-b9ed-98a9337d8f89 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:59.674190 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67496c85-d5ae-47ee-b9ed-98a9337d8f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:59.679198 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67496c85-d5ae-47ee-b9ed-98a9337d8f89 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:59.679198 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67496c85-d5ae-47ee-b9ed-98a9337d8f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:59.679500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 964/1916] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:59 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:59.681851 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67496c85-d5ae-47ee-b9ed-98a9337d8f89 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:59.682570 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a4f5b-5953-4360-9e95-39bcf9138013 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:59.704115 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a4f5b-5953-4360-9e95-39bcf9138013 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:59.714972 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 953/1917] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:48:59 2022] POST /identity/v3/users => generated 294 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:48:59.719734 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67496c85-d5ae-47ee-b9ed-98a9337d8f89 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:59.725126 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec148a10-6763-405b-ae33-00adb995c3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:59.725906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec148a10-6763-405b-ae33-00adb995c3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:59.726195 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec148a10-6763-405b-ae33-00adb995c3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:59.726478 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec148a10-6763-405b-ae33-00adb995c3e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:59.727275 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec148a10-6763-405b-ae33-00adb995c3e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:59.729860 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec148a10-6763-405b-ae33-00adb995c3e2 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:59.733406 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67496c85-d5ae-47ee-b9ed-98a9337d8f89 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:59.739312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0118cb-5f89-481d-aebe-7d64ebfbdd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:59.741341 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0118cb-5f89-481d-aebe-7d64ebfbdd61 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:59.741341 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0118cb-5f89-481d-aebe-7d64ebfbdd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:59.741341 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0118cb-5f89-481d-aebe-7d64ebfbdd61 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:59.741341 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0118cb-5f89-481d-aebe-7d64ebfbdd61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:59.741830 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 965/1918] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:59.746518 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec148a10-6763-405b-ae33-00adb995c3e2 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:59.747325 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0118cb-5f89-481d-aebe-7d64ebfbdd61 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:59.758977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec148a10-6763-405b-ae33-00adb995c3e2 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:59.760028 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 954/1919] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:59.765667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0118cb-5f89-481d-aebe-7d64ebfbdd61 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:59.768531 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19a0c1-0596-4e95-b721-2d037d90999a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:59.769276 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19a0c1-0596-4e95-b721-2d037d90999a admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:59.769597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19a0c1-0596-4e95-b721-2d037d90999a admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:59.770010 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19a0c1-0596-4e95-b721-2d037d90999a admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:59.771295 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19a0c1-0596-4e95-b721-2d037d90999a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:59.773146 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19a0c1-0596-4e95-b721-2d037d90999a admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:59.778672 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0118cb-5f89-481d-aebe-7d64ebfbdd61 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:59.784481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9da8d-6e4a-4927-adce-cc4fae37f9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:59.785718 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9da8d-6e4a-4927-adce-cc4fae37f9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:59.786115 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9da8d-6e4a-4927-adce-cc4fae37f9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:59.786637 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9da8d-6e4a-4927-adce-cc4fae37f9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:59.787511 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9da8d-6e4a-4927-adce-cc4fae37f9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:59.789093 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 966/1920] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:59.790165 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19a0c1-0596-4e95-b721-2d037d90999a admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:59.791913 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-0b19a0c1-0596-4e95-b721-2d037d90999a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:48:59.795209 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e9da8d-6e4a-4927-adce-cc4fae37f9a4 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:59.817450 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 955/1921] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:48:59.817450 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9da8d-6e4a-4927-adce-cc4fae37f9a4 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:59.818214 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19a0c1-0596-4e95-b721-2d037d90999a admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:59.825449 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ab281-d150-4324-9ce1-0aa993f7e54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:59.827330 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ab281-d150-4324-9ce1-0aa993f7e54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:59.827843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ab281-d150-4324-9ce1-0aa993f7e54e admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:59.828162 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ab281-d150-4324-9ce1-0aa993f7e54e admin admin] PATH_INFO: `/v3/projects/261c36f7fb894e1ab4516a65b4f7e1d3` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:59.830633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ab281-d150-4324-9ce1-0aa993f7e54e admin admin] RBAC: Authorizing `identity:delete_project(project_id=261c36f7fb894e1ab4516a65b4f7e1d3)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:59.832906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9da8d-6e4a-4927-adce-cc4fae37f9a4 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:48:59.833584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ab281-d150-4324-9ce1-0aa993f7e54e admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:59.838975 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30807bf7-0606-491b-8217-fa202b819636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:48:59.840307 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30807bf7-0606-491b-8217-fa202b819636 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:59.840705 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30807bf7-0606-491b-8217-fa202b819636 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:59.841556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30807bf7-0606-491b-8217-fa202b819636 admin admin] PATH_INFO: `/v3/projects/a55b40ac223f47bf9f45936d46bee5aa/users/06d972edbce84778837ed73122efac9d/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:59.860874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30807bf7-0606-491b-8217-fa202b819636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55b40ac223f47bf9f45936d46bee5aa, user_id=06d972edbce84778837ed73122efac9d, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:48:59.863847 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30807bf7-0606-491b-8217-fa202b819636 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:48:59.882230 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 956/1922] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:59 2022] PUT /identity/v3/projects/a55b40ac223f47bf9f45936d46bee5aa/users/06d972edbce84778837ed73122efac9d/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:59.884236 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30807bf7-0606-491b-8217-fa202b819636 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:48:59.927964 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-319ab281-d150-4324-9ce1-0aa993f7e54e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '261c36f7fb894e1ab4516a65b4f7e1d3', 'request_id': 'req-319ab281-d150-4324-9ce1-0aa993f7e54e'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:59.933438 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:48:59.939895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-319ab281-d150-4324-9ce1-0aa993f7e54e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '261c36f7fb894e1ab4516a65b4f7e1d3', 'request_id': 'req-319ab281-d150-4324-9ce1-0aa993f7e54e'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:59.955358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-319ab281-d150-4324-9ce1-0aa993f7e54e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '261c36f7fb894e1ab4516a65b4f7e1d3', 'request_id': 'req-319ab281-d150-4324-9ce1-0aa993f7e54e'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:59.972311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-319ab281-d150-4324-9ce1-0aa993f7e54e admin admin] The token cache is being invalidate because project 261c36f7fb894e1ab4516a65b4f7e1d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:48:59.972617 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-319ab281-d150-4324-9ce1-0aa993f7e54e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:59.973324 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-319ab281-d150-4324-9ce1-0aa993f7e54e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:48:59.975147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 967/1923] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:48:59 2022] DELETE /identity/v3/projects/261c36f7fb894e1ab4516a65b4f7e1d3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:48:59.976409 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830a7a7-7481-4775-92ae-c473fd3871a4 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:48:59.976715 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830a7a7-7481-4775-92ae-c473fd3871a4 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:48:59.977642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9830a7a7-7481-4775-92ae-c473fd3871a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:48:59.981715 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30807bf7-0606-491b-8217-fa202b819636 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:00.004594 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-9830a7a7-7481-4775-92ae-c473fd3871a4 None None] MFA Rules not processed for user `06d972edbce84778837ed73122efac9d`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:00.005877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9830a7a7-7481-4775-92ae-c473fd3871a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:00.042851 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793f015-4902-4314-81d9-2fef9c915aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:00.044003 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793f015-4902-4314-81d9-2fef9c915aa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:00.044290 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793f015-4902-4314-81d9-2fef9c915aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:00.044564 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793f015-4902-4314-81d9-2fef9c915aa8 admin admin] PATH_INFO: `/v3/projects/bccfb5996fd34a9ca2e0178c5ba3eaf4/users/472eb894ed634b3293a59136a7f007f6/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:00.067375 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793f015-4902-4314-81d9-2fef9c915aa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bccfb5996fd34a9ca2e0178c5ba3eaf4, user_id=472eb894ed634b3293a59136a7f007f6, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:00.070363 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793f015-4902-4314-81d9-2fef9c915aa8 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:00.070951 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 968/1924] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:48:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:00.071991 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830a7a7-7481-4775-92ae-c473fd3871a4 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:00.075356 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9830a7a7-7481-4775-92ae-c473fd3871a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:00.087019 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 957/1925] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:48:59 2022] PUT /identity/v3/projects/bccfb5996fd34a9ca2e0178c5ba3eaf4/users/472eb894ed634b3293a59136a7f007f6/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:00.087930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793f015-4902-4314-81d9-2fef9c915aa8 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:00.089479 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c793f015-4902-4314-81d9-2fef9c915aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:00.089590 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9830a7a7-7481-4775-92ae-c473fd3871a4 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:00.097074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:00.151090 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ba35e-ef2c-41d6-b7f3-0d4b15f9a6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:00.151989 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ba35e-ef2c-41d6-b7f3-0d4b15f9a6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:00.152293 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ba35e-ef2c-41d6-b7f3-0d4b15f9a6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:00.152597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ba35e-ef2c-41d6-b7f3-0d4b15f9a6d5 admin admin] PATH_INFO: `/v3/projects/b363022181954311aa4be403588d61a1` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:00.153828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ba35e-ef2c-41d6-b7f3-0d4b15f9a6d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b363022181954311aa4be403588d61a1)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:00.155923 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ba35e-ef2c-41d6-b7f3-0d4b15f9a6d5 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:00.156869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793f015-4902-4314-81d9-2fef9c915aa8 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:00.161914 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bbb25-87ce-4a40-ab20-917427197f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:00.162794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bbb25-87ce-4a40-ab20-917427197f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:00.163079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bbb25-87ce-4a40-ab20-917427197f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:00.163386 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bbb25-87ce-4a40-ab20-917427197f7b admin admin] PATH_INFO: `/v3/users/b3dec83d0eca4c85a55f6b9056da5557` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:00.165123 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bbb25-87ce-4a40-ab20-917427197f7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3dec83d0eca4c85a55f6b9056da5557)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:00.167772 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636bbb25-87ce-4a40-ab20-917427197f7b admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:00.212266 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d09ba35e-ef2c-41d6-b7f3-0d4b15f9a6d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b363022181954311aa4be403588d61a1', 'request_id': 'req-d09ba35e-ef2c-41d6-b7f3-0d4b15f9a6d5'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:00.219455 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-636bbb25-87ce-4a40-ab20-917427197f7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3dec83d0eca4c85a55f6b9056da5557'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:00.221569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d09ba35e-ef2c-41d6-b7f3-0d4b15f9a6d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b363022181954311aa4be403588d61a1', 'request_id': 'req-d09ba35e-ef2c-41d6-b7f3-0d4b15f9a6d5'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:00.228146 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d09ba35e-ef2c-41d6-b7f3-0d4b15f9a6d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b363022181954311aa4be403588d61a1', 'request_id': 'req-d09ba35e-ef2c-41d6-b7f3-0d4b15f9a6d5'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:00.230179 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-636bbb25-87ce-4a40-ab20-917427197f7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3dec83d0eca4c85a55f6b9056da5557'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:00.240508 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d09ba35e-ef2c-41d6-b7f3-0d4b15f9a6d5 admin admin] The token cache is being invalidate because project b363022181954311aa4be403588d61a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:00.240802 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d09ba35e-ef2c-41d6-b7f3-0d4b15f9a6d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:00.241483 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d09ba35e-ef2c-41d6-b7f3-0d4b15f9a6d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:00.243465 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 969/1926] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:00 2022] DELETE /identity/v3/projects/b363022181954311aa4be403588d61a1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:00.244268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ba35e-ef2c-41d6-b7f3-0d4b15f9a6d5 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:00.245067 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-636bbb25-87ce-4a40-ab20-917427197f7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3dec83d0eca4c85a55f6b9056da5557'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:00.245684 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-d09ba35e-ef2c-41d6-b7f3-0d4b15f9a6d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:00.252106 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:00.253212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-636bbb25-87ce-4a40-ab20-917427197f7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3dec83d0eca4c85a55f6b9056da5557'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:00.253850 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-636bbb25-87ce-4a40-ab20-917427197f7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3dec83d0eca4c85a55f6b9056da5557'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:00.261911 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 958/1927] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:00 2022] DELETE /identity/v3/users/b3dec83d0eca4c85a55f6b9056da5557 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:00.263885 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5124c-8724-4478-a91d-6ad0de9eac87 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:00.264174 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5124c-8724-4478-a91d-6ad0de9eac87 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:00.264759 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5124c-8724-4478-a91d-6ad0de9eac87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:00.293152 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-24f5124c-8724-4478-a91d-6ad0de9eac87 None None] MFA Rules not processed for user `472eb894ed634b3293a59136a7f007f6`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:00.294813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-24f5124c-8724-4478-a91d-6ad0de9eac87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:00.329372 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ba35e-ef2c-41d6-b7f3-0d4b15f9a6d5 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:00.378861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 959/1928] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:00.380299 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bfd3b-f1c1-42ee-a777-b02258155176 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:00.380588 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bfd3b-f1c1-42ee-a777-b02258155176 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:00.380871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bfd3b-f1c1-42ee-a777-b02258155176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:00.399116 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee48b7-46ca-452d-a1f5-a22cf5e4d464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:00.400252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee48b7-46ca-452d-a1f5-a22cf5e4d464 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:00.400689 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee48b7-46ca-452d-a1f5-a22cf5e4d464 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:00.401189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee48b7-46ca-452d-a1f5-a22cf5e4d464 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:00.401919 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-ee8bfd3b-f1c1-42ee-a777-b02258155176 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:00.402239 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee48b7-46ca-452d-a1f5-a22cf5e4d464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:00.403272 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ee8bfd3b-f1c1-42ee-a777-b02258155176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:00.404524 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee48b7-46ca-452d-a1f5-a22cf5e4d464 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:00.412567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 960/1929] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:00.413373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bfd3b-f1c1-42ee-a777-b02258155176 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:00.414701 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ee8bfd3b-f1c1-42ee-a777-b02258155176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:00.425534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:00.430955 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bfd3b-f1c1-42ee-a777-b02258155176 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:00.441515 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a4f5e-fa56-4314-b592-7278f669b9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:00.443376 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a4f5e-fa56-4314-b592-7278f669b9b8 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:00.443705 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a4f5e-fa56-4314-b592-7278f669b9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:00.444022 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a4f5e-fa56-4314-b592-7278f669b9b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:00.444790 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a4f5e-fa56-4314-b592-7278f669b9b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:00.448530 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a4f5e-fa56-4314-b592-7278f669b9b8 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:00.450511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 970/1930] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:00 2022] POST /identity/v3/projects => generated 367 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:00.452551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556d387-eecf-4610-80a8-31bea50bcc32 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:00.452904 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556d387-eecf-4610-80a8-31bea50bcc32 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:00.453275 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556d387-eecf-4610-80a8-31bea50bcc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:00.474275 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-8556d387-eecf-4610-80a8-31bea50bcc32 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:00.475749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-8556d387-eecf-4610-80a8-31bea50bcc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:00.490218 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 961/1931] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:00 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:00.490218 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a4f5e-fa56-4314-b592-7278f669b9b8 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:00.491548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-118a4f5e-fa56-4314-b592-7278f669b9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:00.575751 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a4f5e-fa56-4314-b592-7278f669b9b8 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:00.580193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 971/1932] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:00.582560 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556d387-eecf-4610-80a8-31bea50bcc32 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:00.583826 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7ed5b-801a-4884-824b-78b94ff686f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:00.584527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7ed5b-801a-4884-824b-78b94ff686f6 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:00.584795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7ed5b-801a-4884-824b-78b94ff686f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:00.585066 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7ed5b-801a-4884-824b-78b94ff686f6 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:00.585797 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7ed5b-801a-4884-824b-78b94ff686f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:00.588345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7ed5b-801a-4884-824b-78b94ff686f6 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:00.599874 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556d387-eecf-4610-80a8-31bea50bcc32 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:00.607042 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd4809-bb69-43c3-99f3-8124fd759ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:00.608089 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd4809-bb69-43c3-99f3-8124fd759ece admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:00.608538 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd4809-bb69-43c3-99f3-8124fd759ece admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:00.609712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd4809-bb69-43c3-99f3-8124fd759ece admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:00.610641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd4809-bb69-43c3-99f3-8124fd759ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:00.612990 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 962/1933] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:00 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:00.613127 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7ed5b-801a-4884-824b-78b94ff686f6 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:00.616075 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd4809-bb69-43c3-99f3-8124fd759ece admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:00.627611 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7ed5b-801a-4884-824b-78b94ff686f6 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:00.632789 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7199d3-18f1-41b7-b852-2d044638d18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:00.634091 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7199d3-18f1-41b7-b852-2d044638d18d admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:00.634530 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7199d3-18f1-41b7-b852-2d044638d18d admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:00.634903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7199d3-18f1-41b7-b852-2d044638d18d admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:00.635928 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7199d3-18f1-41b7-b852-2d044638d18d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:49:00.636181 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7199d3-18f1-41b7-b852-2d044638d18d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:00.638187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7199d3-18f1-41b7-b852-2d044638d18d admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:00.660570 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 972/1935] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:00 2022] POST /identity/v3/users => generated 299 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:00.660784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 963/1935] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:49:00.661136 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd4809-bb69-43c3-99f3-8124fd759ece admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:00.661321 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7199d3-18f1-41b7-b852-2d044638d18d admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:00.672336 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7199d3-18f1-41b7-b852-2d044638d18d admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:00.677791 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf287da0-5397-4411-8c30-1ba4671fa8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:00.678583 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf287da0-5397-4411-8c30-1ba4671fa8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:00.678966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf287da0-5397-4411-8c30-1ba4671fa8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:00.679387 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf287da0-5397-4411-8c30-1ba4671fa8d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:00.680395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf287da0-5397-4411-8c30-1ba4671fa8d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:00.682278 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf287da0-5397-4411-8c30-1ba4671fa8d5 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:00.688322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd4809-bb69-43c3-99f3-8124fd759ece admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:00.703357 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c768b5-c69c-42ef-8eb0-2570001fb8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:00.704077 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c768b5-c69c-42ef-8eb0-2570001fb8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:00.704416 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c768b5-c69c-42ef-8eb0-2570001fb8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:00.704707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c768b5-c69c-42ef-8eb0-2570001fb8d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:00.705480 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c768b5-c69c-42ef-8eb0-2570001fb8d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:00.709811 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c768b5-c69c-42ef-8eb0-2570001fb8d4 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:00.731467 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 964/1936] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:00 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:00.733821 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf287da0-5397-4411-8c30-1ba4671fa8d5 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:00.751393 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 973/1937] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:00.752440 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c768b5-c69c-42ef-8eb0-2570001fb8d4 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:00.777133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c768b5-c69c-42ef-8eb0-2570001fb8d4 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:00.783467 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:00.837653 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf287da0-5397-4411-8c30-1ba4671fa8d5 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:00.843472 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d076888-4bae-489e-8e86-ffb710d4ee73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:00.844326 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d076888-4bae-489e-8e86-ffb710d4ee73 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:00.844673 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d076888-4bae-489e-8e86-ffb710d4ee73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:00.845303 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d076888-4bae-489e-8e86-ffb710d4ee73 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:00.846430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d076888-4bae-489e-8e86-ffb710d4ee73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:00.848352 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d076888-4bae-489e-8e86-ffb710d4ee73 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:00.861561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 965/1938] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:00.862455 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d076888-4bae-489e-8e86-ffb710d4ee73 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:00.873692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d076888-4bae-489e-8e86-ffb710d4ee73 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:00.879296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80139dce-fc10-4c70-a2b5-a9ac5afa0ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:00.880520 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80139dce-fc10-4c70-a2b5-a9ac5afa0ec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:00.880997 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80139dce-fc10-4c70-a2b5-a9ac5afa0ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:00.881508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80139dce-fc10-4c70-a2b5-a9ac5afa0ec6 admin admin] PATH_INFO: `/v3/projects/47ac32aae1e44bfd807a75a96ac33309/users/f5bc45e393b54e77a3531044e1fe8dc8/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:00.886854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fc785-d18e-4351-bda6-1d0310260fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:00.891077 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fc785-d18e-4351-bda6-1d0310260fab admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:00.891077 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fc785-d18e-4351-bda6-1d0310260fab admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:00.891523 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fc785-d18e-4351-bda6-1d0310260fab admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:00.892538 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fc785-d18e-4351-bda6-1d0310260fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:00.899722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fc785-d18e-4351-bda6-1d0310260fab admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:00.918351 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80139dce-fc10-4c70-a2b5-a9ac5afa0ec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47ac32aae1e44bfd807a75a96ac33309, user_id=f5bc45e393b54e77a3531044e1fe8dc8, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:00.921754 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80139dce-fc10-4c70-a2b5-a9ac5afa0ec6 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:00.932296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 974/1939] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:00 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:00.932296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fc785-d18e-4351-bda6-1d0310260fab admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:00.934657 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-d24fc785-d18e-4351-bda6-1d0310260fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:00.941409 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 966/1940] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:00 2022] PUT /identity/v3/projects/47ac32aae1e44bfd807a75a96ac33309/users/f5bc45e393b54e77a3531044e1fe8dc8/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:00.942005 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80139dce-fc10-4c70-a2b5-a9ac5afa0ec6 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:00.949096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fc785-d18e-4351-bda6-1d0310260fab admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:00.956240 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:01.014841 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80139dce-fc10-4c70-a2b5-a9ac5afa0ec6 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:01.019747 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abb816-9b57-435b-be09-7c08cd7ffee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:01.020789 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abb816-9b57-435b-be09-7c08cd7ffee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:01.021081 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abb816-9b57-435b-be09-7c08cd7ffee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:01.021359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64abb816-9b57-435b-be09-7c08cd7ffee7 admin admin] PATH_INFO: `/v3/projects/8306145b05d84d9c927fd0c14eaf37f0/users/2b374c79da2446abb409339a5ec18aac/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:01.022345 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a3ca2-63cc-49a9-a101-f3a64dcc47bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:01.023389 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a3ca2-63cc-49a9-a101-f3a64dcc47bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:01.023933 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a3ca2-63cc-49a9-a101-f3a64dcc47bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:01.024823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a3ca2-63cc-49a9-a101-f3a64dcc47bd admin admin] PATH_INFO: `/v3/projects/348e2134424e42a291a8d8e45feb4e22` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:01.027607 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a3ca2-63cc-49a9-a101-f3a64dcc47bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=348e2134424e42a291a8d8e45feb4e22)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:01.029901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a3ca2-63cc-49a9-a101-f3a64dcc47bd admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:01.046553 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abb816-9b57-435b-be09-7c08cd7ffee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8306145b05d84d9c927fd0c14eaf37f0, user_id=2b374c79da2446abb409339a5ec18aac, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:01.050952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64abb816-9b57-435b-be09-7c08cd7ffee7 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:01.075327 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 967/1941] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:00 2022] PUT /identity/v3/projects/8306145b05d84d9c927fd0c14eaf37f0/users/2b374c79da2446abb409339a5ec18aac/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:01.076261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abb816-9b57-435b-be09-7c08cd7ffee7 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:01.093775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-236a3ca2-63cc-49a9-a101-f3a64dcc47bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '348e2134424e42a291a8d8e45feb4e22', 'request_id': 'req-236a3ca2-63cc-49a9-a101-f3a64dcc47bd'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:01.104535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-236a3ca2-63cc-49a9-a101-f3a64dcc47bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '348e2134424e42a291a8d8e45feb4e22', 'request_id': 'req-236a3ca2-63cc-49a9-a101-f3a64dcc47bd'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:01.110848 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-236a3ca2-63cc-49a9-a101-f3a64dcc47bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '348e2134424e42a291a8d8e45feb4e22', 'request_id': 'req-236a3ca2-63cc-49a9-a101-f3a64dcc47bd'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:01.125549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-236a3ca2-63cc-49a9-a101-f3a64dcc47bd admin admin] The token cache is being invalidate because project 348e2134424e42a291a8d8e45feb4e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:01.125841 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-236a3ca2-63cc-49a9-a101-f3a64dcc47bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:01.126532 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-236a3ca2-63cc-49a9-a101-f3a64dcc47bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:01.128277 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 975/1942] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:00 2022] DELETE /identity/v3/projects/348e2134424e42a291a8d8e45feb4e22 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:01.129112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a3ca2-63cc-49a9-a101-f3a64dcc47bd admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:01.130603 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-236a3ca2-63cc-49a9-a101-f3a64dcc47bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:01.163494 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64abb816-9b57-435b-be09-7c08cd7ffee7 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:01.164641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:01.206374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a3ca2-63cc-49a9-a101-f3a64dcc47bd admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:01.212174 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf298f6e-e13d-41fd-81d4-15c6231a88f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:01.212885 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf298f6e-e13d-41fd-81d4-15c6231a88f9 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:01.213990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf298f6e-e13d-41fd-81d4-15c6231a88f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:01.213990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf298f6e-e13d-41fd-81d4-15c6231a88f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:01.214376 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf298f6e-e13d-41fd-81d4-15c6231a88f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:01.216070 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf298f6e-e13d-41fd-81d4-15c6231a88f9 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:01.226595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 976/1943] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:01.227585 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf298f6e-e13d-41fd-81d4-15c6231a88f9 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:01.229220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-cf298f6e-e13d-41fd-81d4-15c6231a88f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:01.230872 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a892c-68b8-4f3d-b967-f3bf634d8662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:01.231588 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a892c-68b8-4f3d-b967-f3bf634d8662 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:01.231868 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a892c-68b8-4f3d-b967-f3bf634d8662 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:01.232139 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a892c-68b8-4f3d-b967-f3bf634d8662 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:01.232861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a892c-68b8-4f3d-b967-f3bf634d8662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:01.234471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a892c-68b8-4f3d-b967-f3bf634d8662 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:01.241835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf298f6e-e13d-41fd-81d4-15c6231a88f9 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:01.245778 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 968/1944] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:01.245778 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd51912-6a74-4fc2-9eef-205bafd5f430 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:01.245778 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd51912-6a74-4fc2-9eef-205bafd5f430 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:01.245778 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd51912-6a74-4fc2-9eef-205bafd5f430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:01.250095 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecc945-ee3a-4c8b-8305-8fd135c384f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:01.250958 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecc945-ee3a-4c8b-8305-8fd135c384f5 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:01.251249 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecc945-ee3a-4c8b-8305-8fd135c384f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:01.251620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ecc945-ee3a-4c8b-8305-8fd135c384f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:01.252514 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecc945-ee3a-4c8b-8305-8fd135c384f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:01.254764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ecc945-ee3a-4c8b-8305-8fd135c384f5 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:01.266714 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-abd51912-6a74-4fc2-9eef-205bafd5f430 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:01.270204 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 977/1945] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:01.270339 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-abd51912-6a74-4fc2-9eef-205bafd5f430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:01.270446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecc945-ee3a-4c8b-8305-8fd135c384f5 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:01.276490 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 969/1946] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:01.277436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd51912-6a74-4fc2-9eef-205bafd5f430 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:01.278713 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-abd51912-6a74-4fc2-9eef-205bafd5f430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:01.278940 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ecc945-ee3a-4c8b-8305-8fd135c384f5 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:01.283843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478aa579-11d4-4911-8e61-c15b55ae3095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:01.284795 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aa579-11d4-4911-8e61-c15b55ae3095 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:01.285078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aa579-11d4-4911-8e61-c15b55ae3095 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:01.285774 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aa579-11d4-4911-8e61-c15b55ae3095 admin admin] PATH_INFO: `/v3/projects/47ac32aae1e44bfd807a75a96ac33309/users/f5bc45e393b54e77a3531044e1fe8dc8/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:01.287855 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478aa579-11d4-4911-8e61-c15b55ae3095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47ac32aae1e44bfd807a75a96ac33309, user_id=f5bc45e393b54e77a3531044e1fe8dc8, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:01.290551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478aa579-11d4-4911-8e61-c15b55ae3095 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:01.290943 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd51912-6a74-4fc2-9eef-205bafd5f430 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:01.295938 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a05da1-fa57-40a4-adff-6eac3d72b66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:01.296603 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a05da1-fa57-40a4-adff-6eac3d72b66e admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:01.296880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a05da1-fa57-40a4-adff-6eac3d72b66e admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:01.297153 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a05da1-fa57-40a4-adff-6eac3d72b66e admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:01.298126 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a05da1-fa57-40a4-adff-6eac3d72b66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:01.299655 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a05da1-fa57-40a4-adff-6eac3d72b66e admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:01.302241 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 978/1947] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:01 2022] PUT /identity/v3/projects/47ac32aae1e44bfd807a75a96ac33309/users/f5bc45e393b54e77a3531044e1fe8dc8/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:01.303022 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478aa579-11d4-4911-8e61-c15b55ae3095 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:01.311784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 970/1948] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:01.313100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649233b-4abd-4cb7-aaf3-5f4e5ac31189 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:01.313438 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649233b-4abd-4cb7-aaf3-5f4e5ac31189 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:01.313718 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649233b-4abd-4cb7-aaf3-5f4e5ac31189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:01.333459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-3649233b-4abd-4cb7-aaf3-5f4e5ac31189 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:01.334700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3649233b-4abd-4cb7-aaf3-5f4e5ac31189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:01.347439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:01.372793 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478aa579-11d4-4911-8e61-c15b55ae3095 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:01.377687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071575d7-e402-4188-b45e-17fda3a81434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:01.378580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071575d7-e402-4188-b45e-17fda3a81434 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:01.378882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071575d7-e402-4188-b45e-17fda3a81434 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:01.379154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071575d7-e402-4188-b45e-17fda3a81434 admin admin] PATH_INFO: `/v3/projects/8306145b05d84d9c927fd0c14eaf37f0/users/2b374c79da2446abb409339a5ec18aac/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:01.381168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071575d7-e402-4188-b45e-17fda3a81434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8306145b05d84d9c927fd0c14eaf37f0, user_id=2b374c79da2446abb409339a5ec18aac, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:01.384428 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071575d7-e402-4188-b45e-17fda3a81434 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:01.394891 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 979/1949] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:01 2022] PUT /identity/v3/projects/8306145b05d84d9c927fd0c14eaf37f0/users/2b374c79da2446abb409339a5ec18aac/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:01.396112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fae45-7fd7-4fad-a682-2c349a340cdd None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:01.396397 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fae45-7fd7-4fad-a682-2c349a340cdd None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:01.396672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fae45-7fd7-4fad-a682-2c349a340cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:01.406411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 971/1950] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:01.407485 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649233b-4abd-4cb7-aaf3-5f4e5ac31189 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:01.418620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649233b-4abd-4cb7-aaf3-5f4e5ac31189 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:01.425033 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-a14fae45-7fd7-4fad-a682-2c349a340cdd None None] MFA Rules not processed for user `f5bc45e393b54e77a3531044e1fe8dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:01.426323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-a14fae45-7fd7-4fad-a682-2c349a340cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:01.476169 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10143008-d576-476d-aef2-bec30a3fe009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:01.477085 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10143008-d576-476d-aef2-bec30a3fe009 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:01.477366 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10143008-d576-476d-aef2-bec30a3fe009 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:01.477638 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10143008-d576-476d-aef2-bec30a3fe009 admin admin] PATH_INFO: `/v3/projects/2600b938792547418f558b5e43b7c889/users/3ecd84f1476147b59b9ce494a96a27d4/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:01.493790 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10143008-d576-476d-aef2-bec30a3fe009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2600b938792547418f558b5e43b7c889, user_id=3ecd84f1476147b59b9ce494a96a27d4, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:01.496481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10143008-d576-476d-aef2-bec30a3fe009 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:01.502790 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 980/1951] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:01.506634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2764b-3caa-431a-8a13-91a4a078eb8a None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:01.506634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2764b-3caa-431a-8a13-91a4a078eb8a None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:01.506634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2764b-3caa-431a-8a13-91a4a078eb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:01.521253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 972/1952] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:01 2022] PUT /identity/v3/projects/2600b938792547418f558b5e43b7c889/users/3ecd84f1476147b59b9ce494a96a27d4/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:01.521253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10143008-d576-476d-aef2-bec30a3fe009 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:01.545207 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-6ed2764b-3caa-431a-8a13-91a4a078eb8a None None] MFA Rules not processed for user `2b374c79da2446abb409339a5ec18aac`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:01.546515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-6ed2764b-3caa-431a-8a13-91a4a078eb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:01.552851 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:01.582231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10143008-d576-476d-aef2-bec30a3fe009 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:01.587683 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7d013-b651-46b5-9edf-cda1240b43ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:01.588350 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7d013-b651-46b5-9edf-cda1240b43ae admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:01.588629 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7d013-b651-46b5-9edf-cda1240b43ae admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:01.588906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7d013-b651-46b5-9edf-cda1240b43ae admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:01.589618 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7d013-b651-46b5-9edf-cda1240b43ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:49:01.589917 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7d013-b651-46b5-9edf-cda1240b43ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:01.591522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7d013-b651-46b5-9edf-cda1240b43ae admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:01.605368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 973/1953] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:49:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:49:01.606284 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7d013-b651-46b5-9edf-cda1240b43ae admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:01.611798 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-4ec7d013-b651-46b5-9edf-cda1240b43ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:01.622683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 981/1954] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:01.624065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b1d4f-b3a4-41c6-9063-5f631cea059a None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:01.624359 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b1d4f-b3a4-41c6-9063-5f631cea059a None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:01.624646 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b1d4f-b3a4-41c6-9063-5f631cea059a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:01.656179 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-788b1d4f-b3a4-41c6-9063-5f631cea059a None None] MFA Rules not processed for user `3ecd84f1476147b59b9ce494a96a27d4`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:01.658046 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-788b1d4f-b3a4-41c6-9063-5f631cea059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:01.662424 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:01.683665 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7d013-b651-46b5-9edf-cda1240b43ae admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:01.688168 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720bbc9-392f-4b60-9f7b-3f97bde000ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:01.689052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720bbc9-392f-4b60-9f7b-3f97bde000ff service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:01.689502 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720bbc9-392f-4b60-9f7b-3f97bde000ff service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:01.689950 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720bbc9-392f-4b60-9f7b-3f97bde000ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:01.743534 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 982/1955] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:01.750429 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b1d4f-b3a4-41c6-9063-5f631cea059a None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:01.766588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b1d4f-b3a4-41c6-9063-5f631cea059a None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:01.766747 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720bbc9-392f-4b60-9f7b-3f97bde000ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:01.768348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720bbc9-392f-4b60-9f7b-3f97bde000ff service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:01.772478 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9d605-07b8-4ae3-863b-232d155ac2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:01.773159 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9d605-07b8-4ae3-863b-232d155ac2ce admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:01.773463 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9d605-07b8-4ae3-863b-232d155ac2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:01.773765 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e9d605-07b8-4ae3-863b-232d155ac2ce admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:01.775055 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9d605-07b8-4ae3-863b-232d155ac2ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:01.777020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e9d605-07b8-4ae3-863b-232d155ac2ce admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:01.780548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 974/1956] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:01 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:01.781423 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720bbc9-392f-4b60-9f7b-3f97bde000ff service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:01.783315 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-9720bbc9-392f-4b60-9f7b-3f97bde000ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:01.796949 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720bbc9-392f-4b60-9f7b-3f97bde000ff service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:01.802012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30388a7-12da-4855-8dc3-82202aee4cd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:01.803046 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30388a7-12da-4855-8dc3-82202aee4cd1 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:01.803481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30388a7-12da-4855-8dc3-82202aee4cd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:01.803817 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30388a7-12da-4855-8dc3-82202aee4cd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:01.820426 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30388a7-12da-4855-8dc3-82202aee4cd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:01.821388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30388a7-12da-4855-8dc3-82202aee4cd1 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:01.829666 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 983/1957] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:01 2022] POST /identity/v3/projects => generated 367 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:01.830720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9d605-07b8-4ae3-863b-232d155ac2ce admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:01.836565 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 975/1958] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:01.837819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30388a7-12da-4855-8dc3-82202aee4cd1 service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:01.849539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30388a7-12da-4855-8dc3-82202aee4cd1 service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:01.911125 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae48dc-52f1-4b6e-820f-d06e22046dc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:01.911930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae48dc-52f1-4b6e-820f-d06e22046dc1 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:01.912283 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae48dc-52f1-4b6e-820f-d06e22046dc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:01.912628 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae48dc-52f1-4b6e-820f-d06e22046dc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:01.918654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e9d605-07b8-4ae3-863b-232d155ac2ce admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:01.925773 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dce7f-86bf-443b-8e03-575e0c9cd8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:01.926501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dce7f-86bf-443b-8e03-575e0c9cd8bb admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:01.926825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dce7f-86bf-443b-8e03-575e0c9cd8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:01.927231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dce7f-86bf-443b-8e03-575e0c9cd8bb admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:01.928238 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01dce7f-86bf-443b-8e03-575e0c9cd8bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:01.931471 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01dce7f-86bf-443b-8e03-575e0c9cd8bb admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:01.955179 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:01.966718 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 984/1959] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:01 2022] POST /identity/v3/users => generated 284 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:01.967943 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dce7f-86bf-443b-8e03-575e0c9cd8bb admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:01.979679 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dce7f-86bf-443b-8e03-575e0c9cd8bb admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:01.984481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb98a2-8532-4974-a7c1-461766581d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:01.985154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb98a2-8532-4974-a7c1-461766581d70 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:01.990638 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb98a2-8532-4974-a7c1-461766581d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:01.990638 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb98a2-8532-4974-a7c1-461766581d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:01.990638 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb98a2-8532-4974-a7c1-461766581d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:01.990638 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb98a2-8532-4974-a7c1-461766581d70 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:01.991150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae48dc-52f1-4b6e-820f-d06e22046dc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:01.991150 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ae48dc-52f1-4b6e-820f-d06e22046dc1 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:02.000139 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 985/1960] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:49:02.003897 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb98a2-8532-4974-a7c1-461766581d70 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:02.005456 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 976/1961] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:02.016515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb98a2-8532-4974-a7c1-461766581d70 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:02.022102 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd001bc-43e6-4ae7-bc81-ab12238d01d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:02.023020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd001bc-43e6-4ae7-bc81-ab12238d01d3 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:02.023447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd001bc-43e6-4ae7-bc81-ab12238d01d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:02.023853 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd001bc-43e6-4ae7-bc81-ab12238d01d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:02.024855 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd001bc-43e6-4ae7-bc81-ab12238d01d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:02.027485 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae48dc-52f1-4b6e-820f-d06e22046dc1 service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:02.027918 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd001bc-43e6-4ae7-bc81-ab12238d01d3 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:02.040990 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae48dc-52f1-4b6e-820f-d06e22046dc1 service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:02.043069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 986/1962] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:49:02.046268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd001bc-43e6-4ae7-bc81-ab12238d01d3 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:02.053221 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4e8dd-1605-44ec-9b7e-af0ac9356e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:02.054345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4e8dd-1605-44ec-9b7e-af0ac9356e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:02.054729 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4e8dd-1605-44ec-9b7e-af0ac9356e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:02.055672 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4e8dd-1605-44ec-9b7e-af0ac9356e1b admin admin] PATH_INFO: `/v3/users/3ecd84f1476147b59b9ce494a96a27d4` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:02.057047 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4e8dd-1605-44ec-9b7e-af0ac9356e1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ecd84f1476147b59b9ce494a96a27d4)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:02.059057 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4e8dd-1605-44ec-9b7e-af0ac9356e1b admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:02.059878 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd001bc-43e6-4ae7-bc81-ab12238d01d3 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:02.065639 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2c3431-4449-497a-8da8-361f7073fc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:02.066556 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c3431-4449-497a-8da8-361f7073fc58 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:02.066855 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c3431-4449-497a-8da8-361f7073fc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:02.067125 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2c3431-4449-497a-8da8-361f7073fc58 admin admin] PATH_INFO: `/v3/projects/ad71d5300e924001af3199d9a5c20819/users/3d24604acee24bfcb13df55b0621e993/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:02.087033 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:02.092094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c3431-4449-497a-8da8-361f7073fc58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad71d5300e924001af3199d9a5c20819, user_id=3d24604acee24bfcb13df55b0621e993, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:02.094911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2c3431-4449-497a-8da8-361f7073fc58 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:02.125807 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b8f4e8dd-1605-44ec-9b7e-af0ac9356e1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ecd84f1476147b59b9ce494a96a27d4'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:02.136472 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b8f4e8dd-1605-44ec-9b7e-af0ac9356e1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ecd84f1476147b59b9ce494a96a27d4'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:02.149086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 987/1963] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:02 2022] PUT /identity/v3/projects/ad71d5300e924001af3199d9a5c20819/users/3d24604acee24bfcb13df55b0621e993/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:02.150957 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b8f4e8dd-1605-44ec-9b7e-af0ac9356e1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ecd84f1476147b59b9ce494a96a27d4'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:02.153754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2d14d-609c-4e46-9261-44b5405cef14 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:02.154317 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2d14d-609c-4e46-9261-44b5405cef14 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:02.155584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2d14d-609c-4e46-9261-44b5405cef14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:02.161549 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b8f4e8dd-1605-44ec-9b7e-af0ac9356e1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ecd84f1476147b59b9ce494a96a27d4'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:02.162547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b8f4e8dd-1605-44ec-9b7e-af0ac9356e1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ecd84f1476147b59b9ce494a96a27d4'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:02.171113 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 977/1964] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:02 2022] DELETE /identity/v3/users/3ecd84f1476147b59b9ce494a96a27d4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:02.175931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a46424-8b3c-4255-af10-eb11812da20e None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:02.176422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a46424-8b3c-4255-af10-eb11812da20e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:02.177208 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a46424-8b3c-4255-af10-eb11812da20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:02.204387 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-96a46424-8b3c-4255-af10-eb11812da20e None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:02.205826 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-96a46424-8b3c-4255-af10-eb11812da20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:02.241057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-57d2d14d-609c-4e46-9261-44b5405cef14 None None] MFA Rules not processed for user `3d24604acee24bfcb13df55b0621e993`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:02.241883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-57d2d14d-609c-4e46-9261-44b5405cef14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:02.316750 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 978/1965] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:02.327205 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a46424-8b3c-4255-af10-eb11812da20e None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:02.329054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-96a46424-8b3c-4255-af10-eb11812da20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:02.417190 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 988/1966] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:02.421232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2d14d-609c-4e46-9261-44b5405cef14 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:02.424126 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-57d2d14d-609c-4e46-9261-44b5405cef14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:02.448970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2d14d-609c-4e46-9261-44b5405cef14 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:02.457805 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774c94f-5ec3-4232-93fe-95c5e3e15cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:02.458564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774c94f-5ec3-4232-93fe-95c5e3e15cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:02.458960 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774c94f-5ec3-4232-93fe-95c5e3e15cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:02.459220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774c94f-5ec3-4232-93fe-95c5e3e15cb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:02.460137 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774c94f-5ec3-4232-93fe-95c5e3e15cb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:02.463517 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774c94f-5ec3-4232-93fe-95c5e3e15cb5 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:02.486948 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a46424-8b3c-4255-af10-eb11812da20e None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:02.494985 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd0dff-bd55-47a2-b955-b3c44337bb40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:02.495409 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd0dff-bd55-47a2-b955-b3c44337bb40 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:02.495800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd0dff-bd55-47a2-b955-b3c44337bb40 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:02.496177 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd0dff-bd55-47a2-b955-b3c44337bb40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:02.507035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd0dff-bd55-47a2-b955-b3c44337bb40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:02.508819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd0dff-bd55-47a2-b955-b3c44337bb40 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:02.521309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 979/1967] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:49:02.521642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 989/1968] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:02 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:02.531995 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd0dff-bd55-47a2-b955-b3c44337bb40 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:02.545709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd0dff-bd55-47a2-b955-b3c44337bb40 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:02.612135 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:02.665827 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7b592-100d-47be-918b-cae341bb4d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:02.666615 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7b592-100d-47be-918b-cae341bb4d71 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:02.666964 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7b592-100d-47be-918b-cae341bb4d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:02.667327 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7b592-100d-47be-918b-cae341bb4d71 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:02.668043 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7b592-100d-47be-918b-cae341bb4d71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:02.670273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7b592-100d-47be-918b-cae341bb4d71 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:02.714651 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 980/1969] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:02 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:02.717957 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774c94f-5ec3-4232-93fe-95c5e3e15cb5 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:02.741855 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774c94f-5ec3-4232-93fe-95c5e3e15cb5 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:02.749123 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a82bfd-5ca9-4a3d-9a93-9fc5e7a4911c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:02.750398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a82bfd-5ca9-4a3d-9a93-9fc5e7a4911c admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:02.750997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a82bfd-5ca9-4a3d-9a93-9fc5e7a4911c admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:02.751341 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a82bfd-5ca9-4a3d-9a93-9fc5e7a4911c admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:02.753217 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a82bfd-5ca9-4a3d-9a93-9fc5e7a4911c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:02.756427 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a82bfd-5ca9-4a3d-9a93-9fc5e7a4911c admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:02.773150 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 990/1970] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:49:02.781169 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7b592-100d-47be-918b-cae341bb4d71 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:02.798851 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7b592-100d-47be-918b-cae341bb4d71 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:02.809261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7ac66-216a-40ed-abad-01071e9791ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:02.811205 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7ac66-216a-40ed-abad-01071e9791ec admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:02.811677 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7ac66-216a-40ed-abad-01071e9791ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:02.812120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7ac66-216a-40ed-abad-01071e9791ec admin admin] PATH_INFO: `/v3/projects/54080dcefccc4924bfbaed30664353e6/users/77f1cd36c963477ca44fd61760c68b65/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:02.850762 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7ac66-216a-40ed-abad-01071e9791ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=54080dcefccc4924bfbaed30664353e6, user_id=77f1cd36c963477ca44fd61760c68b65, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:02.853933 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7ac66-216a-40ed-abad-01071e9791ec admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:02.874577 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 981/1971] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:02 2022] PUT /identity/v3/projects/54080dcefccc4924bfbaed30664353e6/users/77f1cd36c963477ca44fd61760c68b65/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:02.882126 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a82bfd-5ca9-4a3d-9a93-9fc5e7a4911c admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:02.906564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a82bfd-5ca9-4a3d-9a93-9fc5e7a4911c admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:03.020457 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa30e5d-f946-4d76-940c-8f88dab09f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:03.021666 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa30e5d-f946-4d76-940c-8f88dab09f20 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:03.023034 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa30e5d-f946-4d76-940c-8f88dab09f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:03.024400 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa30e5d-f946-4d76-940c-8f88dab09f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:03.026607 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa30e5d-f946-4d76-940c-8f88dab09f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:03.031468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7ac66-216a-40ed-abad-01071e9791ec admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:03.032012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa30e5d-f946-4d76-940c-8f88dab09f20 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:03.033981 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-2ec7ac66-216a-40ed-abad-01071e9791ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:03.065411 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 991/1972] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:03.071473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa30e5d-f946-4d76-940c-8f88dab09f20 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:03.099506 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa30e5d-f946-4d76-940c-8f88dab09f20 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:03.104891 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7ac66-216a-40ed-abad-01071e9791ec admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:03.114386 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fc291-ff07-4faa-a481-c4c11ce36a3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:03.115060 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fc291-ff07-4faa-a481-c4c11ce36a3e service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:03.115392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fc291-ff07-4faa-a481-c4c11ce36a3e service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:03.115673 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fc291-ff07-4faa-a481-c4c11ce36a3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:03.117532 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2a8ed-4098-48c8-9deb-8a570225f153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:03.118495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2a8ed-4098-48c8-9deb-8a570225f153 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:03.118779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2a8ed-4098-48c8-9deb-8a570225f153 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:03.119030 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b66fc291-ff07-4faa-a481-c4c11ce36a3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:03.119153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2a8ed-4098-48c8-9deb-8a570225f153 admin admin] PATH_INFO: `/v3/projects/54080dcefccc4924bfbaed30664353e6/users/77f1cd36c963477ca44fd61760c68b65/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:03.121254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2a8ed-4098-48c8-9deb-8a570225f153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54080dcefccc4924bfbaed30664353e6, user_id=77f1cd36c963477ca44fd61760c68b65, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:03.123971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2a8ed-4098-48c8-9deb-8a570225f153 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:03.127038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:03.149150 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 992/1973] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:03 2022] PUT /identity/v3/projects/54080dcefccc4924bfbaed30664353e6/users/77f1cd36c963477ca44fd61760c68b65/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:03.159732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852e5b1-de25-4b23-8734-2ae5acce1bca None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:03.160028 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852e5b1-de25-4b23-8734-2ae5acce1bca None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:03.160611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852e5b1-de25-4b23-8734-2ae5acce1bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:03.211660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-0852e5b1-de25-4b23-8734-2ae5acce1bca None None] MFA Rules not processed for user `77f1cd36c963477ca44fd61760c68b65`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:03.214466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-0852e5b1-de25-4b23-8734-2ae5acce1bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:03.235487 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66fc291-ff07-4faa-a481-c4c11ce36a3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:03.237613 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66fc291-ff07-4faa-a481-c4c11ce36a3e service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:03.277328 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 982/1974] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:49:03.278449 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fc291-ff07-4faa-a481-c4c11ce36a3e service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:03.286840 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b66fc291-ff07-4faa-a481-c4c11ce36a3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:03.308586 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fc291-ff07-4faa-a481-c4c11ce36a3e service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:03.367329 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 993/1975] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:49:03.377966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852e5b1-de25-4b23-8734-2ae5acce1bca None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:03.379412 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-0852e5b1-de25-4b23-8734-2ae5acce1bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:03.406395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789accd-d40a-41a0-99e5-1ddf4973f825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:03.407979 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789accd-d40a-41a0-99e5-1ddf4973f825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:03.407979 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789accd-d40a-41a0-99e5-1ddf4973f825 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:03.407979 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789accd-d40a-41a0-99e5-1ddf4973f825 admin admin] PATH_INFO: `/v3/projects/2600b938792547418f558b5e43b7c889` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:03.409363 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789accd-d40a-41a0-99e5-1ddf4973f825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2600b938792547418f558b5e43b7c889)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:03.411584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789accd-d40a-41a0-99e5-1ddf4973f825 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:03.416601 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:03.496521 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-4789accd-d40a-41a0-99e5-1ddf4973f825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2600b938792547418f558b5e43b7c889', 'request_id': 'req-4789accd-d40a-41a0-99e5-1ddf4973f825'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:03.502750 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852e5b1-de25-4b23-8734-2ae5acce1bca None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:03.509913 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-4789accd-d40a-41a0-99e5-1ddf4973f825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2600b938792547418f558b5e43b7c889', 'request_id': 'req-4789accd-d40a-41a0-99e5-1ddf4973f825'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:03.525859 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-4789accd-d40a-41a0-99e5-1ddf4973f825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2600b938792547418f558b5e43b7c889', 'request_id': 'req-4789accd-d40a-41a0-99e5-1ddf4973f825'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:03.545139 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-4789accd-d40a-41a0-99e5-1ddf4973f825 admin admin] The token cache is being invalidate because project 2600b938792547418f558b5e43b7c889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:03.545790 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-4789accd-d40a-41a0-99e5-1ddf4973f825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:03.546723 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-4789accd-d40a-41a0-99e5-1ddf4973f825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:03.550939 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 983/1976] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:03 2022] DELETE /identity/v3/projects/2600b938792547418f558b5e43b7c889 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:03.557536 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca275a-6789-4e87-b01d-c06a1506e147 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:03.557846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca275a-6789-4e87-b01d-c06a1506e147 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:03.558155 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca275a-6789-4e87-b01d-c06a1506e147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:03.621450 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-f7ca275a-6789-4e87-b01d-c06a1506e147 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:03.628100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-f7ca275a-6789-4e87-b01d-c06a1506e147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:03.686170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c87552-5b85-4d59-984d-e7732a98f418 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:03.686857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c87552-5b85-4d59-984d-e7732a98f418 service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:03.687145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c87552-5b85-4d59-984d-e7732a98f418 service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:03.687469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c87552-5b85-4d59-984d-e7732a98f418 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:03.692656 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-35c87552-5b85-4d59-984d-e7732a98f418 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:03.843943 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:03.848322 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 984/1977] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:49:03.857074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427e065-5b55-483c-8474-d99a1361104a None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:03.857466 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427e065-5b55-483c-8474-d99a1361104a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:03.857766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427e065-5b55-483c-8474-d99a1361104a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:03.876140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c87552-5b85-4d59-984d-e7732a98f418 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:03.877027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c87552-5b85-4d59-984d-e7732a98f418 service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:03.906238 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 994/1978] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:03 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:49:03.951335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-5427e065-5b55-483c-8474-d99a1361104a None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:03.957034 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-5427e065-5b55-483c-8474-d99a1361104a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:03.996773 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c87552-5b85-4d59-984d-e7732a98f418 service cinder] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:03.999367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 985/1979] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:04.020141 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c87552-5b85-4d59-984d-e7732a98f418 service cinder] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:04.034240 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e5a1b-6224-42dd-9ccf-9efb17359239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:04.034915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e5a1b-6224-42dd-9ccf-9efb17359239 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:04.035566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e5a1b-6224-42dd-9ccf-9efb17359239 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:04.035974 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e5a1b-6224-42dd-9ccf-9efb17359239 admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:04.036972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e5a1b-6224-42dd-9ccf-9efb17359239 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:49:04.037250 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e5a1b-6224-42dd-9ccf-9efb17359239 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:04.039097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e5a1b-6224-42dd-9ccf-9efb17359239 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:04.077129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 995/1980] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:49:04.080800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427e065-5b55-483c-8474-d99a1361104a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:04.093932 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427e065-5b55-483c-8474-d99a1361104a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:04.101608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ca260-cec1-4078-aab5-6ba9a4c3acb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:04.103009 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ca260-cec1-4078-aab5-6ba9a4c3acb8 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:04.104901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ca260-cec1-4078-aab5-6ba9a4c3acb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:04.105291 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ca260-cec1-4078-aab5-6ba9a4c3acb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:04.109852 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ca260-cec1-4078-aab5-6ba9a4c3acb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:04.111675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ca260-cec1-4078-aab5-6ba9a4c3acb8 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:04.124401 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e5a1b-6224-42dd-9ccf-9efb17359239 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:04.126283 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-849e5a1b-6224-42dd-9ccf-9efb17359239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:04.145805 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e5a1b-6224-42dd-9ccf-9efb17359239 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:04.157742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25474a3-55bc-4006-8688-d824f51698e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:04.160980 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25474a3-55bc-4006-8688-d824f51698e5 service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:04.163164 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25474a3-55bc-4006-8688-d824f51698e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:04.163486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25474a3-55bc-4006-8688-d824f51698e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:04.169128 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b25474a3-55bc-4006-8688-d824f51698e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:04.175736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 986/1981] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:04 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:04.180177 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ca260-cec1-4078-aab5-6ba9a4c3acb8 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:04.319148 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25474a3-55bc-4006-8688-d824f51698e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:04.321079 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25474a3-55bc-4006-8688-d824f51698e5 service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:04.337159 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 996/1982] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:04.354694 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ca260-cec1-4078-aab5-6ba9a4c3acb8 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:04.361369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2f2ae-a15a-491a-8021-d9e02a170bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:04.362063 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2f2ae-a15a-491a-8021-d9e02a170bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:04.362388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2f2ae-a15a-491a-8021-d9e02a170bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:04.362837 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2f2ae-a15a-491a-8021-d9e02a170bf7 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:04.364306 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2f2ae-a15a-491a-8021-d9e02a170bf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:04.366570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2f2ae-a15a-491a-8021-d9e02a170bf7 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:04.378632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:04.395314 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 987/1983] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:04 2022] POST /identity/v3/users => generated 288 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:04.398520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25474a3-55bc-4006-8688-d824f51698e5 service cinder] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:04.418041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25474a3-55bc-4006-8688-d824f51698e5 service cinder] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:04.424854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425888ae-f8cf-45d8-a290-3e4230e5db05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:04.425668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425888ae-f8cf-45d8-a290-3e4230e5db05 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:04.425954 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425888ae-f8cf-45d8-a290-3e4230e5db05 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:04.426234 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425888ae-f8cf-45d8-a290-3e4230e5db05 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:04.427547 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425888ae-f8cf-45d8-a290-3e4230e5db05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:04.429894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425888ae-f8cf-45d8-a290-3e4230e5db05 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:04.444168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 997/1984] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:04.448834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2f2ae-a15a-491a-8021-d9e02a170bf7 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:04.462201 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2f2ae-a15a-491a-8021-d9e02a170bf7 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:04.473394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95a16c-2135-4b9b-a2c2-37109bdbbd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:04.474441 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95a16c-2135-4b9b-a2c2-37109bdbbd21 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:04.474636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95a16c-2135-4b9b-a2c2-37109bdbbd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:04.475096 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95a16c-2135-4b9b-a2c2-37109bdbbd21 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:04.475809 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95a16c-2135-4b9b-a2c2-37109bdbbd21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:04.478198 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95a16c-2135-4b9b-a2c2-37109bdbbd21 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:04.489737 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 988/1985] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:04.493915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425888ae-f8cf-45d8-a290-3e4230e5db05 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:04.506860 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425888ae-f8cf-45d8-a290-3e4230e5db05 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:04.518023 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf7025-5775-4fda-9a55-0a5aa63f89f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:04.519317 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf7025-5775-4fda-9a55-0a5aa63f89f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:04.519789 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf7025-5775-4fda-9a55-0a5aa63f89f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:04.520242 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf7025-5775-4fda-9a55-0a5aa63f89f3 admin admin] PATH_INFO: `/v3/projects/93e0359e6ef34f41990bd9bb007b5185/users/88401d1a9d27415a94274db78821c11f/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:04.546813 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf7025-5775-4fda-9a55-0a5aa63f89f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93e0359e6ef34f41990bd9bb007b5185, user_id=88401d1a9d27415a94274db78821c11f, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:04.550211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bf7025-5775-4fda-9a55-0a5aa63f89f3 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:04.568502 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 998/1986] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:04 2022] PUT /identity/v3/projects/93e0359e6ef34f41990bd9bb007b5185/users/88401d1a9d27415a94274db78821c11f/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:04.582212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bfaa0-5947-40fb-b154-fdfdd10eca07 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:04.582712 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bfaa0-5947-40fb-b154-fdfdd10eca07 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:04.583065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430bfaa0-5947-40fb-b154-fdfdd10eca07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:04.650572 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-430bfaa0-5947-40fb-b154-fdfdd10eca07 None None] MFA Rules not processed for user `88401d1a9d27415a94274db78821c11f`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:04.652257 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-430bfaa0-5947-40fb-b154-fdfdd10eca07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:04.762993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 989/1987] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:49:04.768546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf7025-5775-4fda-9a55-0a5aa63f89f3 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:04.838542 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bfaa0-5947-40fb-b154-fdfdd10eca07 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:04.840132 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-430bfaa0-5947-40fb-b154-fdfdd10eca07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:05.007102 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430bfaa0-5947-40fb-b154-fdfdd10eca07 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:05.022370 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9a91d-37fd-47dc-abde-d9563906adc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:05.024701 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9a91d-37fd-47dc-abde-d9563906adc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:05.025323 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9a91d-37fd-47dc-abde-d9563906adc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:05.025633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9a91d-37fd-47dc-abde-d9563906adc1 admin admin] PATH_INFO: `/v3/users/0647a9fe0e5d401cab913507d995bafd` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:05.033128 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9a91d-37fd-47dc-abde-d9563906adc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0647a9fe0e5d401cab913507d995bafd)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:05.035441 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9a91d-37fd-47dc-abde-d9563906adc1 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:05.095002 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf7025-5775-4fda-9a55-0a5aa63f89f3 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:05.111556 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b43889-a88a-4b62-a026-1834dfc80f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:05.112298 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b43889-a88a-4b62-a026-1834dfc80f8f admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:05.115246 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b43889-a88a-4b62-a026-1834dfc80f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:05.115828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b43889-a88a-4b62-a026-1834dfc80f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:05.116604 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b43889-a88a-4b62-a026-1834dfc80f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:05.119128 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b43889-a88a-4b62-a026-1834dfc80f8f admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:05.147255 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-94e9a91d-37fd-47dc-abde-d9563906adc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0647a9fe0e5d401cab913507d995bafd'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:05.171550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-94e9a91d-37fd-47dc-abde-d9563906adc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0647a9fe0e5d401cab913507d995bafd'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:05.188303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 999/1988] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:04 2022] POST /identity/v3/projects => generated 375 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:05.189360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b43889-a88a-4b62-a026-1834dfc80f8f admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:05.203736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-94e9a91d-37fd-47dc-abde-d9563906adc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0647a9fe0e5d401cab913507d995bafd'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:05.205882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:INSERT=1,keystone:SELECT=90,keystone:DELETE=9 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:05.217269 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-94e9a91d-37fd-47dc-abde-d9563906adc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0647a9fe0e5d401cab913507d995bafd'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:05.219214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-94e9a91d-37fd-47dc-abde-d9563906adc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0647a9fe0e5d401cab913507d995bafd'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:05.244511 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 990/1989] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:04 2022] DELETE /identity/v3/users/0647a9fe0e5d401cab913507d995bafd => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:05.248815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01385304-d642-4700-8496-95fb330981d7 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:05.249493 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01385304-d642-4700-8496-95fb330981d7 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:05.249493 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01385304-d642-4700-8496-95fb330981d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:05.252262 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:05.296596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-01385304-d642-4700-8496-95fb330981d7 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:05.297117 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-01385304-d642-4700-8496-95fb330981d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:05.378775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b43889-a88a-4b62-a026-1834dfc80f8f admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:05.438125 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 991/1990] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:05.451908 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01385304-d642-4700-8496-95fb330981d7 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:05.455718 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-01385304-d642-4700-8496-95fb330981d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:05.493587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f0f36-7d11-4d4d-b3bc-c32ed1f1915e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:05.493587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f0f36-7d11-4d4d-b3bc-c32ed1f1915e admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:05.493587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f0f36-7d11-4d4d-b3bc-c32ed1f1915e admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:05.493587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0f0f36-7d11-4d4d-b3bc-c32ed1f1915e admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:05.497009 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f0f36-7d11-4d4d-b3bc-c32ed1f1915e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:05.499104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0f0f36-7d11-4d4d-b3bc-c32ed1f1915e admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:05.527589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1000/1991] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:05 2022] POST /identity/v3/users => generated 294 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:05.528755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f0f36-7d11-4d4d-b3bc-c32ed1f1915e admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:05.531077 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-4f0f0f36-7d11-4d4d-b3bc-c32ed1f1915e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:05.546680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0f0f36-7d11-4d4d-b3bc-c32ed1f1915e admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:05.553026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06181f-b766-40d6-bd12-f0195b4e1efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:05.554110 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06181f-b766-40d6-bd12-f0195b4e1efd admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:05.554654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06181f-b766-40d6-bd12-f0195b4e1efd admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:05.555732 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06181f-b766-40d6-bd12-f0195b4e1efd admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:05.557356 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01385304-d642-4700-8496-95fb330981d7 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:05.557845 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06181f-b766-40d6-bd12-f0195b4e1efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:05.559832 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06181f-b766-40d6-bd12-f0195b4e1efd admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:05.562424 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011348b-3f6c-4638-a676-798a4d3e1997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:05.563718 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011348b-3f6c-4638-a676-798a4d3e1997 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:05.564012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011348b-3f6c-4638-a676-798a4d3e1997 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:05.564290 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011348b-3f6c-4638-a676-798a4d3e1997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:05.577512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1001/1992] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:05.579879 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011348b-3f6c-4638-a676-798a4d3e1997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:05.580874 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06181f-b766-40d6-bd12-f0195b4e1efd admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:05.581628 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011348b-3f6c-4638-a676-798a4d3e1997 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:05.596792 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06181f-b766-40d6-bd12-f0195b4e1efd admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:05.604487 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b7065-c298-41e3-82c6-c3ca4cc6805f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:05.606374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b7065-c298-41e3-82c6-c3ca4cc6805f admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:05.606948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b7065-c298-41e3-82c6-c3ca4cc6805f admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:05.607561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 992/1993] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:05.607792 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b7065-c298-41e3-82c6-c3ca4cc6805f admin admin] PATH_INFO: `/v3/projects/f50b8bf31f744e01ad2d41c84ea8c295/users/8742d9b1301a4b558bc52fd144bb74a7/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:05.637245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b7065-c298-41e3-82c6-c3ca4cc6805f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f50b8bf31f744e01ad2d41c84ea8c295, user_id=8742d9b1301a4b558bc52fd144bb74a7, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:05.644723 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b7065-c298-41e3-82c6-c3ca4cc6805f admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:05.677002 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1002/1994] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:05 2022] PUT /identity/v3/projects/f50b8bf31f744e01ad2d41c84ea8c295/users/8742d9b1301a4b558bc52fd144bb74a7/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:05.678970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011348b-3f6c-4638-a676-798a4d3e1997 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:05.696110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011348b-3f6c-4638-a676-798a4d3e1997 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:05.821888 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9bc4c-a2c7-4ec4-8a9f-ba70581694a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:05.822576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9bc4c-a2c7-4ec4-8a9f-ba70581694a1 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:05.822861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9bc4c-a2c7-4ec4-8a9f-ba70581694a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:05.823140 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9bc4c-a2c7-4ec4-8a9f-ba70581694a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:05.824269 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9bc4c-a2c7-4ec4-8a9f-ba70581694a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:05.825685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9bc4c-a2c7-4ec4-8a9f-ba70581694a1 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:05.886775 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 993/1995] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:05.887087 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b7065-c298-41e3-82c6-c3ca4cc6805f admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:05.906913 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b7065-c298-41e3-82c6-c3ca4cc6805f admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:05.929915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a13d6-d832-4840-9f5e-3babe13c4d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:05.931587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a13d6-d832-4840-9f5e-3babe13c4d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:05.931880 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a13d6-d832-4840-9f5e-3babe13c4d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:05.932533 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a13d6-d832-4840-9f5e-3babe13c4d5d admin admin] PATH_INFO: `/v3/projects/f50b8bf31f744e01ad2d41c84ea8c295/users/8742d9b1301a4b558bc52fd144bb74a7/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:05.934831 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a13d6-d832-4840-9f5e-3babe13c4d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f50b8bf31f744e01ad2d41c84ea8c295, user_id=8742d9b1301a4b558bc52fd144bb74a7, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:05.938222 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a13d6-d832-4840-9f5e-3babe13c4d5d admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:05.966077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38a27b-b676-4a1c-8e73-e3d48a9493d1 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:05.966545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38a27b-b676-4a1c-8e73-e3d48a9493d1 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:05.966731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38a27b-b676-4a1c-8e73-e3d48a9493d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:05.968521 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1003/1996] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:05 2022] PUT /identity/v3/projects/f50b8bf31f744e01ad2d41c84ea8c295/users/8742d9b1301a4b558bc52fd144bb74a7/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:06.006166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-9c38a27b-b676-4a1c-8e73-e3d48a9493d1 None None] MFA Rules not processed for user `8742d9b1301a4b558bc52fd144bb74a7`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:06.007799 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-9c38a27b-b676-4a1c-8e73-e3d48a9493d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:06.028598 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a13d6-d832-4840-9f5e-3babe13c4d5d admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:06.030535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-c22a13d6-d832-4840-9f5e-3babe13c4d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:06.033182 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:06.127462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 994/1997] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:06.135302 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a13d6-d832-4840-9f5e-3babe13c4d5d admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:06.139059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38a27b-b676-4a1c-8e73-e3d48a9493d1 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:06.140792 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fedbd7-4a9f-4675-940f-7770b02d58dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:06.141711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-9c38a27b-b676-4a1c-8e73-e3d48a9493d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:06.141836 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fedbd7-4a9f-4675-940f-7770b02d58dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:06.142578 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fedbd7-4a9f-4675-940f-7770b02d58dd admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:06.142578 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fedbd7-4a9f-4675-940f-7770b02d58dd admin admin] PATH_INFO: `/v3/users/06d972edbce84778837ed73122efac9d` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:06.143589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fedbd7-4a9f-4675-940f-7770b02d58dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d972edbce84778837ed73122efac9d)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:06.146207 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fedbd7-4a9f-4675-940f-7770b02d58dd admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:06.168701 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:06.214296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38a27b-b676-4a1c-8e73-e3d48a9493d1 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:06.249049 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef379f15-cf07-4d93-bc1b-3f1641afc468 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:06.251298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef379f15-cf07-4d93-bc1b-3f1641afc468 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:06.251736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef379f15-cf07-4d93-bc1b-3f1641afc468 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:06.253564 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef379f15-cf07-4d93-bc1b-3f1641afc468 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:06.255982 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ef379f15-cf07-4d93-bc1b-3f1641afc468 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:06.259919 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-49fedbd7-4a9f-4675-940f-7770b02d58dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d972edbce84778837ed73122efac9d'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:06.270017 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-49fedbd7-4a9f-4675-940f-7770b02d58dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d972edbce84778837ed73122efac9d'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:06.288010 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-49fedbd7-4a9f-4675-940f-7770b02d58dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d972edbce84778837ed73122efac9d'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:06.289112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-49fedbd7-4a9f-4675-940f-7770b02d58dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d972edbce84778837ed73122efac9d'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:06.297449 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-49fedbd7-4a9f-4675-940f-7770b02d58dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d972edbce84778837ed73122efac9d'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:06.306016 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1004/1998] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:06 2022] DELETE /identity/v3/users/06d972edbce84778837ed73122efac9d => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:06.320410 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ea41f-fe83-43ee-a61a-024f239ffaad None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:06.320721 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ea41f-fe83-43ee-a61a-024f239ffaad None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:06.321001 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ea41f-fe83-43ee-a61a-024f239ffaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:06.341752 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-ed2ea41f-fe83-43ee-a61a-024f239ffaad None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:06.343242 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-ed2ea41f-fe83-43ee-a61a-024f239ffaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:06.402144 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef379f15-cf07-4d93-bc1b-3f1641afc468 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:06.403711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef379f15-cf07-4d93-bc1b-3f1641afc468 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:06.416040 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 995/1999] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:49:06.417797 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef379f15-cf07-4d93-bc1b-3f1641afc468 service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:06.420101 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ef379f15-cf07-4d93-bc1b-3f1641afc468 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:06.422882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1005/2000] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:06.434364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ea41f-fe83-43ee-a61a-024f239ffaad None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:06.435754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-ed2ea41f-fe83-43ee-a61a-024f239ffaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:06.452476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef379f15-cf07-4d93-bc1b-3f1641afc468 service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:06.458834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892306c-bea3-4c42-a253-f34e8fdeb582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:06.459749 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892306c-bea3-4c42-a253-f34e8fdeb582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:06.460039 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892306c-bea3-4c42-a253-f34e8fdeb582 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:06.460321 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892306c-bea3-4c42-a253-f34e8fdeb582 admin admin] PATH_INFO: `/v3/projects/b99ee5c978604197a594027fc6c0ef30` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:06.462274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892306c-bea3-4c42-a253-f34e8fdeb582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b99ee5c978604197a594027fc6c0ef30)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:06.464480 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892306c-bea3-4c42-a253-f34e8fdeb582 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:06.524736 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ea41f-fe83-43ee-a61a-024f239ffaad None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:06.535410 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-a892306c-bea3-4c42-a253-f34e8fdeb582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b99ee5c978604197a594027fc6c0ef30', 'request_id': 'req-a892306c-bea3-4c42-a253-f34e8fdeb582'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:06.543047 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-a892306c-bea3-4c42-a253-f34e8fdeb582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b99ee5c978604197a594027fc6c0ef30', 'request_id': 'req-a892306c-bea3-4c42-a253-f34e8fdeb582'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:06.559807 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-a892306c-bea3-4c42-a253-f34e8fdeb582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b99ee5c978604197a594027fc6c0ef30', 'request_id': 'req-a892306c-bea3-4c42-a253-f34e8fdeb582'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:06.561488 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:06.584153 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-a892306c-bea3-4c42-a253-f34e8fdeb582 admin admin] The token cache is being invalidate because project b99ee5c978604197a594027fc6c0ef30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:06.584579 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-a892306c-bea3-4c42-a253-f34e8fdeb582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:06.585307 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-a892306c-bea3-4c42-a253-f34e8fdeb582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:06.590703 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 996/2001] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:06 2022] DELETE /identity/v3/projects/b99ee5c978604197a594027fc6c0ef30 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:06.591935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892306c-bea3-4c42-a253-f34e8fdeb582 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:06.593981 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a892306c-bea3-4c42-a253-f34e8fdeb582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:06.595207 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:06.625486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e97a43-3f7d-4a44-b288-66869df97c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:06.628786 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e97a43-3f7d-4a44-b288-66869df97c7f service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:06.630668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e97a43-3f7d-4a44-b288-66869df97c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:06.630805 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e97a43-3f7d-4a44-b288-66869df97c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:06.635553 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-79e97a43-3f7d-4a44-b288-66869df97c7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:06.710417 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892306c-bea3-4c42-a253-f34e8fdeb582 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:06.718338 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae675c-d09e-4865-b0ce-2d35ba2e4754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:06.719515 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae675c-d09e-4865-b0ce-2d35ba2e4754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:06.720013 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae675c-d09e-4865-b0ce-2d35ba2e4754 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:06.720516 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae675c-d09e-4865-b0ce-2d35ba2e4754 admin admin] PATH_INFO: `/v3/users/bb513893f1f24b87bfb40b05de52abe2` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:06.722097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae675c-d09e-4865-b0ce-2d35ba2e4754 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb513893f1f24b87bfb40b05de52abe2)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:06.724590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae675c-d09e-4865-b0ce-2d35ba2e4754 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:06.775353 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e97a43-3f7d-4a44-b288-66869df97c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:06.776989 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e97a43-3f7d-4a44-b288-66869df97c7f service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:06.801988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1006/2002] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:49:06.810254 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-7fae675c-d09e-4865-b0ce-2d35ba2e4754 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb513893f1f24b87bfb40b05de52abe2'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:06.834078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-7fae675c-d09e-4865-b0ce-2d35ba2e4754 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb513893f1f24b87bfb40b05de52abe2'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:06.850367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-7fae675c-d09e-4865-b0ce-2d35ba2e4754 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb513893f1f24b87bfb40b05de52abe2'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:06.869714 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-7fae675c-d09e-4865-b0ce-2d35ba2e4754 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb513893f1f24b87bfb40b05de52abe2'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:06.872238 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-7fae675c-d09e-4865-b0ce-2d35ba2e4754 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb513893f1f24b87bfb40b05de52abe2'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:06.897123 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 997/2003] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:06 2022] DELETE /identity/v3/users/bb513893f1f24b87bfb40b05de52abe2 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:07.271062 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e97a43-3f7d-4a44-b288-66869df97c7f service neutron] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:07.272751 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-79e97a43-3f7d-4a44-b288-66869df97c7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:07.293671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e97a43-3f7d-4a44-b288-66869df97c7f service neutron] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:07.347568 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae675c-d09e-4865-b0ce-2d35ba2e4754 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:07.349007 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7fae675c-d09e-4865-b0ce-2d35ba2e4754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:07.404700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62632018-e13e-4cf3-8c84-b82c04f20c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:07.405578 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62632018-e13e-4cf3-8c84-b82c04f20c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:07.406040 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62632018-e13e-4cf3-8c84-b82c04f20c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:07.406498 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62632018-e13e-4cf3-8c84-b82c04f20c27 admin admin] PATH_INFO: `/v3/projects/a55b40ac223f47bf9f45936d46bee5aa` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:07.407743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62632018-e13e-4cf3-8c84-b82c04f20c27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a55b40ac223f47bf9f45936d46bee5aa)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:07.409645 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62632018-e13e-4cf3-8c84-b82c04f20c27 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:07.451108 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae675c-d09e-4865-b0ce-2d35ba2e4754 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:07.476234 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:07.482980 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-62632018-e13e-4cf3-8c84-b82c04f20c27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a55b40ac223f47bf9f45936d46bee5aa', 'request_id': 'req-62632018-e13e-4cf3-8c84-b82c04f20c27'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:07.492983 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-62632018-e13e-4cf3-8c84-b82c04f20c27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a55b40ac223f47bf9f45936d46bee5aa', 'request_id': 'req-62632018-e13e-4cf3-8c84-b82c04f20c27'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:07.503211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-62632018-e13e-4cf3-8c84-b82c04f20c27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a55b40ac223f47bf9f45936d46bee5aa', 'request_id': 'req-62632018-e13e-4cf3-8c84-b82c04f20c27'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:07.522134 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-62632018-e13e-4cf3-8c84-b82c04f20c27 admin admin] The token cache is being invalidate because project a55b40ac223f47bf9f45936d46bee5aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:07.522454 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-62632018-e13e-4cf3-8c84-b82c04f20c27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:07.523134 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-62632018-e13e-4cf3-8c84-b82c04f20c27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:07.525348 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1007/2004] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:07 2022] DELETE /identity/v3/projects/a55b40ac223f47bf9f45936d46bee5aa => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:07.529121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62632018-e13e-4cf3-8c84-b82c04f20c27 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:07.530526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-62632018-e13e-4cf3-8c84-b82c04f20c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:07.561868 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469233a4-09e3-4423-91a8-24d108628040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:07.562812 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469233a4-09e3-4423-91a8-24d108628040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:07.562950 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469233a4-09e3-4423-91a8-24d108628040 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:07.563282 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469233a4-09e3-4423-91a8-24d108628040 admin admin] PATH_INFO: `/v3/projects/313efbb69fb34a008ce618b269773f29` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:07.564637 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469233a4-09e3-4423-91a8-24d108628040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=313efbb69fb34a008ce618b269773f29)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:07.566716 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469233a4-09e3-4423-91a8-24d108628040 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:07.573058 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:07.637469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62632018-e13e-4cf3-8c84-b82c04f20c27 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:07.640261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-469233a4-09e3-4423-91a8-24d108628040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '313efbb69fb34a008ce618b269773f29', 'request_id': 'req-469233a4-09e3-4423-91a8-24d108628040'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:07.647701 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-469233a4-09e3-4423-91a8-24d108628040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '313efbb69fb34a008ce618b269773f29', 'request_id': 'req-469233a4-09e3-4423-91a8-24d108628040'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:07.659204 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-469233a4-09e3-4423-91a8-24d108628040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '313efbb69fb34a008ce618b269773f29', 'request_id': 'req-469233a4-09e3-4423-91a8-24d108628040'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:07.673212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-469233a4-09e3-4423-91a8-24d108628040 admin admin] The token cache is being invalidate because project 313efbb69fb34a008ce618b269773f29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:07.673498 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-469233a4-09e3-4423-91a8-24d108628040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:07.674153 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-469233a4-09e3-4423-91a8-24d108628040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:07.676126 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 998/2005] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:07 2022] DELETE /identity/v3/projects/313efbb69fb34a008ce618b269773f29 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:07.683571 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14967d0f-6eb6-4c33-b661-808b4a6bc18a None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:07.683875 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14967d0f-6eb6-4c33-b661-808b4a6bc18a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:07.684416 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14967d0f-6eb6-4c33-b661-808b4a6bc18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:07.710800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-14967d0f-6eb6-4c33-b661-808b4a6bc18a None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:07.712114 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-14967d0f-6eb6-4c33-b661-808b4a6bc18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:07.715493 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b9a80-221f-4003-aff4-9569b1bde197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:07.717158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b9a80-221f-4003-aff4-9569b1bde197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:07.717766 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b9a80-221f-4003-aff4-9569b1bde197 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:07.718218 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b9a80-221f-4003-aff4-9569b1bde197 admin admin] PATH_INFO: `/v3/users/f5bc45e393b54e77a3531044e1fe8dc8` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:07.720357 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b9a80-221f-4003-aff4-9569b1bde197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5bc45e393b54e77a3531044e1fe8dc8)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:07.721589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 999/2006] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:07.722940 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b9a80-221f-4003-aff4-9569b1bde197 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:07.730881 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b13bf-434a-4583-b5f0-d032fe533809 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:07.731049 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b13bf-434a-4583-b5f0-d032fe533809 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:07.731233 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b13bf-434a-4583-b5f0-d032fe533809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:07.752720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-640b13bf-434a-4583-b5f0-d032fe533809 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:07.753945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-640b13bf-434a-4583-b5f0-d032fe533809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:07.763949 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1000/2007] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:49:07.769042 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b13bf-434a-4583-b5f0-d032fe533809 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:07.779921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b13bf-434a-4583-b5f0-d032fe533809 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:07.785496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46459fc8-ce78-454a-a23e-470ae5cbd6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:07.786178 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-831b9a80-221f-4003-aff4-9569b1bde197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5bc45e393b54e77a3531044e1fe8dc8'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:07.786585 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46459fc8-ce78-454a-a23e-470ae5cbd6dc admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:07.786864 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46459fc8-ce78-454a-a23e-470ae5cbd6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:07.787141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46459fc8-ce78-454a-a23e-470ae5cbd6dc admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:07.788986 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46459fc8-ce78-454a-a23e-470ae5cbd6dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:49:07.789217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46459fc8-ce78-454a-a23e-470ae5cbd6dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:07.791032 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46459fc8-ce78-454a-a23e-470ae5cbd6dc admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:07.795137 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-831b9a80-221f-4003-aff4-9569b1bde197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5bc45e393b54e77a3531044e1fe8dc8'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:07.807175 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1001/2008] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:49:07.813231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46459fc8-ce78-454a-a23e-470ae5cbd6dc admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:07.813458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-831b9a80-221f-4003-aff4-9569b1bde197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5bc45e393b54e77a3531044e1fe8dc8'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:07.814267 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-831b9a80-221f-4003-aff4-9569b1bde197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5bc45e393b54e77a3531044e1fe8dc8'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:07.823255 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-831b9a80-221f-4003-aff4-9569b1bde197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5bc45e393b54e77a3531044e1fe8dc8'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:07.825132 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46459fc8-ce78-454a-a23e-470ae5cbd6dc admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:07.830673 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d51977-676d-4c1c-b0d5-02b29f504e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:07.831503 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1008/2009] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:07 2022] DELETE /identity/v3/users/f5bc45e393b54e77a3531044e1fe8dc8 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:07.831630 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d51977-676d-4c1c-b0d5-02b29f504e9c admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:07.831630 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d51977-676d-4c1c-b0d5-02b29f504e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:07.831889 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d51977-676d-4c1c-b0d5-02b29f504e9c admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:07.832625 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d51977-676d-4c1c-b0d5-02b29f504e9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:07.837081 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d51977-676d-4c1c-b0d5-02b29f504e9c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:07.893050 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1002/2010] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:07 2022] POST /identity/v3/projects => generated 363 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:49:07.901869 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b9a80-221f-4003-aff4-9569b1bde197 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:07.901869 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-831b9a80-221f-4003-aff4-9569b1bde197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:08.028213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:08.048564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b9a80-221f-4003-aff4-9569b1bde197 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:08.192328 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3cf13-adfb-453c-a47e-0b774b41ede1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:08.197831 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3cf13-adfb-453c-a47e-0b774b41ede1 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:08.200541 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3cf13-adfb-453c-a47e-0b774b41ede1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:08.201081 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3cf13-adfb-453c-a47e-0b774b41ede1 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:08.201997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3cf13-adfb-453c-a47e-0b774b41ede1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:08.209505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3cf13-adfb-453c-a47e-0b774b41ede1 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:08.250783 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1009/2011] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:07 2022] POST /identity/v3/users => generated 282 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:08.254811 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d51977-676d-4c1c-b0d5-02b29f504e9c admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:08.268292 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3cf13-adfb-453c-a47e-0b774b41ede1 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:08.271046 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-29a3cf13-adfb-453c-a47e-0b774b41ede1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:08.277373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d51977-676d-4c1c-b0d5-02b29f504e9c admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:08.290755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3cf13-adfb-453c-a47e-0b774b41ede1 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:08.296315 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e6d48-814a-495d-977c-5173407d5370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:08.297207 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e6d48-814a-495d-977c-5173407d5370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:08.297494 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e6d48-814a-495d-977c-5173407d5370 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:08.297867 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e6d48-814a-495d-977c-5173407d5370 admin admin] PATH_INFO: `/v3/projects/47ac32aae1e44bfd807a75a96ac33309` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:08.299364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e6d48-814a-495d-977c-5173407d5370 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47ac32aae1e44bfd807a75a96ac33309)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:08.309705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e6d48-814a-495d-977c-5173407d5370 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:08.309799 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035443fa-f884-42d7-983e-bd40d0355c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:08.309799 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035443fa-f884-42d7-983e-bd40d0355c69 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:08.309799 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035443fa-f884-42d7-983e-bd40d0355c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:08.309799 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035443fa-f884-42d7-983e-bd40d0355c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:08.312604 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035443fa-f884-42d7-983e-bd40d0355c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:08.314627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035443fa-f884-42d7-983e-bd40d0355c69 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:08.347471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1003/2012] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:08.352422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035443fa-f884-42d7-983e-bd40d0355c69 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:08.371450 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-de9e6d48-814a-495d-977c-5173407d5370 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47ac32aae1e44bfd807a75a96ac33309', 'request_id': 'req-de9e6d48-814a-495d-977c-5173407d5370'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:08.382408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-de9e6d48-814a-495d-977c-5173407d5370 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47ac32aae1e44bfd807a75a96ac33309', 'request_id': 'req-de9e6d48-814a-495d-977c-5173407d5370'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:08.382935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035443fa-f884-42d7-983e-bd40d0355c69 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:08.396598 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-de9e6d48-814a-495d-977c-5173407d5370 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47ac32aae1e44bfd807a75a96ac33309', 'request_id': 'req-de9e6d48-814a-495d-977c-5173407d5370'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:08.415832 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-de9e6d48-814a-495d-977c-5173407d5370 admin admin] The token cache is being invalidate because project 47ac32aae1e44bfd807a75a96ac33309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:08.416256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-de9e6d48-814a-495d-977c-5173407d5370 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:08.417377 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-de9e6d48-814a-495d-977c-5173407d5370 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:08.423971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1010/2013] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:08 2022] DELETE /identity/v3/projects/47ac32aae1e44bfd807a75a96ac33309 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:08.423971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abb02e-ae6a-419a-ae4d-0def8e79ac1f None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:08.423971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abb02e-ae6a-419a-ae4d-0def8e79ac1f None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:08.423971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abb02e-ae6a-419a-ae4d-0def8e79ac1f None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:08.425073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1011/2014] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jul 19 20:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:49:08.427444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14abee0-7306-4c29-aa27-96a8a172bfc2 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:08.427886 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14abee0-7306-4c29-aa27-96a8a172bfc2 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:08.428289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14abee0-7306-4c29-aa27-96a8a172bfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:08.460009 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-c14abee0-7306-4c29-aa27-96a8a172bfc2 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:08.462507 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-c14abee0-7306-4c29-aa27-96a8a172bfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:08.484013 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:08.504691 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc2b3f8-7168-46d0-a02b-fa4a57cc0bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:08.505578 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2b3f8-7168-46d0-a02b-fa4a57cc0bfa admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:08.506781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2b3f8-7168-46d0-a02b-fa4a57cc0bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:08.507195 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc2b3f8-7168-46d0-a02b-fa4a57cc0bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:08.508772 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2b3f8-7168-46d0-a02b-fa4a57cc0bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:08.511216 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc2b3f8-7168-46d0-a02b-fa4a57cc0bfa admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:08.543304 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1004/2015] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:08.544865 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39401a52-ef1e-4fcd-975c-6192f0cea674 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:08.545159 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39401a52-ef1e-4fcd-975c-6192f0cea674 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:08.545439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39401a52-ef1e-4fcd-975c-6192f0cea674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:08.570392 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1012/2016] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:08.571498 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14abee0-7306-4c29-aa27-96a8a172bfc2 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:08.577743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-c14abee0-7306-4c29-aa27-96a8a172bfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:08.580333 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-39401a52-ef1e-4fcd-975c-6192f0cea674 None None] MFA Rules not processed for user `6dbbb8f7b3f2449fb9c64ca3815b6c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:08.582042 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-39401a52-ef1e-4fcd-975c-6192f0cea674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:08.603324 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:08.691858 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1005/2017] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jul 19 20:49:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:08.692763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39401a52-ef1e-4fcd-975c-6192f0cea674 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:08.697468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-39401a52-ef1e-4fcd-975c-6192f0cea674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:08.712742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14abee0-7306-4c29-aa27-96a8a172bfc2 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:08.716419 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39401a52-ef1e-4fcd-975c-6192f0cea674 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:08.722435 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e767a10-d00c-4911-a97f-dc67abf531be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:08.723610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e767a10-d00c-4911-a97f-dc67abf531be admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:08.724059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e767a10-d00c-4911-a97f-dc67abf531be admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:08.724584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e767a10-d00c-4911-a97f-dc67abf531be admin admin] PATH_INFO: `/v3/projects/66158a0525d5467c8d175c5f77bace03/users/b065a24205364587952811c3802dbb44/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:08.725011 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1fb944-de2f-4c0c-bfe7-9391325b607c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:08.725698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fb944-de2f-4c0c-bfe7-9391325b607c service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:08.725987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fb944-de2f-4c0c-bfe7-9391325b607c service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:08.727155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1fb944-de2f-4c0c-bfe7-9391325b607c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:08.732574 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-4b1fb944-de2f-4c0c-bfe7-9391325b607c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:08.780165 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e767a10-d00c-4911-a97f-dc67abf531be admin admin] RBAC: Authorizing `identity:create_grant(project_id=66158a0525d5467c8d175c5f77bace03, user_id=b065a24205364587952811c3802dbb44, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:08.787875 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e767a10-d00c-4911-a97f-dc67abf531be admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:08.810935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1006/2018] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:08 2022] PUT /identity/v3/projects/66158a0525d5467c8d175c5f77bace03/users/b065a24205364587952811c3802dbb44/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:08.813685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f9669-0acd-492b-806a-26555411ce7d None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:08.814216 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f9669-0acd-492b-806a-26555411ce7d None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:08.816224 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f9669-0acd-492b-806a-26555411ce7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:08.866871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-c68f9669-0acd-492b-806a-26555411ce7d None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:08.869988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c68f9669-0acd-492b-806a-26555411ce7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:08.873429 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fb944-de2f-4c0c-bfe7-9391325b607c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:08.876753 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1fb944-de2f-4c0c-bfe7-9391325b607c service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:08.930971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1013/2019] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:08.949939 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d5a85-ed46-450a-83fc-3d9f24dd826e None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:08.950754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d5a85-ed46-450a-83fc-3d9f24dd826e None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:08.962962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d5a85-ed46-450a-83fc-3d9f24dd826e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:09.005115 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1007/2020] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:09.006074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f9669-0acd-492b-806a-26555411ce7d None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:09.007674 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c68f9669-0acd-492b-806a-26555411ce7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:09.027228 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-f07d5a85-ed46-450a-83fc-3d9f24dd826e None None] MFA Rules not processed for user `b065a24205364587952811c3802dbb44`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:09.028736 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-f07d5a85-ed46-450a-83fc-3d9f24dd826e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:09.120239 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:09.163195 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f9669-0acd-492b-806a-26555411ce7d None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:09.168870 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1014/2021] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:09.169994 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d5a85-ed46-450a-83fc-3d9f24dd826e None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:09.176044 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afd488-9804-4539-8fcf-0d86bfb2b8c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:09.178543 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afd488-9804-4539-8fcf-0d86bfb2b8c0 service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:09.179593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afd488-9804-4539-8fcf-0d86bfb2b8c0 service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:09.182148 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afd488-9804-4539-8fcf-0d86bfb2b8c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:09.184661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d5a85-ed46-450a-83fc-3d9f24dd826e None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:09.189661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22841d41-3235-4e6b-b865-668d960c82a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:09.190554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22841d41-3235-4e6b-b865-668d960c82a2 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:09.190929 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22841d41-3235-4e6b-b865-668d960c82a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:09.191305 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22841d41-3235-4e6b-b865-668d960c82a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:09.192353 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22841d41-3235-4e6b-b865-668d960c82a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:49:09.192705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22841d41-3235-4e6b-b865-668d960c82a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:09.194418 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22841d41-3235-4e6b-b865-668d960c82a2 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:09.203786 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afd488-9804-4539-8fcf-0d86bfb2b8c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:09.205391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afd488-9804-4539-8fcf-0d86bfb2b8c0 service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:09.208762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1015/2022] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:49:09.214104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22841d41-3235-4e6b-b865-668d960c82a2 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:09.217171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1008/2023] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:09.218065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afd488-9804-4539-8fcf-0d86bfb2b8c0 service nova] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:09.230747 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afd488-9804-4539-8fcf-0d86bfb2b8c0 service nova] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:09.237644 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7136222-da44-4241-871e-945f7dc42fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:09.238847 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7136222-da44-4241-871e-945f7dc42fae admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:09.238847 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7136222-da44-4241-871e-945f7dc42fae admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:09.238847 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7136222-da44-4241-871e-945f7dc42fae admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:09.239521 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7136222-da44-4241-871e-945f7dc42fae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:09.241634 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7136222-da44-4241-871e-945f7dc42fae admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:09.246646 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22841d41-3235-4e6b-b865-668d960c82a2 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:09.260347 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113e868-bbe6-4f14-978e-19a610947ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:09.261047 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113e868-bbe6-4f14-978e-19a610947ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:09.261332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113e868-bbe6-4f14-978e-19a610947ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:09.261614 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113e868-bbe6-4f14-978e-19a610947ad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:09.262379 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113e868-bbe6-4f14-978e-19a610947ad0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:09.264375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113e868-bbe6-4f14-978e-19a610947ad0 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:09.271312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1009/2024] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:09 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:09.275619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7136222-da44-4241-871e-945f7dc42fae admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:09.310049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1016/2025] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:09 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:09.311709 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113e868-bbe6-4f14-978e-19a610947ad0 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:09.342592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:09.364660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7136222-da44-4241-871e-945f7dc42fae admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:09.449865 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01294db0-ec03-4f0b-bf71-0b1ef715d2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:09.450782 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01294db0-ec03-4f0b-bf71-0b1ef715d2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:09.451165 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01294db0-ec03-4f0b-bf71-0b1ef715d2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:09.451662 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01294db0-ec03-4f0b-bf71-0b1ef715d2e7 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:09.452420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01294db0-ec03-4f0b-bf71-0b1ef715d2e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:09.454755 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01294db0-ec03-4f0b-bf71-0b1ef715d2e7 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:09.460709 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113e868-bbe6-4f14-978e-19a610947ad0 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:09.475114 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d87d1-9d88-4801-bbe5-508f83bf70da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:09.476010 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d87d1-9d88-4801-bbe5-508f83bf70da admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:09.476301 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d87d1-9d88-4801-bbe5-508f83bf70da admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:09.476579 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d87d1-9d88-4801-bbe5-508f83bf70da admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:09.477990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d87d1-9d88-4801-bbe5-508f83bf70da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:09.479501 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1010/2026] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:09 2022] POST /identity/v3/users => generated 295 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:49:09.480112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d87d1-9d88-4801-bbe5-508f83bf70da admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:09.480383 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01294db0-ec03-4f0b-bf71-0b1ef715d2e7 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:09.482212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-01294db0-ec03-4f0b-bf71-0b1ef715d2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:09.496786 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01294db0-ec03-4f0b-bf71-0b1ef715d2e7 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:09.503579 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace10aff-eb23-4ab9-861a-8403c86b4df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:09.504468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace10aff-eb23-4ab9-861a-8403c86b4df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:09.504759 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace10aff-eb23-4ab9-861a-8403c86b4df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:09.505244 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace10aff-eb23-4ab9-861a-8403c86b4df6 admin admin] PATH_INFO: `/v3/users/88401d1a9d27415a94274db78821c11f` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:09.506520 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace10aff-eb23-4ab9-861a-8403c86b4df6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88401d1a9d27415a94274db78821c11f)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:09.508768 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace10aff-eb23-4ab9-861a-8403c86b4df6 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:09.522862 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1017/2027] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:09 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:49:09.525668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d87d1-9d88-4801-bbe5-508f83bf70da admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:09.540734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d87d1-9d88-4801-bbe5-508f83bf70da admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:09.546899 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b4c48-9902-430c-998e-cbb652eb5164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:09.548560 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b4c48-9902-430c-998e-cbb652eb5164 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:09.548998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b4c48-9902-430c-998e-cbb652eb5164 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:09.549550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b4c48-9902-430c-998e-cbb652eb5164 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:09.550476 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b4c48-9902-430c-998e-cbb652eb5164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:09.552667 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b4c48-9902-430c-998e-cbb652eb5164 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:09.566524 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1018/2028] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:09.568345 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b4c48-9902-430c-998e-cbb652eb5164 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:09.580032 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b4c48-9902-430c-998e-cbb652eb5164 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:09.581510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-ace10aff-eb23-4ab9-861a-8403c86b4df6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88401d1a9d27415a94274db78821c11f'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:09.584731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:09.587472 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42b66d-d600-41d3-a2c8-4043f4f5984b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:09.588783 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42b66d-d600-41d3-a2c8-4043f4f5984b admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:09.590289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42b66d-d600-41d3-a2c8-4043f4f5984b admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:09.590910 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42b66d-d600-41d3-a2c8-4043f4f5984b admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:09.592122 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42b66d-d600-41d3-a2c8-4043f4f5984b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:09.593792 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-ace10aff-eb23-4ab9-861a-8403c86b4df6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88401d1a9d27415a94274db78821c11f'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:09.595913 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f42b66d-d600-41d3-a2c8-4043f4f5984b admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:09.613480 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-ace10aff-eb23-4ab9-861a-8403c86b4df6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88401d1a9d27415a94274db78821c11f'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:09.614525 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1019/2029] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:09.615674 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42b66d-d600-41d3-a2c8-4043f4f5984b admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:09.627884 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-ace10aff-eb23-4ab9-861a-8403c86b4df6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88401d1a9d27415a94274db78821c11f'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:09.628827 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-ace10aff-eb23-4ab9-861a-8403c86b4df6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88401d1a9d27415a94274db78821c11f'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:09.631726 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f42b66d-d600-41d3-a2c8-4043f4f5984b admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:09.639814 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1011/2030] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:09 2022] DELETE /identity/v3/users/88401d1a9d27415a94274db78821c11f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:09.640114 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce3340-8a9f-46cb-b0f2-14338ac433c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:09.640931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace10aff-eb23-4ab9-861a-8403c86b4df6 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:09.641166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce3340-8a9f-46cb-b0f2-14338ac433c6 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:09.641634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce3340-8a9f-46cb-b0f2-14338ac433c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:09.642061 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce3340-8a9f-46cb-b0f2-14338ac433c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:09.642978 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce3340-8a9f-46cb-b0f2-14338ac433c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:09.643365 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ace10aff-eb23-4ab9-861a-8403c86b4df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:09.645341 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce3340-8a9f-46cb-b0f2-14338ac433c6 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:09.663331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1020/2031] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:09.665352 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480528df-92da-4b12-8ad6-903df1a10d20 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:09.665637 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480528df-92da-4b12-8ad6-903df1a10d20 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:09.665912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480528df-92da-4b12-8ad6-903df1a10d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:09.704932 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-480528df-92da-4b12-8ad6-903df1a10d20 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:09.706420 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-480528df-92da-4b12-8ad6-903df1a10d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:09.742871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace10aff-eb23-4ab9-861a-8403c86b4df6 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:09.748347 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eeab9c-26b2-48b4-a757-1e2591944915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:09.749578 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eeab9c-26b2-48b4-a757-1e2591944915 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:09.749801 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eeab9c-26b2-48b4-a757-1e2591944915 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:09.750137 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eeab9c-26b2-48b4-a757-1e2591944915 admin admin] PATH_INFO: `/v3/projects/c81d77a03cfd4ac4aa074c250611d1f4/users/e4a3fd3090924a3c9d1818326acecb2c/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:09.790318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eeab9c-26b2-48b4-a757-1e2591944915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c81d77a03cfd4ac4aa074c250611d1f4, user_id=e4a3fd3090924a3c9d1818326acecb2c, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:09.794318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eeab9c-26b2-48b4-a757-1e2591944915 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:09.801570 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1021/2032] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:09.803012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480528df-92da-4b12-8ad6-903df1a10d20 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:09.805193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-480528df-92da-4b12-8ad6-903df1a10d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:09.814100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1012/2033] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:09 2022] PUT /identity/v3/projects/c81d77a03cfd4ac4aa074c250611d1f4/users/e4a3fd3090924a3c9d1818326acecb2c/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:09.815194 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eeab9c-26b2-48b4-a757-1e2591944915 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:09.817649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-94eeab9c-26b2-48b4-a757-1e2591944915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:09.821441 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480528df-92da-4b12-8ad6-903df1a10d20 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:09.920326 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728aa974-d70d-450e-8bfd-ce0980f3d121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:09.921419 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728aa974-d70d-450e-8bfd-ce0980f3d121 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:09.921754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728aa974-d70d-450e-8bfd-ce0980f3d121 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:09.922139 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728aa974-d70d-450e-8bfd-ce0980f3d121 admin admin] PATH_INFO: `/v3/projects/323405c544e04d6c8715a12fbae4508c/users/103f25dee0e14e9696303af59bb05d12/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:09.932298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eeab9c-26b2-48b4-a757-1e2591944915 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:09.937176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e896f-7a28-4d3b-ade3-99fe6788dc1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:09.937842 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e896f-7a28-4d3b-ade3-99fe6788dc1e service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:09.938123 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e896f-7a28-4d3b-ade3-99fe6788dc1e service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:09.938398 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e896f-7a28-4d3b-ade3-99fe6788dc1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:09.942555 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728aa974-d70d-450e-8bfd-ce0980f3d121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=323405c544e04d6c8715a12fbae4508c, user_id=103f25dee0e14e9696303af59bb05d12, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:09.947503 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728aa974-d70d-450e-8bfd-ce0980f3d121 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:09.951853 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e896f-7a28-4d3b-ade3-99fe6788dc1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:09.954777 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e896f-7a28-4d3b-ade3-99fe6788dc1e service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:09.964765 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:09.971842 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1013/2034] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:09.973318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e896f-7a28-4d3b-ade3-99fe6788dc1e service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:09.976108 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1022/2035] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:09 2022] PUT /identity/v3/projects/323405c544e04d6c8715a12fbae4508c/users/103f25dee0e14e9696303af59bb05d12/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:09.986590 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53c73e-681c-4df2-99b1-1632ccb089b8 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:09.986904 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53c73e-681c-4df2-99b1-1632ccb089b8 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:09.987234 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53c73e-681c-4df2-99b1-1632ccb089b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:09.998718 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e896f-7a28-4d3b-ade3-99fe6788dc1e service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:10.037958 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-fe53c73e-681c-4df2-99b1-1632ccb089b8 None None] MFA Rules not processed for user `103f25dee0e14e9696303af59bb05d12`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:10.039652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-fe53c73e-681c-4df2-99b1-1632ccb089b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:10.095195 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:10.127291 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fce63-5cd0-41b8-b96a-88a5ec427cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:10.130212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fce63-5cd0-41b8-b96a-88a5ec427cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:10.131194 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fce63-5cd0-41b8-b96a-88a5ec427cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:10.131667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fce63-5cd0-41b8-b96a-88a5ec427cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:10.134421 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fce63-5cd0-41b8-b96a-88a5ec427cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:10.136849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fce63-5cd0-41b8-b96a-88a5ec427cb8 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:10.154808 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1014/2036] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:10.159716 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fce63-5cd0-41b8-b96a-88a5ec427cb8 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:10.178729 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fce63-5cd0-41b8-b96a-88a5ec427cb8 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:10.199213 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc079bf-7229-42e3-9eff-088a8784a334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:10.200792 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc079bf-7229-42e3-9eff-088a8784a334 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:10.204588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1023/2037] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:10.206280 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53c73e-681c-4df2-99b1-1632ccb089b8 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:10.207067 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc079bf-7229-42e3-9eff-088a8784a334 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:10.208133 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc079bf-7229-42e3-9eff-088a8784a334 admin admin] PATH_INFO: `/v3/projects/c81d77a03cfd4ac4aa074c250611d1f4/users/e4a3fd3090924a3c9d1818326acecb2c/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:10.211498 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc079bf-7229-42e3-9eff-088a8784a334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c81d77a03cfd4ac4aa074c250611d1f4, user_id=e4a3fd3090924a3c9d1818326acecb2c, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:10.215432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc079bf-7229-42e3-9eff-088a8784a334 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:10.236253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1015/2038] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:10 2022] PUT /identity/v3/projects/c81d77a03cfd4ac4aa074c250611d1f4/users/e4a3fd3090924a3c9d1818326acecb2c/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:10.237507 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53c73e-681c-4df2-99b1-1632ccb089b8 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:10.252536 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1d82a-f6d1-49d4-a5d7-1bb2ae19079a None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:10.255626 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1d82a-f6d1-49d4-a5d7-1bb2ae19079a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:10.257063 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1d82a-f6d1-49d4-a5d7-1bb2ae19079a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:10.317916 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-3ed1d82a-f6d1-49d4-a5d7-1bb2ae19079a None None] MFA Rules not processed for user `e4a3fd3090924a3c9d1818326acecb2c`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:10.319717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3ed1d82a-f6d1-49d4-a5d7-1bb2ae19079a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:10.347369 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c2fb1-a009-413f-8974-b82d3f04c79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:10.348055 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c2fb1-a009-413f-8974-b82d3f04c79d admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:10.348496 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c2fb1-a009-413f-8974-b82d3f04c79d admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:10.348608 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c2fb1-a009-413f-8974-b82d3f04c79d admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:10.349322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c2fb1-a009-413f-8974-b82d3f04c79d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:10.351753 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c2fb1-a009-413f-8974-b82d3f04c79d admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:10.390553 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1024/2039] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:10 2022] POST /identity/v3/projects => generated 393 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:10.391752 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c2fb1-a009-413f-8974-b82d3f04c79d admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:10.396040 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-a98c2fb1-a009-413f-8974-b82d3f04c79d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:10.421537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1016/2040] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:10.423044 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1d82a-f6d1-49d4-a5d7-1bb2ae19079a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:10.443179 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1d82a-f6d1-49d4-a5d7-1bb2ae19079a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:10.484880 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c2fb1-a009-413f-8974-b82d3f04c79d admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:10.490797 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e4f54-043e-4602-9eb3-b531d1c2949c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:10.492174 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e4f54-043e-4602-9eb3-b531d1c2949c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:10.492572 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e4f54-043e-4602-9eb3-b531d1c2949c admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:10.492967 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e4f54-043e-4602-9eb3-b531d1c2949c admin admin] PATH_INFO: `/v3/users/3d24604acee24bfcb13df55b0621e993` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:10.494243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e4f54-043e-4602-9eb3-b531d1c2949c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d24604acee24bfcb13df55b0621e993)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:10.496372 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e4f54-043e-4602-9eb3-b531d1c2949c admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:10.510642 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0873aa1-b484-4192-9796-4049c1985ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:10.511345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0873aa1-b484-4192-9796-4049c1985ded admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:10.511628 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0873aa1-b484-4192-9796-4049c1985ded admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:10.511902 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0873aa1-b484-4192-9796-4049c1985ded admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:10.512597 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0873aa1-b484-4192-9796-4049c1985ded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:10.514519 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0873aa1-b484-4192-9796-4049c1985ded admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:10.517512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:10.540770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1017/2041] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:10 2022] POST /identity/v3/users => generated 303 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:10.541845 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0873aa1-b484-4192-9796-4049c1985ded admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:10.543665 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d0873aa1-b484-4192-9796-4049c1985ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:10.561763 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d40e4f54-043e-4602-9eb3-b531d1c2949c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d24604acee24bfcb13df55b0621e993'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:10.570537 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d40e4f54-043e-4602-9eb3-b531d1c2949c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d24604acee24bfcb13df55b0621e993'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:10.587178 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d40e4f54-043e-4602-9eb3-b531d1c2949c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d24604acee24bfcb13df55b0621e993'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:10.588301 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d40e4f54-043e-4602-9eb3-b531d1c2949c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d24604acee24bfcb13df55b0621e993'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:10.597372 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d40e4f54-043e-4602-9eb3-b531d1c2949c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d24604acee24bfcb13df55b0621e993'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:10.605038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1025/2042] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:10 2022] DELETE /identity/v3/users/3d24604acee24bfcb13df55b0621e993 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:10.605842 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e4f54-043e-4602-9eb3-b531d1c2949c admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:10.608104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0873aa1-b484-4192-9796-4049c1985ded admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:10.608782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-d40e4f54-043e-4602-9eb3-b531d1c2949c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:10.612325 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:10.664304 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9721d9-d466-4e32-85bd-a521f320be82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:10.664881 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9721d9-d466-4e32-85bd-a521f320be82 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:10.665168 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9721d9-d466-4e32-85bd-a521f320be82 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:10.665447 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9721d9-d466-4e32-85bd-a521f320be82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:10.667398 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-2a9721d9-d466-4e32-85bd-a521f320be82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:10.677166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e4f54-043e-4602-9eb3-b531d1c2949c admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:10.681874 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb5e8a-576b-4c4a-83cb-980131b0e1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:10.682536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb5e8a-576b-4c4a-83cb-980131b0e1ec admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:10.682818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb5e8a-576b-4c4a-83cb-980131b0e1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:10.683091 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb5e8a-576b-4c4a-83cb-980131b0e1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:10.683846 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb5e8a-576b-4c4a-83cb-980131b0e1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:10.685440 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb5e8a-576b-4c4a-83cb-980131b0e1ec admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:10.699881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1026/2043] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:10.699881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb5e8a-576b-4c4a-83cb-980131b0e1ec admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:10.701590 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-edfb5e8a-576b-4c4a-83cb-980131b0e1ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:10.715902 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb5e8a-576b-4c4a-83cb-980131b0e1ec admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:10.723515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43516b-e2ad-4c3c-86df-0da9d5a7ab60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:10.724860 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43516b-e2ad-4c3c-86df-0da9d5a7ab60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:10.724860 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43516b-e2ad-4c3c-86df-0da9d5a7ab60 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:10.725060 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43516b-e2ad-4c3c-86df-0da9d5a7ab60 admin admin] PATH_INFO: `/v3/projects/93e0359e6ef34f41990bd9bb007b5185` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:10.726218 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43516b-e2ad-4c3c-86df-0da9d5a7ab60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93e0359e6ef34f41990bd9bb007b5185)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:10.728696 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43516b-e2ad-4c3c-86df-0da9d5a7ab60 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:10.758950 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9721d9-d466-4e32-85bd-a521f320be82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:10.761866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9721d9-d466-4e32-85bd-a521f320be82 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:10.778378 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1018/2044] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:10 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:10.779900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfc007-3ae0-4890-8df5-3c79e22c1d48 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:10.780318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfc007-3ae0-4890-8df5-3c79e22c1d48 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:10.781192 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cfc007-3ae0-4890-8df5-3c79e22c1d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:10.788382 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-7c43516b-e2ad-4c3c-86df-0da9d5a7ab60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93e0359e6ef34f41990bd9bb007b5185', 'request_id': 'req-7c43516b-e2ad-4c3c-86df-0da9d5a7ab60'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:10.801113 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-7c43516b-e2ad-4c3c-86df-0da9d5a7ab60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93e0359e6ef34f41990bd9bb007b5185', 'request_id': 'req-7c43516b-e2ad-4c3c-86df-0da9d5a7ab60'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:10.801735 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-12cfc007-3ae0-4890-8df5-3c79e22c1d48 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:10.802960 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-12cfc007-3ae0-4890-8df5-3c79e22c1d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:10.814194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-7c43516b-e2ad-4c3c-86df-0da9d5a7ab60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93e0359e6ef34f41990bd9bb007b5185', 'request_id': 'req-7c43516b-e2ad-4c3c-86df-0da9d5a7ab60'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:10.839076 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-7c43516b-e2ad-4c3c-86df-0da9d5a7ab60 admin admin] The token cache is being invalidate because project 93e0359e6ef34f41990bd9bb007b5185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:10.839076 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-7c43516b-e2ad-4c3c-86df-0da9d5a7ab60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:10.839906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-7c43516b-e2ad-4c3c-86df-0da9d5a7ab60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:10.844757 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1027/2045] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:10 2022] DELETE /identity/v3/projects/93e0359e6ef34f41990bd9bb007b5185 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:10.844757 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43516b-e2ad-4c3c-86df-0da9d5a7ab60 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:10.845708 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-7c43516b-e2ad-4c3c-86df-0da9d5a7ab60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:10.865931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:10.923453 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1019/2046] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:10.924267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfc007-3ae0-4890-8df5-3c79e22c1d48 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:10.928298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-12cfc007-3ae0-4890-8df5-3c79e22c1d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:10.941396 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cfc007-3ae0-4890-8df5-3c79e22c1d48 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:10.946664 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20850eb-20d0-450a-98e8-64d53fb5ea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:10.947576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20850eb-20d0-450a-98e8-64d53fb5ea84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:10.947859 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20850eb-20d0-450a-98e8-64d53fb5ea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:10.948131 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20850eb-20d0-450a-98e8-64d53fb5ea84 admin admin] PATH_INFO: `/v3/users/8742d9b1301a4b558bc52fd144bb74a7` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:10.949329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20850eb-20d0-450a-98e8-64d53fb5ea84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8742d9b1301a4b558bc52fd144bb74a7)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:10.951163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43516b-e2ad-4c3c-86df-0da9d5a7ab60 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:10.951317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20850eb-20d0-450a-98e8-64d53fb5ea84 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:10.956776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b574575-637f-48d6-ba0b-ad1471bf5b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:10.957667 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b574575-637f-48d6-ba0b-ad1471bf5b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:10.957953 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b574575-637f-48d6-ba0b-ad1471bf5b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:10.958344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b574575-637f-48d6-ba0b-ad1471bf5b8c admin admin] PATH_INFO: `/v3/projects/b084823b59db47038f579cf7ec0c21d0/users/abcb76bfd40a4343a5fa245b1f079274/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:10.972336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b574575-637f-48d6-ba0b-ad1471bf5b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b084823b59db47038f579cf7ec0c21d0, user_id=abcb76bfd40a4343a5fa245b1f079274, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:10.975056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b574575-637f-48d6-ba0b-ad1471bf5b8c admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:10.989184 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1028/2047] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:10 2022] PUT /identity/v3/projects/b084823b59db47038f579cf7ec0c21d0/users/abcb76bfd40a4343a5fa245b1f079274/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:10.989767 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b574575-637f-48d6-ba0b-ad1471bf5b8c admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:10.991381 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-4b574575-637f-48d6-ba0b-ad1471bf5b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:11.000487 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-c20850eb-20d0-450a-98e8-64d53fb5ea84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8742d9b1301a4b558bc52fd144bb74a7'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:11.005401 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:11.009017 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-c20850eb-20d0-450a-98e8-64d53fb5ea84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8742d9b1301a4b558bc52fd144bb74a7'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:11.024375 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-c20850eb-20d0-450a-98e8-64d53fb5ea84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8742d9b1301a4b558bc52fd144bb74a7'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:11.031465 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-c20850eb-20d0-450a-98e8-64d53fb5ea84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8742d9b1301a4b558bc52fd144bb74a7'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:11.032192 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-c20850eb-20d0-450a-98e8-64d53fb5ea84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8742d9b1301a4b558bc52fd144bb74a7'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:11.039164 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1020/2048] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:10 2022] DELETE /identity/v3/users/8742d9b1301a4b558bc52fd144bb74a7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:11.039897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20850eb-20d0-450a-98e8-64d53fb5ea84 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:11.041315 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c20850eb-20d0-450a-98e8-64d53fb5ea84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:11.050617 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b574575-637f-48d6-ba0b-ad1471bf5b8c admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:11.121710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20850eb-20d0-450a-98e8-64d53fb5ea84 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:11.126058 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa667fb-c534-415e-a2a7-bc4cb4464429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:11.126220 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b812eac-4137-43a9-a500-1057fa10e6eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:11.126852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa667fb-c534-415e-a2a7-bc4cb4464429 service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:11.126962 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b812eac-4137-43a9-a500-1057fa10e6eb service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:11.127238 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa667fb-c534-415e-a2a7-bc4cb4464429 service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:11.127385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b812eac-4137-43a9-a500-1057fa10e6eb service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:11.127551 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b812eac-4137-43a9-a500-1057fa10e6eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:11.127744 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa667fb-c534-415e-a2a7-bc4cb4464429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:11.129716 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7b812eac-4137-43a9-a500-1057fa10e6eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:11.130867 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-6fa667fb-c534-415e-a2a7-bc4cb4464429 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:11.215857 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b812eac-4137-43a9-a500-1057fa10e6eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:11.217539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b812eac-4137-43a9-a500-1057fa10e6eb service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:11.231623 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1021/2049] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:11.233174 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b812eac-4137-43a9-a500-1057fa10e6eb service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:11.235418 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7b812eac-4137-43a9-a500-1057fa10e6eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:11.245864 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa667fb-c534-415e-a2a7-bc4cb4464429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:11.247338 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa667fb-c534-415e-a2a7-bc4cb4464429 service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:11.255889 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b812eac-4137-43a9-a500-1057fa10e6eb service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:11.258095 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1029/2050] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:10 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:11.275512 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae721e1a-eba4-499e-85d9-fa2ae81c968c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:11.276211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae721e1a-eba4-499e-85d9-fa2ae81c968c admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:11.276500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae721e1a-eba4-499e-85d9-fa2ae81c968c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:11.276782 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae721e1a-eba4-499e-85d9-fa2ae81c968c admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:11.279312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae721e1a-eba4-499e-85d9-fa2ae81c968c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:11.286297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae721e1a-eba4-499e-85d9-fa2ae81c968c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:11.315017 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1022/2051] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:11.316817 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa667fb-c534-415e-a2a7-bc4cb4464429 service cinder] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:11.337911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa667fb-c534-415e-a2a7-bc4cb4464429 service cinder] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:11.343477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eae6e1-f5ee-4181-aa15-d4346b85b2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:11.344553 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eae6e1-f5ee-4181-aa15-d4346b85b2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:11.344955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eae6e1-f5ee-4181-aa15-d4346b85b2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:11.345331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eae6e1-f5ee-4181-aa15-d4346b85b2a0 admin admin] PATH_INFO: `/v3/projects/b084823b59db47038f579cf7ec0c21d0/users/abcb76bfd40a4343a5fa245b1f079274/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:11.347987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eae6e1-f5ee-4181-aa15-d4346b85b2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b084823b59db47038f579cf7ec0c21d0, user_id=abcb76bfd40a4343a5fa245b1f079274, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:11.353185 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eae6e1-f5ee-4181-aa15-d4346b85b2a0 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:11.356710 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:11.378777 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1030/2052] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:11 2022] PUT /identity/v3/projects/b084823b59db47038f579cf7ec0c21d0/users/abcb76bfd40a4343a5fa245b1f079274/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:11.389927 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6da333-bf15-43ba-b799-cf9e61578c33 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:11.390217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6da333-bf15-43ba-b799-cf9e61578c33 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:11.390501 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6da333-bf15-43ba-b799-cf9e61578c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:11.448266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-3c6da333-bf15-43ba-b799-cf9e61578c33 None None] MFA Rules not processed for user `abcb76bfd40a4343a5fa245b1f079274`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:11.452337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3c6da333-bf15-43ba-b799-cf9e61578c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:11.519040 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eae6e1-f5ee-4181-aa15-d4346b85b2a0 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:11.520933 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-20eae6e1-f5ee-4181-aa15-d4346b85b2a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:11.701966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eae6e1-f5ee-4181-aa15-d4346b85b2a0 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:11.707881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538fe21-b83c-4adf-8b89-eb29ddc1ab76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:11.708895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538fe21-b83c-4adf-8b89-eb29ddc1ab76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:11.709286 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538fe21-b83c-4adf-8b89-eb29ddc1ab76 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:11.709666 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538fe21-b83c-4adf-8b89-eb29ddc1ab76 admin admin] PATH_INFO: `/v3/projects/f50b8bf31f744e01ad2d41c84ea8c295` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:11.711400 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538fe21-b83c-4adf-8b89-eb29ddc1ab76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f50b8bf31f744e01ad2d41c84ea8c295)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:11.713624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538fe21-b83c-4adf-8b89-eb29ddc1ab76 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:11.720789 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:11.752934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1023/2053] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:11.766673 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6da333-bf15-43ba-b799-cf9e61578c33 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:11.769837 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3c6da333-bf15-43ba-b799-cf9e61578c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:11.811299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a538fe21-b83c-4adf-8b89-eb29ddc1ab76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f50b8bf31f744e01ad2d41c84ea8c295', 'request_id': 'req-a538fe21-b83c-4adf-8b89-eb29ddc1ab76'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:11.824886 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a538fe21-b83c-4adf-8b89-eb29ddc1ab76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f50b8bf31f744e01ad2d41c84ea8c295', 'request_id': 'req-a538fe21-b83c-4adf-8b89-eb29ddc1ab76'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:11.835952 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a538fe21-b83c-4adf-8b89-eb29ddc1ab76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f50b8bf31f744e01ad2d41c84ea8c295', 'request_id': 'req-a538fe21-b83c-4adf-8b89-eb29ddc1ab76'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:11.866443 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a538fe21-b83c-4adf-8b89-eb29ddc1ab76 admin admin] The token cache is being invalidate because project f50b8bf31f744e01ad2d41c84ea8c295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:11.867138 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a538fe21-b83c-4adf-8b89-eb29ddc1ab76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:11.867990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a538fe21-b83c-4adf-8b89-eb29ddc1ab76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:11.869956 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1031/2054] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:11 2022] DELETE /identity/v3/projects/f50b8bf31f744e01ad2d41c84ea8c295 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:11.870934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538fe21-b83c-4adf-8b89-eb29ddc1ab76 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:11.872498 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-a538fe21-b83c-4adf-8b89-eb29ddc1ab76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:11.893403 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6da333-bf15-43ba-b799-cf9e61578c33 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:11.976004 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538fe21-b83c-4adf-8b89-eb29ddc1ab76 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:11.985355 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654d956-ea2d-4f68-8a73-397fb055622e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:11.986749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654d956-ea2d-4f68-8a73-397fb055622e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:11.987432 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654d956-ea2d-4f68-8a73-397fb055622e admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:11.987721 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654d956-ea2d-4f68-8a73-397fb055622e admin admin] PATH_INFO: `/v3/users/6df21630d6a24eefb71226012b0981bc` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:11.989056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654d956-ea2d-4f68-8a73-397fb055622e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6df21630d6a24eefb71226012b0981bc)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:11.991099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654d956-ea2d-4f68-8a73-397fb055622e admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:11.992010 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc422f-b73c-47e4-8268-d48d73969e95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:11.993095 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc422f-b73c-47e4-8268-d48d73969e95 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:11.993586 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc422f-b73c-47e4-8268-d48d73969e95 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:11.994093 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc422f-b73c-47e4-8268-d48d73969e95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:11.996376 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-27fc422f-b73c-47e4-8268-d48d73969e95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:12.032674 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:INSERT=2,keystone:SELECT=87,keystone:DELETE=11 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:12.060879 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-0654d956-ea2d-4f68-8a73-397fb055622e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6df21630d6a24eefb71226012b0981bc'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:12.077418 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-0654d956-ea2d-4f68-8a73-397fb055622e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6df21630d6a24eefb71226012b0981bc'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:12.102330 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-0654d956-ea2d-4f68-8a73-397fb055622e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6df21630d6a24eefb71226012b0981bc'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:12.103758 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-0654d956-ea2d-4f68-8a73-397fb055622e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6df21630d6a24eefb71226012b0981bc'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:12.115606 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-0654d956-ea2d-4f68-8a73-397fb055622e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6df21630d6a24eefb71226012b0981bc'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:12.126038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1032/2055] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:11 2022] DELETE /identity/v3/users/6df21630d6a24eefb71226012b0981bc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:12.127015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654d956-ea2d-4f68-8a73-397fb055622e admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:12.129156 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-0654d956-ea2d-4f68-8a73-397fb055622e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:12.139914 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc422f-b73c-47e4-8268-d48d73969e95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:12.142056 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc422f-b73c-47e4-8268-d48d73969e95 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:12.152704 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1024/2056] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:12.154020 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e05cf-fbd9-4b0e-900a-7fc67a8a13de None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:12.154311 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e05cf-fbd9-4b0e-900a-7fc67a8a13de None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:12.154623 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e05cf-fbd9-4b0e-900a-7fc67a8a13de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:12.177890 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-334e05cf-fbd9-4b0e-900a-7fc67a8a13de None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:12.179110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-334e05cf-fbd9-4b0e-900a-7fc67a8a13de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:12.250844 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654d956-ea2d-4f68-8a73-397fb055622e admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:12.257094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1d0c9-9f57-4913-bba6-ba1076860b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:12.258992 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1d0c9-9f57-4913-bba6-ba1076860b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:12.259300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1d0c9-9f57-4913-bba6-ba1076860b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:12.259586 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1d0c9-9f57-4913-bba6-ba1076860b5e admin admin] PATH_INFO: `/v3/projects/ad71d5300e924001af3199d9a5c20819` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:12.270308 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1d0c9-9f57-4913-bba6-ba1076860b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad71d5300e924001af3199d9a5c20819)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:12.270415 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:12.270518 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1d0c9-9f57-4913-bba6-ba1076860b5e admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:12.282676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1025/2057] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:12.284074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e883c6e-4f66-40db-a117-94447dfe5bcd None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:12.284365 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e883c6e-4f66-40db-a117-94447dfe5bcd None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:12.284649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e883c6e-4f66-40db-a117-94447dfe5bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:12.302296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-1e883c6e-4f66-40db-a117-94447dfe5bcd None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:12.303640 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-1e883c6e-4f66-40db-a117-94447dfe5bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:12.315355 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-7bf1d0c9-9f57-4913-bba6-ba1076860b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad71d5300e924001af3199d9a5c20819', 'request_id': 'req-7bf1d0c9-9f57-4913-bba6-ba1076860b5e'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:12.323929 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-7bf1d0c9-9f57-4913-bba6-ba1076860b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad71d5300e924001af3199d9a5c20819', 'request_id': 'req-7bf1d0c9-9f57-4913-bba6-ba1076860b5e'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:12.329526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-7bf1d0c9-9f57-4913-bba6-ba1076860b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad71d5300e924001af3199d9a5c20819', 'request_id': 'req-7bf1d0c9-9f57-4913-bba6-ba1076860b5e'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:12.343082 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-7bf1d0c9-9f57-4913-bba6-ba1076860b5e admin admin] The token cache is being invalidate because project ad71d5300e924001af3199d9a5c20819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:12.343403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-7bf1d0c9-9f57-4913-bba6-ba1076860b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:12.344071 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-7bf1d0c9-9f57-4913-bba6-ba1076860b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:12.345626 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1033/2058] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:12 2022] DELETE /identity/v3/projects/ad71d5300e924001af3199d9a5c20819 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:12.346388 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1d0c9-9f57-4913-bba6-ba1076860b5e admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:12.347789 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-7bf1d0c9-9f57-4913-bba6-ba1076860b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:12.363420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1026/2059] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:12.366734 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f4aa4-1a7f-425a-976e-2edea6349743 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:12.366734 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f4aa4-1a7f-425a-976e-2edea6349743 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:12.366734 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f4aa4-1a7f-425a-976e-2edea6349743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:12.383247 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:12.385461 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-722f4aa4-1a7f-425a-976e-2edea6349743 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:12.386692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-722f4aa4-1a7f-425a-976e-2edea6349743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:12.396104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1027/2060] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:12.399916 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f4aa4-1a7f-425a-976e-2edea6349743 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:12.399916 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-722f4aa4-1a7f-425a-976e-2edea6349743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:12.410791 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f4aa4-1a7f-425a-976e-2edea6349743 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:12.410954 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1d0c9-9f57-4913-bba6-ba1076860b5e admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:12.414760 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfcfbc-46c3-4914-94e8-a981160bc78d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:12.415430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332db41-8d45-4b75-8be3-59b25152b15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:12.415549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfcfbc-46c3-4914-94e8-a981160bc78d service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:12.415725 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfcfbc-46c3-4914-94e8-a981160bc78d service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:12.416006 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfcfbc-46c3-4914-94e8-a981160bc78d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:12.416287 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332db41-8d45-4b75-8be3-59b25152b15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:12.416571 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332db41-8d45-4b75-8be3-59b25152b15f admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:12.416847 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332db41-8d45-4b75-8be3-59b25152b15f admin admin] PATH_INFO: `/v3/users/77f1cd36c963477ca44fd61760c68b65` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:12.417865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-7fbfcfbc-46c3-4914-94e8-a981160bc78d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:12.418026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332db41-8d45-4b75-8be3-59b25152b15f admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f1cd36c963477ca44fd61760c68b65)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:12.419981 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332db41-8d45-4b75-8be3-59b25152b15f admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:12.468582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-1332db41-8d45-4b75-8be3-59b25152b15f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f1cd36c963477ca44fd61760c68b65'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:12.476451 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-1332db41-8d45-4b75-8be3-59b25152b15f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f1cd36c963477ca44fd61760c68b65'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:12.477756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfcfbc-46c3-4914-94e8-a981160bc78d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:12.479198 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfcfbc-46c3-4914-94e8-a981160bc78d service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:12.488457 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1034/2061] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:12.488806 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-1332db41-8d45-4b75-8be3-59b25152b15f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f1cd36c963477ca44fd61760c68b65'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:12.489341 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfcfbc-46c3-4914-94e8-a981160bc78d service cinder] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:12.490693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-7fbfcfbc-46c3-4914-94e8-a981160bc78d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:12.499062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-1332db41-8d45-4b75-8be3-59b25152b15f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f1cd36c963477ca44fd61760c68b65'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:12.499995 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-1332db41-8d45-4b75-8be3-59b25152b15f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f1cd36c963477ca44fd61760c68b65'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:12.508084 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1028/2062] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:12 2022] DELETE /identity/v3/users/77f1cd36c963477ca44fd61760c68b65 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:12.508759 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332db41-8d45-4b75-8be3-59b25152b15f admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:12.510424 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-1332db41-8d45-4b75-8be3-59b25152b15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:12.575490 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfcfbc-46c3-4914-94e8-a981160bc78d service cinder] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:12.599292 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332db41-8d45-4b75-8be3-59b25152b15f admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:12.606118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ca173-1b7f-483c-bbbb-0846e1d5d796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:12.607478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ca173-1b7f-483c-bbbb-0846e1d5d796 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:12.607880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ca173-1b7f-483c-bbbb-0846e1d5d796 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:12.608326 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93ca173-1b7f-483c-bbbb-0846e1d5d796 admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:12.609449 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ca173-1b7f-483c-bbbb-0846e1d5d796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:49:12.609867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ca173-1b7f-483c-bbbb-0846e1d5d796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:12.612312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93ca173-1b7f-483c-bbbb-0846e1d5d796 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:12.624161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:12.635585 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1029/2063] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:49:12.642564 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ca173-1b7f-483c-bbbb-0846e1d5d796 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:12.648735 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525deee-a79b-4665-8105-5a89cb12ce4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:12.649605 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525deee-a79b-4665-8105-5a89cb12ce4b service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:12.649959 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525deee-a79b-4665-8105-5a89cb12ce4b service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:12.650227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525deee-a79b-4665-8105-5a89cb12ce4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:12.652444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-4525deee-a79b-4665-8105-5a89cb12ce4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:12.670802 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525deee-a79b-4665-8105-5a89cb12ce4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:12.672906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525deee-a79b-4665-8105-5a89cb12ce4b service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:12.673498 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93ca173-1b7f-483c-bbbb-0846e1d5d796 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:12.685604 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6985c-0282-4507-84a9-bc6e116fe596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:12.686650 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6985c-0282-4507-84a9-bc6e116fe596 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:12.687716 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6985c-0282-4507-84a9-bc6e116fe596 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:12.688183 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6985c-0282-4507-84a9-bc6e116fe596 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:12.689487 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1035/2064] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:12.690443 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6985c-0282-4507-84a9-bc6e116fe596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:12.693822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6985c-0282-4507-84a9-bc6e116fe596 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:12.794137 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1030/2065] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:12 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:12.796304 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525deee-a79b-4665-8105-5a89cb12ce4b service neutron] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:12.826511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525deee-a79b-4665-8105-5a89cb12ce4b service neutron] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:13.134452 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6985c-0282-4507-84a9-bc6e116fe596 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:13.142022 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a4c6985c-0282-4507-84a9-bc6e116fe596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:13.154071 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:13.197289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771f004-4797-4714-a5c0-228c62c27335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:13.198115 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771f004-4797-4714-a5c0-228c62c27335 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:13.198473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771f004-4797-4714-a5c0-228c62c27335 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:13.198825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771f004-4797-4714-a5c0-228c62c27335 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:13.200092 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771f004-4797-4714-a5c0-228c62c27335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:13.202109 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771f004-4797-4714-a5c0-228c62c27335 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:13.261949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1036/2066] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:12 2022] POST /identity/v3/users => generated 289 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:49:13.263448 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771f004-4797-4714-a5c0-228c62c27335 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:13.280437 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771f004-4797-4714-a5c0-228c62c27335 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:13.287629 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550879d-4e25-4016-9550-ce91f4c2218d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:13.288356 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550879d-4e25-4016-9550-ce91f4c2218d admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:13.288663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550879d-4e25-4016-9550-ce91f4c2218d admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:13.290122 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550879d-4e25-4016-9550-ce91f4c2218d admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:13.291633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550879d-4e25-4016-9550-ce91f4c2218d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:13.294257 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550879d-4e25-4016-9550-ce91f4c2218d admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:13.309546 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6985c-0282-4507-84a9-bc6e116fe596 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:13.311684 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1037/2067] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:13.314890 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550879d-4e25-4016-9550-ce91f4c2218d admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:13.321231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2ac4d-5080-485e-8aab-99ba0c28d5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:13.322972 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2ac4d-5080-485e-8aab-99ba0c28d5c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:13.323276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2ac4d-5080-485e-8aab-99ba0c28d5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:13.327369 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550879d-4e25-4016-9550-ce91f4c2218d admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:13.328175 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2ac4d-5080-485e-8aab-99ba0c28d5c3 admin admin] PATH_INFO: `/v3/projects/54080dcefccc4924bfbaed30664353e6` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:13.332496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2ac4d-5080-485e-8aab-99ba0c28d5c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54080dcefccc4924bfbaed30664353e6)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:13.337757 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2ac4d-5080-485e-8aab-99ba0c28d5c3 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:13.360829 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b74822-ee97-4430-bc52-52b1ff1f042b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:13.361743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b74822-ee97-4430-bc52-52b1ff1f042b admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:13.362835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b74822-ee97-4430-bc52-52b1ff1f042b admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:13.363087 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b74822-ee97-4430-bc52-52b1ff1f042b admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:13.374655 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b74822-ee97-4430-bc52-52b1ff1f042b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:13.379084 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b74822-ee97-4430-bc52-52b1ff1f042b admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:13.401823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1038/2068] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:13.402539 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b74822-ee97-4430-bc52-52b1ff1f042b admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:13.405810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-57b74822-ee97-4430-bc52-52b1ff1f042b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:13.421779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b74822-ee97-4430-bc52-52b1ff1f042b admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:13.435440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-d0c2ac4d-5080-485e-8aab-99ba0c28d5c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54080dcefccc4924bfbaed30664353e6', 'request_id': 'req-d0c2ac4d-5080-485e-8aab-99ba0c28d5c3'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:13.442699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-d0c2ac4d-5080-485e-8aab-99ba0c28d5c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54080dcefccc4924bfbaed30664353e6', 'request_id': 'req-d0c2ac4d-5080-485e-8aab-99ba0c28d5c3'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:13.455255 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-d0c2ac4d-5080-485e-8aab-99ba0c28d5c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54080dcefccc4924bfbaed30664353e6', 'request_id': 'req-d0c2ac4d-5080-485e-8aab-99ba0c28d5c3'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:13.475661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-d0c2ac4d-5080-485e-8aab-99ba0c28d5c3 admin admin] The token cache is being invalidate because project 54080dcefccc4924bfbaed30664353e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:13.476267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-d0c2ac4d-5080-485e-8aab-99ba0c28d5c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:13.477735 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-d0c2ac4d-5080-485e-8aab-99ba0c28d5c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:13.482701 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1031/2069] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:13 2022] DELETE /identity/v3/projects/54080dcefccc4924bfbaed30664353e6 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:13.482701 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2ac4d-5080-485e-8aab-99ba0c28d5c3 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:13.482701 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d0c2ac4d-5080-485e-8aab-99ba0c28d5c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:13.519746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eab7a0-26ea-442b-a17a-b31bef4d23e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:13.523156 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eab7a0-26ea-442b-a17a-b31bef4d23e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:13.524555 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eab7a0-26ea-442b-a17a-b31bef4d23e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:13.524871 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eab7a0-26ea-442b-a17a-b31bef4d23e8 admin admin] PATH_INFO: `/v3/projects/5b7a9c3d0d9b4ef9bd6db164d33bcc6a` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:13.527426 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eab7a0-26ea-442b-a17a-b31bef4d23e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b7a9c3d0d9b4ef9bd6db164d33bcc6a)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:13.530657 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eab7a0-26ea-442b-a17a-b31bef4d23e8 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:13.604051 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-45eab7a0-26ea-442b-a17a-b31bef4d23e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b7a9c3d0d9b4ef9bd6db164d33bcc6a', 'request_id': 'req-45eab7a0-26ea-442b-a17a-b31bef4d23e8'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:13.614416 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-45eab7a0-26ea-442b-a17a-b31bef4d23e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b7a9c3d0d9b4ef9bd6db164d33bcc6a', 'request_id': 'req-45eab7a0-26ea-442b-a17a-b31bef4d23e8'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:13.621853 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-45eab7a0-26ea-442b-a17a-b31bef4d23e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b7a9c3d0d9b4ef9bd6db164d33bcc6a', 'request_id': 'req-45eab7a0-26ea-442b-a17a-b31bef4d23e8'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:13.625766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2ac4d-5080-485e-8aab-99ba0c28d5c3 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:13.635965 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-45eab7a0-26ea-442b-a17a-b31bef4d23e8 admin admin] The token cache is being invalidate because project 5b7a9c3d0d9b4ef9bd6db164d33bcc6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:13.636417 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-45eab7a0-26ea-442b-a17a-b31bef4d23e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:13.637347 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-45eab7a0-26ea-442b-a17a-b31bef4d23e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:13.642007 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:13.643030 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1039/2070] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:13 2022] DELETE /identity/v3/projects/5b7a9c3d0d9b4ef9bd6db164d33bcc6a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:13.644433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52423eaf-9547-456e-a26b-0a43eaf9b45d None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:13.644874 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52423eaf-9547-456e-a26b-0a43eaf9b45d None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:13.645592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52423eaf-9547-456e-a26b-0a43eaf9b45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:13.669164 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-52423eaf-9547-456e-a26b-0a43eaf9b45d None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:13.670407 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-52423eaf-9547-456e-a26b-0a43eaf9b45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:13.738432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1a22b-7b09-4f46-b155-5bbeff7f08fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:13.739797 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:13.740110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1a22b-7b09-4f46-b155-5bbeff7f08fd admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:13.740406 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1a22b-7b09-4f46-b155-5bbeff7f08fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:13.740688 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1a22b-7b09-4f46-b155-5bbeff7f08fd admin admin] PATH_INFO: `/v3/projects/79af921d2c884570b3d055afdfdc152b/users/2eddc6b1a64c42e482fed95b6a8c58ed/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:13.757644 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1a22b-7b09-4f46-b155-5bbeff7f08fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=79af921d2c884570b3d055afdfdc152b, user_id=2eddc6b1a64c42e482fed95b6a8c58ed, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:13.761685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1a22b-7b09-4f46-b155-5bbeff7f08fd admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:13.762758 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1040/2071] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:13.763631 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52423eaf-9547-456e-a26b-0a43eaf9b45d None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:13.764904 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-52423eaf-9547-456e-a26b-0a43eaf9b45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:13.777394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1032/2072] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:13 2022] PUT /identity/v3/projects/79af921d2c884570b3d055afdfdc152b/users/2eddc6b1a64c42e482fed95b6a8c58ed/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:13.778697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52423eaf-9547-456e-a26b-0a43eaf9b45d None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:13.780766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838f45c-f2a5-4085-97d2-ca6c5268a2cf None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:13.781052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838f45c-f2a5-4085-97d2-ca6c5268a2cf None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:13.781327 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838f45c-f2a5-4085-97d2-ca6c5268a2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:13.800881 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-9838f45c-f2a5-4085-97d2-ca6c5268a2cf None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:13.802107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-9838f45c-f2a5-4085-97d2-ca6c5268a2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:13.840800 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e08ef-6d78-47df-b3cf-aaf9046cc4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:13.841744 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e08ef-6d78-47df-b3cf-aaf9046cc4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:13.842012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e08ef-6d78-47df-b3cf-aaf9046cc4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:13.842292 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e08ef-6d78-47df-b3cf-aaf9046cc4ab admin admin] PATH_INFO: `/v3/users/472eb894ed634b3293a59136a7f007f6` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:13.843587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e08ef-6d78-47df-b3cf-aaf9046cc4ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=472eb894ed634b3293a59136a7f007f6)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:13.845544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e08ef-6d78-47df-b3cf-aaf9046cc4ab admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:13.865406 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1033/2073] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:13.866813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e27aec-585c-4104-b847-f00659c8b2fe None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:13.867107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e27aec-585c-4104-b847-f00659c8b2fe None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:13.867975 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e27aec-585c-4104-b847-f00659c8b2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:13.900760 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-208e08ef-6d78-47df-b3cf-aaf9046cc4ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '472eb894ed634b3293a59136a7f007f6'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:13.904548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-208e08ef-6d78-47df-b3cf-aaf9046cc4ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '472eb894ed634b3293a59136a7f007f6'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:13.904885 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-82e27aec-585c-4104-b847-f00659c8b2fe None None] MFA Rules not processed for user `2eddc6b1a64c42e482fed95b6a8c58ed`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:13.906122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-82e27aec-585c-4104-b847-f00659c8b2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:13.917777 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-208e08ef-6d78-47df-b3cf-aaf9046cc4ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '472eb894ed634b3293a59136a7f007f6'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:13.918486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-208e08ef-6d78-47df-b3cf-aaf9046cc4ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '472eb894ed634b3293a59136a7f007f6'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:13.927091 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-208e08ef-6d78-47df-b3cf-aaf9046cc4ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '472eb894ed634b3293a59136a7f007f6'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:13.934572 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1041/2074] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:13 2022] DELETE /identity/v3/users/472eb894ed634b3293a59136a7f007f6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:13.935585 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e08ef-6d78-47df-b3cf-aaf9046cc4ab admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:13.938467 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-208e08ef-6d78-47df-b3cf-aaf9046cc4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:13.977736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1034/2075] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:13.989889 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e27aec-585c-4104-b847-f00659c8b2fe None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:13.991544 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-82e27aec-585c-4104-b847-f00659c8b2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:14.023642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e08ef-6d78-47df-b3cf-aaf9046cc4ab admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:14.033909 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59b5dc-215e-49fc-9500-266ed10508a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:14.034918 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59b5dc-215e-49fc-9500-266ed10508a7 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:14.035917 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59b5dc-215e-49fc-9500-266ed10508a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:14.037257 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59b5dc-215e-49fc-9500-266ed10508a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:14.038309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59b5dc-215e-49fc-9500-266ed10508a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:49:14.039501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59b5dc-215e-49fc-9500-266ed10508a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:14.041952 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59b5dc-215e-49fc-9500-266ed10508a7 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:14.052362 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:14.057287 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:14.066798 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1042/2076] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:49:14.071733 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59b5dc-215e-49fc-9500-266ed10508a7 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:14.085017 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59b5dc-215e-49fc-9500-266ed10508a7 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:14.091096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e18c3-1000-42e4-8b2f-211addc0cc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:14.092326 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e18c3-1000-42e4-8b2f-211addc0cc11 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:14.093261 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e18c3-1000-42e4-8b2f-211addc0cc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:14.093536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e18c3-1000-42e4-8b2f-211addc0cc11 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:14.094615 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e18c3-1000-42e4-8b2f-211addc0cc11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:14.096725 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e27aec-585c-4104-b847-f00659c8b2fe None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:14.096898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e18c3-1000-42e4-8b2f-211addc0cc11 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:14.139288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1043/2077] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:14 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:49:14.145666 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e18c3-1000-42e4-8b2f-211addc0cc11 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:14.178673 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3931da-203f-4ff8-b306-07c74357534b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:14.181163 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3931da-203f-4ff8-b306-07c74357534b service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:14.181466 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3931da-203f-4ff8-b306-07c74357534b service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:14.181744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3931da-203f-4ff8-b306-07c74357534b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:14.238330 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e18c3-1000-42e4-8b2f-211addc0cc11 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:14.245511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf297f-d706-41d7-aef0-eeab0d9419e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:14.246294 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf297f-d706-41d7-aef0-eeab0d9419e6 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:14.247350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf297f-d706-41d7-aef0-eeab0d9419e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:14.248336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf297f-d706-41d7-aef0-eeab0d9419e6 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:14.249138 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf297f-d706-41d7-aef0-eeab0d9419e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:14.251871 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf297f-d706-41d7-aef0-eeab0d9419e6 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:14.259755 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3931da-203f-4ff8-b306-07c74357534b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:14.262234 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3931da-203f-4ff8-b306-07c74357534b service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:14.277746 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1035/2078] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:49:14.280312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1044/2079] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:14 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:14.284293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3931da-203f-4ff8-b306-07c74357534b service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:14.299528 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf297f-d706-41d7-aef0-eeab0d9419e6 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:14.304308 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-daaf297f-d706-41d7-aef0-eeab0d9419e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:14.309212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3931da-203f-4ff8-b306-07c74357534b service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:14.316036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f57d9-4016-4e47-9136-48893be29bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:14.316736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f57d9-4016-4e47-9136-48893be29bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:14.317023 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f57d9-4016-4e47-9136-48893be29bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:14.317317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f57d9-4016-4e47-9136-48893be29bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:14.320870 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f57d9-4016-4e47-9136-48893be29bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:14.322837 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f57d9-4016-4e47-9136-48893be29bb7 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:14.334253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf297f-d706-41d7-aef0-eeab0d9419e6 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:14.336482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1036/2080] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:14.340545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f57d9-4016-4e47-9136-48893be29bb7 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:14.352542 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a09744-d10d-473e-8aac-5011b6ff3668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:14.353509 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a09744-d10d-473e-8aac-5011b6ff3668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:14.353795 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a09744-d10d-473e-8aac-5011b6ff3668 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:14.354105 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a09744-d10d-473e-8aac-5011b6ff3668 admin admin] PATH_INFO: `/v3/projects/bccfb5996fd34a9ca2e0178c5ba3eaf4` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:14.355674 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a09744-d10d-473e-8aac-5011b6ff3668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bccfb5996fd34a9ca2e0178c5ba3eaf4)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:14.357720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a09744-d10d-473e-8aac-5011b6ff3668 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:14.363493 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f57d9-4016-4e47-9136-48893be29bb7 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:14.369439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560cc95-bee1-4711-bb39-6c6dda7ca1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:14.370128 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560cc95-bee1-4711-bb39-6c6dda7ca1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:14.370415 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560cc95-bee1-4711-bb39-6c6dda7ca1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:14.370694 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560cc95-bee1-4711-bb39-6c6dda7ca1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:14.371463 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560cc95-bee1-4711-bb39-6c6dda7ca1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:14.373113 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560cc95-bee1-4711-bb39-6c6dda7ca1a8 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:14.386813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1037/2081] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:14.391456 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560cc95-bee1-4711-bb39-6c6dda7ca1a8 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:14.407903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560cc95-bee1-4711-bb39-6c6dda7ca1a8 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:14.416953 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82eb4f1-05ff-4c26-8c7f-da4bef1cbb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:14.418448 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82eb4f1-05ff-4c26-8c7f-da4bef1cbb71 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:14.418740 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82eb4f1-05ff-4c26-8c7f-da4bef1cbb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:14.419175 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82eb4f1-05ff-4c26-8c7f-da4bef1cbb71 admin admin] PATH_INFO: `/v3/projects/4a391878a24248a19d336148549a7e45/users/3b470dfe263943dbbb9e54fab846db7b/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:14.440384 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82eb4f1-05ff-4c26-8c7f-da4bef1cbb71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a391878a24248a19d336148549a7e45, user_id=3b470dfe263943dbbb9e54fab846db7b, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:14.443499 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82eb4f1-05ff-4c26-8c7f-da4bef1cbb71 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:14.451628 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-62a09744-d10d-473e-8aac-5011b6ff3668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bccfb5996fd34a9ca2e0178c5ba3eaf4', 'request_id': 'req-62a09744-d10d-473e-8aac-5011b6ff3668'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:14.461236 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-62a09744-d10d-473e-8aac-5011b6ff3668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bccfb5996fd34a9ca2e0178c5ba3eaf4', 'request_id': 'req-62a09744-d10d-473e-8aac-5011b6ff3668'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:14.470049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-62a09744-d10d-473e-8aac-5011b6ff3668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bccfb5996fd34a9ca2e0178c5ba3eaf4', 'request_id': 'req-62a09744-d10d-473e-8aac-5011b6ff3668'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:14.486174 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1038/2082] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:14 2022] PUT /identity/v3/projects/4a391878a24248a19d336148549a7e45/users/3b470dfe263943dbbb9e54fab846db7b/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:14.489433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-62a09744-d10d-473e-8aac-5011b6ff3668 admin admin] The token cache is being invalidate because project bccfb5996fd34a9ca2e0178c5ba3eaf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:14.489743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-62a09744-d10d-473e-8aac-5011b6ff3668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:14.490636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-62a09744-d10d-473e-8aac-5011b6ff3668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:14.491982 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0b1c3-8471-47d6-9a32-ac2ce4168894 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:14.492312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0b1c3-8471-47d6-9a32-ac2ce4168894 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:14.492619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0b1c3-8471-47d6-9a32-ac2ce4168894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:14.495605 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1045/2083] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:14 2022] DELETE /identity/v3/projects/bccfb5996fd34a9ca2e0178c5ba3eaf4 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:14.496665 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a09744-d10d-473e-8aac-5011b6ff3668 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:14.499022 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-62a09744-d10d-473e-8aac-5011b6ff3668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:14.533587 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-adf0b1c3-8471-47d6-9a32-ac2ce4168894 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:14.536059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-adf0b1c3-8471-47d6-9a32-ac2ce4168894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:14.620146 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:14.649469 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:14.656404 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a09744-d10d-473e-8aac-5011b6ff3668 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:14.713580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1039/2084] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:14.724538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0b1c3-8471-47d6-9a32-ac2ce4168894 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:14.734676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-adf0b1c3-8471-47d6-9a32-ac2ce4168894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:14.908435 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0b1c3-8471-47d6-9a32-ac2ce4168894 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:14.916516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7cbdd-cd72-4d06-9ef6-8efb0552c487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:14.919290 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d98fc-4eab-4f34-9bfa-10d8ada1e51a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:14.919290 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d98fc-4eab-4f34-9bfa-10d8ada1e51a service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:14.919290 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d98fc-4eab-4f34-9bfa-10d8ada1e51a service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:14.919290 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d98fc-4eab-4f34-9bfa-10d8ada1e51a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:14.920331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7cbdd-cd72-4d06-9ef6-8efb0552c487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:14.920772 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7cbdd-cd72-4d06-9ef6-8efb0552c487 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:14.921202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7cbdd-cd72-4d06-9ef6-8efb0552c487 admin admin] PATH_INFO: `/v3/users/2b374c79da2446abb409339a5ec18aac` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:14.923663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7cbdd-cd72-4d06-9ef6-8efb0552c487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b374c79da2446abb409339a5ec18aac)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:14.927458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e7cbdd-cd72-4d06-9ef6-8efb0552c487 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:14.946122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d98fc-4eab-4f34-9bfa-10d8ada1e51a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:14.948114 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d98fc-4eab-4f34-9bfa-10d8ada1e51a service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:14.964168 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1040/2085] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:49:15.047993 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-f8e7cbdd-cd72-4d06-9ef6-8efb0552c487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b374c79da2446abb409339a5ec18aac'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:15.059551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-f8e7cbdd-cd72-4d06-9ef6-8efb0552c487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b374c79da2446abb409339a5ec18aac'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:15.091246 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-f8e7cbdd-cd72-4d06-9ef6-8efb0552c487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b374c79da2446abb409339a5ec18aac'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:15.092020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-f8e7cbdd-cd72-4d06-9ef6-8efb0552c487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b374c79da2446abb409339a5ec18aac'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:15.103101 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-f8e7cbdd-cd72-4d06-9ef6-8efb0552c487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b374c79da2446abb409339a5ec18aac'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:15.116242 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1046/2086] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:14 2022] DELETE /identity/v3/users/2b374c79da2446abb409339a5ec18aac => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:15.723207 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d98fc-4eab-4f34-9bfa-10d8ada1e51a service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:15.740327 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d98fc-4eab-4f34-9bfa-10d8ada1e51a service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:15.838708 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44388cf-c82c-4b39-9b27-db04aa7f7777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:15.839950 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44388cf-c82c-4b39-9b27-db04aa7f7777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:15.840424 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44388cf-c82c-4b39-9b27-db04aa7f7777 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:15.840936 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44388cf-c82c-4b39-9b27-db04aa7f7777 admin admin] PATH_INFO: `/v3/projects/8306145b05d84d9c927fd0c14eaf37f0` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:15.842433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44388cf-c82c-4b39-9b27-db04aa7f7777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8306145b05d84d9c927fd0c14eaf37f0)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:15.844621 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44388cf-c82c-4b39-9b27-db04aa7f7777 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:15.916750 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-f44388cf-c82c-4b39-9b27-db04aa7f7777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8306145b05d84d9c927fd0c14eaf37f0', 'request_id': 'req-f44388cf-c82c-4b39-9b27-db04aa7f7777'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:15.923971 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-f44388cf-c82c-4b39-9b27-db04aa7f7777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8306145b05d84d9c927fd0c14eaf37f0', 'request_id': 'req-f44388cf-c82c-4b39-9b27-db04aa7f7777'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:15.936427 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-f44388cf-c82c-4b39-9b27-db04aa7f7777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8306145b05d84d9c927fd0c14eaf37f0', 'request_id': 'req-f44388cf-c82c-4b39-9b27-db04aa7f7777'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:15.968144 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-f44388cf-c82c-4b39-9b27-db04aa7f7777 admin admin] The token cache is being invalidate because project 8306145b05d84d9c927fd0c14eaf37f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:15.968608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-f44388cf-c82c-4b39-9b27-db04aa7f7777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:15.972074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-f44388cf-c82c-4b39-9b27-db04aa7f7777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:15.977669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1041/2087] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:15 2022] DELETE /identity/v3/projects/8306145b05d84d9c927fd0c14eaf37f0 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:15.986370 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dc53f-0dc5-4f0a-a988-a043dce0d6e3 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:15.987632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dc53f-0dc5-4f0a-a988-a043dce0d6e3 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:15.988310 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6dc53f-0dc5-4f0a-a988-a043dce0d6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:16.018873 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-0e6dc53f-0dc5-4f0a-a988-a043dce0d6e3 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:16.022702 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-0e6dc53f-0dc5-4f0a-a988-a043dce0d6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:16.077894 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab1415-c81e-4adb-8a44-246302252a30 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:16.078253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab1415-c81e-4adb-8a44-246302252a30 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:16.078606 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab1415-c81e-4adb-8a44-246302252a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:16.159776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-7aab1415-c81e-4adb-8a44-246302252a30 None None] MFA Rules not processed for user `3b470dfe263943dbbb9e54fab846db7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:16.161295 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7aab1415-c81e-4adb-8a44-246302252a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:16.204101 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:16.252625 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1047/2088] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:16.254990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0852ed0-3bf3-4437-80ac-883fb8a6eda0 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:16.255635 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0852ed0-3bf3-4437-80ac-883fb8a6eda0 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:16.256192 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0852ed0-3bf3-4437-80ac-883fb8a6eda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:16.286291 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-a0852ed0-3bf3-4437-80ac-883fb8a6eda0 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:16.288081 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-a0852ed0-3bf3-4437-80ac-883fb8a6eda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:16.298663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1048/2089] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:16.310212 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0852ed0-3bf3-4437-80ac-883fb8a6eda0 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:16.340228 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0852ed0-3bf3-4437-80ac-883fb8a6eda0 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:16.350384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435695c0-a076-4cc5-bf68-1abdfbaa7a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:16.351122 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435695c0-a076-4cc5-bf68-1abdfbaa7a19 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:16.351443 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435695c0-a076-4cc5-bf68-1abdfbaa7a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:16.351748 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435695c0-a076-4cc5-bf68-1abdfbaa7a19 admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:16.352911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435695c0-a076-4cc5-bf68-1abdfbaa7a19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:49:16.353683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435695c0-a076-4cc5-bf68-1abdfbaa7a19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:16.355601 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435695c0-a076-4cc5-bf68-1abdfbaa7a19 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:16.360613 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:16.390469 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1042/2090] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:49:16.394957 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab1415-c81e-4adb-8a44-246302252a30 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:16.401041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7aab1415-c81e-4adb-8a44-246302252a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:16.404582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1049/2091] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:49:16.406009 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435695c0-a076-4cc5-bf68-1abdfbaa7a19 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:16.422688 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab1415-c81e-4adb-8a44-246302252a30 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:16.423610 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435695c0-a076-4cc5-bf68-1abdfbaa7a19 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:16.427693 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63792e73-45f0-4c68-b590-f6986ce6a054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:16.428372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63792e73-45f0-4c68-b590-f6986ce6a054 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:16.428652 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63792e73-45f0-4c68-b590-f6986ce6a054 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:16.428931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63792e73-45f0-4c68-b590-f6986ce6a054 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:16.429509 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0666b7-a707-464d-999b-967913eaef37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:16.429631 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63792e73-45f0-4c68-b590-f6986ce6a054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:16.430405 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0666b7-a707-464d-999b-967913eaef37 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:16.430847 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0666b7-a707-464d-999b-967913eaef37 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:16.431131 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0666b7-a707-464d-999b-967913eaef37 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:16.432255 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63792e73-45f0-4c68-b590-f6986ce6a054 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:16.432368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0666b7-a707-464d-999b-967913eaef37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:16.434666 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0666b7-a707-464d-999b-967913eaef37 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:16.465772 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1043/2092] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:16 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:16.467384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1050/2093] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:16 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:49:16.471241 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0666b7-a707-464d-999b-967913eaef37 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:16.471433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63792e73-45f0-4c68-b590-f6986ce6a054 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:16.536351 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63792e73-45f0-4c68-b590-f6986ce6a054 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:16.541215 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0666b7-a707-464d-999b-967913eaef37 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:16.541925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b55f6-e536-4c73-a4e3-7e5c98c8ffc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:16.542715 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b55f6-e536-4c73-a4e3-7e5c98c8ffc7 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:16.543012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b55f6-e536-4c73-a4e3-7e5c98c8ffc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:16.543287 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b55f6-e536-4c73-a4e3-7e5c98c8ffc7 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:16.543993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b55f6-e536-4c73-a4e3-7e5c98c8ffc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:16.545968 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b55f6-e536-4c73-a4e3-7e5c98c8ffc7 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:16.549086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8d441-5240-4a0e-a697-2b89bfbb24d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:16.549761 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8d441-5240-4a0e-a697-2b89bfbb24d4 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:16.550042 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8d441-5240-4a0e-a697-2b89bfbb24d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:16.550319 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8d441-5240-4a0e-a697-2b89bfbb24d4 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:16.552111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8d441-5240-4a0e-a697-2b89bfbb24d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:16.553075 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8d441-5240-4a0e-a697-2b89bfbb24d4 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:16.575789 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1051/2094] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:16 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:16.577877 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1044/2095] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:16 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:16.580212 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8d441-5240-4a0e-a697-2b89bfbb24d4 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:16.581659 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b55f6-e536-4c73-a4e3-7e5c98c8ffc7 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:16.590891 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8d441-5240-4a0e-a697-2b89bfbb24d4 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:16.591283 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b55f6-e536-4c73-a4e3-7e5c98c8ffc7 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:16.595595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c722d-761e-4321-9b81-96e70c24fe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:16.596049 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70557756-065c-49b1-b388-0f4f601312c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:16.596259 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c722d-761e-4321-9b81-96e70c24fe54 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:16.596545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c722d-761e-4321-9b81-96e70c24fe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:16.596707 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70557756-065c-49b1-b388-0f4f601312c8 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:16.596803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c722d-761e-4321-9b81-96e70c24fe54 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:16.597057 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70557756-065c-49b1-b388-0f4f601312c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:16.597343 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70557756-065c-49b1-b388-0f4f601312c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:16.597623 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c722d-761e-4321-9b81-96e70c24fe54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:16.598097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70557756-065c-49b1-b388-0f4f601312c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:16.599423 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c722d-761e-4321-9b81-96e70c24fe54 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:16.599755 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70557756-065c-49b1-b388-0f4f601312c8 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:16.611821 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1045/2096] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:49:16.612247 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1052/2097] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:49:16.616298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70557756-065c-49b1-b388-0f4f601312c8 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:16.619570 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c722d-761e-4321-9b81-96e70c24fe54 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:16.628269 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70557756-065c-49b1-b388-0f4f601312c8 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:16.634392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534100d4-5d14-41d5-8a4a-da621cca10fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:16.635607 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534100d4-5d14-41d5-8a4a-da621cca10fe admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:16.635930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534100d4-5d14-41d5-8a4a-da621cca10fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:16.636215 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534100d4-5d14-41d5-8a4a-da621cca10fe admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:16.636845 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c722d-761e-4321-9b81-96e70c24fe54 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:16.637018 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534100d4-5d14-41d5-8a4a-da621cca10fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:16.639010 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534100d4-5d14-41d5-8a4a-da621cca10fe admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:16.646358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74089d88-c85e-4291-b3a6-b6e179d1fedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:16.648158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74089d88-c85e-4291-b3a6-b6e179d1fedf admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:16.649160 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74089d88-c85e-4291-b3a6-b6e179d1fedf admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:16.649462 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74089d88-c85e-4291-b3a6-b6e179d1fedf admin admin] PATH_INFO: `/v3/projects/4c689c0135fe426380d340c950720716/users/85d4c2cd5725477e933faf999d779d7d/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:16.655333 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1046/2098] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:49:16.659537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534100d4-5d14-41d5-8a4a-da621cca10fe admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:16.672304 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534100d4-5d14-41d5-8a4a-da621cca10fe admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:16.681388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fa24b8-435b-4d36-a103-e23d7a726d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:16.682869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa24b8-435b-4d36-a103-e23d7a726d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:16.683491 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa24b8-435b-4d36-a103-e23d7a726d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:16.683863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fa24b8-435b-4d36-a103-e23d7a726d4c admin admin] PATH_INFO: `/v3/projects/1d7ce4d860a54f86a41a2d9d3fdcc496/users/4d216c3d85f545fda11f320b159fa3f8/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:16.685516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74089d88-c85e-4291-b3a6-b6e179d1fedf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c689c0135fe426380d340c950720716, user_id=85d4c2cd5725477e933faf999d779d7d, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:16.689310 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74089d88-c85e-4291-b3a6-b6e179d1fedf admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:16.702341 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa24b8-435b-4d36-a103-e23d7a726d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7ce4d860a54f86a41a2d9d3fdcc496, user_id=4d216c3d85f545fda11f320b159fa3f8, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:16.705128 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fa24b8-435b-4d36-a103-e23d7a726d4c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:16.706645 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1053/2099] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:16 2022] PUT /identity/v3/projects/4c689c0135fe426380d340c950720716/users/85d4c2cd5725477e933faf999d779d7d/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:16.716214 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74089d88-c85e-4291-b3a6-b6e179d1fedf admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:16.737204 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1047/2100] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:16 2022] PUT /identity/v3/projects/1d7ce4d860a54f86a41a2d9d3fdcc496/users/4d216c3d85f545fda11f320b159fa3f8/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:16.739872 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed800bf-e3e7-44ad-a078-1d89d593e1a9 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:16.740015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed800bf-e3e7-44ad-a078-1d89d593e1a9 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:16.740344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed800bf-e3e7-44ad-a078-1d89d593e1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:16.773160 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-4ed800bf-e3e7-44ad-a078-1d89d593e1a9 None None] MFA Rules not processed for user `4d216c3d85f545fda11f320b159fa3f8`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:16.775146 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-4ed800bf-e3e7-44ad-a078-1d89d593e1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:16.807950 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:16.826807 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74089d88-c85e-4291-b3a6-b6e179d1fedf admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:16.865142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1048/2101] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:49:16.870261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed800bf-e3e7-44ad-a078-1d89d593e1a9 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:16.879718 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:16.908530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68700ea5-d682-4875-b873-a9492c66ebed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:16.909209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68700ea5-d682-4875-b873-a9492c66ebed admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:16.909497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68700ea5-d682-4875-b873-a9492c66ebed admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:16.909776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68700ea5-d682-4875-b873-a9492c66ebed admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:16.910779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68700ea5-d682-4875-b873-a9492c66ebed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:16.912437 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68700ea5-d682-4875-b873-a9492c66ebed admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:16.923468 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1054/2102] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:16.924315 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68700ea5-d682-4875-b873-a9492c66ebed admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:16.926072 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-68700ea5-d682-4875-b873-a9492c66ebed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:16.939709 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68700ea5-d682-4875-b873-a9492c66ebed admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:16.946474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83872a-4adc-4e66-9dbe-3a9286a61bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:16.947774 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83872a-4adc-4e66-9dbe-3a9286a61bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:16.948328 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83872a-4adc-4e66-9dbe-3a9286a61bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:16.948488 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83872a-4adc-4e66-9dbe-3a9286a61bf2 admin admin] PATH_INFO: `/v3/users/103f25dee0e14e9696303af59bb05d12` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:16.949745 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83872a-4adc-4e66-9dbe-3a9286a61bf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=103f25dee0e14e9696303af59bb05d12)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:16.951791 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83872a-4adc-4e66-9dbe-3a9286a61bf2 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:16.969619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed800bf-e3e7-44ad-a078-1d89d593e1a9 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:16.977528 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7af58-8a68-4cab-8c2a-1fd134ac1022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:16.978771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7af58-8a68-4cab-8c2a-1fd134ac1022 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:16.979066 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7af58-8a68-4cab-8c2a-1fd134ac1022 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:16.979618 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7af58-8a68-4cab-8c2a-1fd134ac1022 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:16.980800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7af58-8a68-4cab-8c2a-1fd134ac1022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:16.983894 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7af58-8a68-4cab-8c2a-1fd134ac1022 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:17.026468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1049/2103] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:16 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:49:17.028051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7af58-8a68-4cab-8c2a-1fd134ac1022 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:17.043917 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ac83872a-4adc-4e66-9dbe-3a9286a61bf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '103f25dee0e14e9696303af59bb05d12'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:17.057140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ac83872a-4adc-4e66-9dbe-3a9286a61bf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '103f25dee0e14e9696303af59bb05d12'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:17.072886 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ac83872a-4adc-4e66-9dbe-3a9286a61bf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '103f25dee0e14e9696303af59bb05d12'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:17.073459 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ac83872a-4adc-4e66-9dbe-3a9286a61bf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '103f25dee0e14e9696303af59bb05d12'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:17.081950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ac83872a-4adc-4e66-9dbe-3a9286a61bf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '103f25dee0e14e9696303af59bb05d12'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:17.090890 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1055/2104] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:16 2022] DELETE /identity/v3/users/103f25dee0e14e9696303af59bb05d12 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:17.091696 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83872a-4adc-4e66-9dbe-3a9286a61bf2 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:17.093104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-ac83872a-4adc-4e66-9dbe-3a9286a61bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:17.113376 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7af58-8a68-4cab-8c2a-1fd134ac1022 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:17.178019 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83872a-4adc-4e66-9dbe-3a9286a61bf2 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:17.184975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4b7ae-6465-47c8-8e19-3437bc17eed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:17.185759 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4b7ae-6465-47c8-8e19-3437bc17eed8 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:17.186050 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4b7ae-6465-47c8-8e19-3437bc17eed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:17.186330 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4b7ae-6465-47c8-8e19-3437bc17eed8 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:17.188193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4b7ae-6465-47c8-8e19-3437bc17eed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:17.191484 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4b7ae-6465-47c8-8e19-3437bc17eed8 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:17.199033 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7667a624-54a3-461e-a4db-7ccc0102c08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:17.200504 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667a624-54a3-461e-a4db-7ccc0102c08b admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:17.200811 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667a624-54a3-461e-a4db-7ccc0102c08b admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:17.201214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7667a624-54a3-461e-a4db-7ccc0102c08b admin admin] PATH_INFO: `/v3/projects/4c689c0135fe426380d340c950720716/users/85d4c2cd5725477e933faf999d779d7d/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:17.203937 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667a624-54a3-461e-a4db-7ccc0102c08b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c689c0135fe426380d340c950720716, user_id=85d4c2cd5725477e933faf999d779d7d, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:17.207637 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7667a624-54a3-461e-a4db-7ccc0102c08b admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:17.211197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:17.225309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1056/2106] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:17 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:17.225505 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1050/2106] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:17 2022] PUT /identity/v3/projects/4c689c0135fe426380d340c950720716/users/85d4c2cd5725477e933faf999d779d7d/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:17.227489 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4b7ae-6465-47c8-8e19-3437bc17eed8 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:17.227842 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957c27a-4e51-469f-9120-b094b6bf2786 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:17.228188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957c27a-4e51-469f-9120-b094b6bf2786 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:17.228471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957c27a-4e51-469f-9120-b094b6bf2786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:17.266928 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4b7ae-6465-47c8-8e19-3437bc17eed8 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:17.267401 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-5957c27a-4e51-469f-9120-b094b6bf2786 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:17.271214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-5957c27a-4e51-469f-9120-b094b6bf2786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:17.367889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:17.390648 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1051/2107] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:17.413529 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957c27a-4e51-469f-9120-b094b6bf2786 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:17.415519 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-5957c27a-4e51-469f-9120-b094b6bf2786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:17.429482 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4d9f2-23ca-45c6-8599-3d917477c84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:17.430804 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4d9f2-23ca-45c6-8599-3d917477c84c admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:17.431807 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4d9f2-23ca-45c6-8599-3d917477c84c admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:17.433138 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a4d9f2-23ca-45c6-8599-3d917477c84c admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:17.435574 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4d9f2-23ca-45c6-8599-3d917477c84c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:17.439840 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a4d9f2-23ca-45c6-8599-3d917477c84c admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:17.464680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1057/2108] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:17.474745 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4d9f2-23ca-45c6-8599-3d917477c84c admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:17.487363 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a4d9f2-23ca-45c6-8599-3d917477c84c admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:17.494643 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4308e-5707-486a-8541-95b37f9b10cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:17.495495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4308e-5707-486a-8541-95b37f9b10cb admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:17.495925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4308e-5707-486a-8541-95b37f9b10cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:17.496489 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4308e-5707-486a-8541-95b37f9b10cb admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:17.497669 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4308e-5707-486a-8541-95b37f9b10cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:17.499883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4308e-5707-486a-8541-95b37f9b10cb admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:17.519709 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1058/2109] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:17.521005 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4308e-5707-486a-8541-95b37f9b10cb admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:17.522199 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957c27a-4e51-469f-9120-b094b6bf2786 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:17.528019 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad80ae-95c7-46a8-be01-399ee0e0ccac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:17.529210 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad80ae-95c7-46a8-be01-399ee0e0ccac service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:17.529935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad80ae-95c7-46a8-be01-399ee0e0ccac service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:17.530416 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad80ae-95c7-46a8-be01-399ee0e0ccac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:17.544743 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad80ae-95c7-46a8-be01-399ee0e0ccac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:17.546378 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad80ae-95c7-46a8-be01-399ee0e0ccac service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:17.550370 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4308e-5707-486a-8541-95b37f9b10cb admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:17.560969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1052/2110] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:17.561171 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46261d5-a253-4d9f-bf30-62f3ee34b9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:17.562357 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46261d5-a253-4d9f-bf30-62f3ee34b9d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:17.562357 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46261d5-a253-4d9f-bf30-62f3ee34b9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:17.562536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46261d5-a253-4d9f-bf30-62f3ee34b9d3 admin admin] PATH_INFO: `/v3/projects/ec48e02429a743f88e05650a3acd6700/users/5dc3b0061e71416a8264f9a560ce3e5c/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:17.596310 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46261d5-a253-4d9f-bf30-62f3ee34b9d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec48e02429a743f88e05650a3acd6700, user_id=5dc3b0061e71416a8264f9a560ce3e5c, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:17.599021 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46261d5-a253-4d9f-bf30-62f3ee34b9d3 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:17.626360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1059/2111] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:17 2022] PUT /identity/v3/projects/ec48e02429a743f88e05650a3acd6700/users/5dc3b0061e71416a8264f9a560ce3e5c/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:17.637273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb064a-6bc7-4a2c-bec7-a1e32a4af954 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:17.637630 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb064a-6bc7-4a2c-bec7-a1e32a4af954 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:17.637913 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb064a-6bc7-4a2c-bec7-a1e32a4af954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:17.688399 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-cabb064a-6bc7-4a2c-bec7-a1e32a4af954 None None] MFA Rules not processed for user `5dc3b0061e71416a8264f9a560ce3e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:17.689546 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-cabb064a-6bc7-4a2c-bec7-a1e32a4af954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:17.825815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1053/2112] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:17.830821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46261d5-a253-4d9f-bf30-62f3ee34b9d3 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:17.963028 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46261d5-a253-4d9f-bf30-62f3ee34b9d3 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:17.987582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f034a2-0ea1-4068-abff-a519948fc125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:17.988925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f034a2-0ea1-4068-abff-a519948fc125 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:17.989802 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f034a2-0ea1-4068-abff-a519948fc125 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:17.990596 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f034a2-0ea1-4068-abff-a519948fc125 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:17.993317 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f034a2-0ea1-4068-abff-a519948fc125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:17.997075 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f034a2-0ea1-4068-abff-a519948fc125 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:18.046355 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1060/2113] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:17 2022] POST /identity/v3/projects => generated 377 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:18.051389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb064a-6bc7-4a2c-bec7-a1e32a4af954 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:18.072083 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb064a-6bc7-4a2c-bec7-a1e32a4af954 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:18.131149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:18.197513 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95378f-b9ca-467d-817c-1adc2df3f210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:18.199252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95378f-b9ca-467d-817c-1adc2df3f210 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:18.200052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95378f-b9ca-467d-817c-1adc2df3f210 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:18.200536 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95378f-b9ca-467d-817c-1adc2df3f210 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:18.201829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95378f-b9ca-467d-817c-1adc2df3f210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:18.204409 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95378f-b9ca-467d-817c-1adc2df3f210 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:18.245527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1054/2114] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:18 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:18.249969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f034a2-0ea1-4068-abff-a519948fc125 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:18.264023 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f034a2-0ea1-4068-abff-a519948fc125 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:18.291714 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4072988-3b99-4128-986a-538171b384a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:18.292422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4072988-3b99-4128-986a-538171b384a4 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:18.292713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4072988-3b99-4128-986a-538171b384a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:18.292997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4072988-3b99-4128-986a-538171b384a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:18.293816 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4072988-3b99-4128-986a-538171b384a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:18.296087 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4072988-3b99-4128-986a-538171b384a4 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:18.325032 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1061/2115] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:18.325729 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95378f-b9ca-467d-817c-1adc2df3f210 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:18.338469 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95378f-b9ca-467d-817c-1adc2df3f210 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:18.350707 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74c475-847e-4b9f-9e3b-7ae068b7a458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:18.360683 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74c475-847e-4b9f-9e3b-7ae068b7a458 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:18.360683 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74c475-847e-4b9f-9e3b-7ae068b7a458 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:18.360683 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74c475-847e-4b9f-9e3b-7ae068b7a458 admin admin] PATH_INFO: `/v3/projects/1389fa51bc164cc48a4cc0bedde83dbb/users/a98109cc39144c2880cd47f0de74c7dd/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:18.400625 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74c475-847e-4b9f-9e3b-7ae068b7a458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1389fa51bc164cc48a4cc0bedde83dbb, user_id=a98109cc39144c2880cd47f0de74c7dd, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:18.405710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed74c475-847e-4b9f-9e3b-7ae068b7a458 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:18.435748 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1055/2116] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:18 2022] PUT /identity/v3/projects/1389fa51bc164cc48a4cc0bedde83dbb/users/a98109cc39144c2880cd47f0de74c7dd/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:18.440772 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4072988-3b99-4128-986a-538171b384a4 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:18.466161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4072988-3b99-4128-986a-538171b384a4 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:18.480902 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74c475-847e-4b9f-9e3b-7ae068b7a458 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:18.483387 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ed74c475-847e-4b9f-9e3b-7ae068b7a458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:18.588619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74c475-847e-4b9f-9e3b-7ae068b7a458 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:18.605401 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921af5e-47cd-4dec-a29d-ed0059e314ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:18.605857 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921af5e-47cd-4dec-a29d-ed0059e314ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:18.606173 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921af5e-47cd-4dec-a29d-ed0059e314ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:18.606495 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921af5e-47cd-4dec-a29d-ed0059e314ce admin admin] PATH_INFO: `/v3/projects/323405c544e04d6c8715a12fbae4508c` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:18.607314 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78604892-6904-4f71-aa07-3fabcc4f31c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:18.607995 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921af5e-47cd-4dec-a29d-ed0059e314ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=323405c544e04d6c8715a12fbae4508c)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:18.608582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78604892-6904-4f71-aa07-3fabcc4f31c2 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:18.609304 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78604892-6904-4f71-aa07-3fabcc4f31c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:18.609783 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78604892-6904-4f71-aa07-3fabcc4f31c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:18.610850 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921af5e-47cd-4dec-a29d-ed0059e314ce admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:18.611841 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78604892-6904-4f71-aa07-3fabcc4f31c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:18.614545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78604892-6904-4f71-aa07-3fabcc4f31c2 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:18.668615 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1062/2117] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:18.670435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f22ea-671d-42ca-90b7-08d4aaaaa3de None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:18.671745 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f22ea-671d-42ca-90b7-08d4aaaaa3de None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:18.672253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f22ea-671d-42ca-90b7-08d4aaaaa3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:18.689226 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:18.693176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-4921af5e-47cd-4dec-a29d-ed0059e314ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '323405c544e04d6c8715a12fbae4508c', 'request_id': 'req-4921af5e-47cd-4dec-a29d-ed0059e314ce'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:18.705759 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-4921af5e-47cd-4dec-a29d-ed0059e314ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '323405c544e04d6c8715a12fbae4508c', 'request_id': 'req-4921af5e-47cd-4dec-a29d-ed0059e314ce'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:18.723665 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-4921af5e-47cd-4dec-a29d-ed0059e314ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '323405c544e04d6c8715a12fbae4508c', 'request_id': 'req-4921af5e-47cd-4dec-a29d-ed0059e314ce'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:18.726053 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-9e8f22ea-671d-42ca-90b7-08d4aaaaa3de None None] MFA Rules not processed for user `85d4c2cd5725477e933faf999d779d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:18.727898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9e8f22ea-671d-42ca-90b7-08d4aaaaa3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:18.755391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-4921af5e-47cd-4dec-a29d-ed0059e314ce admin admin] The token cache is being invalidate because project 323405c544e04d6c8715a12fbae4508c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:18.756547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-4921af5e-47cd-4dec-a29d-ed0059e314ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:18.757289 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-4921af5e-47cd-4dec-a29d-ed0059e314ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:18.762383 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1056/2118] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:18 2022] DELETE /identity/v3/projects/323405c544e04d6c8715a12fbae4508c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:18.762383 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921af5e-47cd-4dec-a29d-ed0059e314ce admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:18.762383 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-4921af5e-47cd-4dec-a29d-ed0059e314ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:18.815455 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:18.883604 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1063/2119] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:18.886532 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f22ea-671d-42ca-90b7-08d4aaaaa3de None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:18.892089 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9e8f22ea-671d-42ca-90b7-08d4aaaaa3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:18.910747 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921af5e-47cd-4dec-a29d-ed0059e314ce admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:18.917279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d298658-5ac0-4d8b-a0e5-390d51347572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:18.918467 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d298658-5ac0-4d8b-a0e5-390d51347572 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:18.918873 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d298658-5ac0-4d8b-a0e5-390d51347572 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:18.919275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d298658-5ac0-4d8b-a0e5-390d51347572 admin admin] PATH_INFO: `/v3/projects/1389fa51bc164cc48a4cc0bedde83dbb/users/a98109cc39144c2880cd47f0de74c7dd/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:18.921914 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d298658-5ac0-4d8b-a0e5-390d51347572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1389fa51bc164cc48a4cc0bedde83dbb, user_id=a98109cc39144c2880cd47f0de74c7dd, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:18.924975 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d298658-5ac0-4d8b-a0e5-390d51347572 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:18.936506 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f22ea-671d-42ca-90b7-08d4aaaaa3de None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:18.947318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1057/2120] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:18 2022] PUT /identity/v3/projects/1389fa51bc164cc48a4cc0bedde83dbb/users/a98109cc39144c2880cd47f0de74c7dd/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:18.947318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe4a77-fae4-42c1-b131-9459a46371e9 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:18.947318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe4a77-fae4-42c1-b131-9459a46371e9 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:18.947318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe4a77-fae4-42c1-b131-9459a46371e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:18.978351 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-3ebe4a77-fae4-42c1-b131-9459a46371e9 None None] MFA Rules not processed for user `3b470dfe263943dbbb9e54fab846db7b`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:18.979737 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3ebe4a77-fae4-42c1-b131-9459a46371e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:19.101741 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2ab64-ea25-434e-901f-e2639aab37f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:19.103331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2ab64-ea25-434e-901f-e2639aab37f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:19.103689 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2ab64-ea25-434e-901f-e2639aab37f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:19.104077 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2ab64-ea25-434e-901f-e2639aab37f8 admin admin] PATH_INFO: `/v3/users/abcb76bfd40a4343a5fa245b1f079274` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:19.105753 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2ab64-ea25-434e-901f-e2639aab37f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abcb76bfd40a4343a5fa245b1f079274)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:19.107863 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2ab64-ea25-434e-901f-e2639aab37f8 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:19.191421 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1058/2121] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:19.192837 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4bc27-4111-4a76-aa8e-ace131ab0a2f None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:19.193131 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4bc27-4111-4a76-aa8e-ace131ab0a2f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:19.193411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4bc27-4111-4a76-aa8e-ace131ab0a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:19.239985 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b4d2ab64-ea25-434e-901f-e2639aab37f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abcb76bfd40a4343a5fa245b1f079274'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:19.250413 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b4d2ab64-ea25-434e-901f-e2639aab37f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abcb76bfd40a4343a5fa245b1f079274'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:19.268533 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b4d2ab64-ea25-434e-901f-e2639aab37f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abcb76bfd40a4343a5fa245b1f079274'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:19.269483 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b4d2ab64-ea25-434e-901f-e2639aab37f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abcb76bfd40a4343a5fa245b1f079274'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:19.272386 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-d7a4bc27-4111-4a76-aa8e-ace131ab0a2f None None] MFA Rules not processed for user `a98109cc39144c2880cd47f0de74c7dd`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:19.275942 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d7a4bc27-4111-4a76-aa8e-ace131ab0a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:19.278094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b4d2ab64-ea25-434e-901f-e2639aab37f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abcb76bfd40a4343a5fa245b1f079274'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:19.290855 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1064/2122] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:18 2022] DELETE /identity/v3/users/abcb76bfd40a4343a5fa245b1f079274 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:19.290855 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2ab64-ea25-434e-901f-e2639aab37f8 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:19.290855 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b4d2ab64-ea25-434e-901f-e2639aab37f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:19.305892 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:19.408224 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1059/2123] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:19.419112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2ab64-ea25-434e-901f-e2639aab37f8 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:19.430043 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bea2c-9e27-4553-b64f-743d73968a9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:19.430788 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bea2c-9e27-4553-b64f-743d73968a9a service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:19.431149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bea2c-9e27-4553-b64f-743d73968a9a service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:19.431542 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bea2c-9e27-4553-b64f-743d73968a9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:19.433513 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-fb8bea2c-9e27-4553-b64f-743d73968a9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:19.447896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4bc27-4111-4a76-aa8e-ace131ab0a2f None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:19.449768 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d7a4bc27-4111-4a76-aa8e-ace131ab0a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:19.530660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bea2c-9e27-4553-b64f-743d73968a9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:19.531028 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:19.533546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bea2c-9e27-4553-b64f-743d73968a9a service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:19.543671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4bc27-4111-4a76-aa8e-ace131ab0a2f None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:19.553987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1065/2124] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:19.652023 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbd031-c686-4c6c-9afb-bcaddd272d9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:19.653089 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbd031-c686-4c6c-9afb-bcaddd272d9d service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:19.655587 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbd031-c686-4c6c-9afb-bcaddd272d9d service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:19.656821 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbbd031-c686-4c6c-9afb-bcaddd272d9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:19.735589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bea2c-9e27-4553-b64f-743d73968a9a service nova] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:19.737157 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-fb8bea2c-9e27-4553-b64f-743d73968a9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:19.752392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbd031-c686-4c6c-9afb-bcaddd272d9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:19.754217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbbd031-c686-4c6c-9afb-bcaddd272d9d service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:19.774744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1060/2125] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:49:19.827173 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbd031-c686-4c6c-9afb-bcaddd272d9d service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:19.828861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-9cbbd031-c686-4c6c-9afb-bcaddd272d9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:19.853794 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bea2c-9e27-4553-b64f-743d73968a9a service nova] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:19.856658 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbbd031-c686-4c6c-9afb-bcaddd272d9d service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:19.858839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882a67a-1e14-4926-a922-899fbfeaab39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:19.859973 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882a67a-1e14-4926-a922-899fbfeaab39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:19.860337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882a67a-1e14-4926-a922-899fbfeaab39 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:19.860691 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff6e67-a001-47e5-b565-29bf90faf4cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:19.860818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882a67a-1e14-4926-a922-899fbfeaab39 admin admin] PATH_INFO: `/v3/projects/b084823b59db47038f579cf7ec0c21d0` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:19.861404 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff6e67-a001-47e5-b565-29bf90faf4cb service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:19.861621 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff6e67-a001-47e5-b565-29bf90faf4cb service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:19.861897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff6e67-a001-47e5-b565-29bf90faf4cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:19.862277 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a882a67a-1e14-4926-a922-899fbfeaab39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b084823b59db47038f579cf7ec0c21d0)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:19.863781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ceff6e67-a001-47e5-b565-29bf90faf4cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:19.864390 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a882a67a-1e14-4926-a922-899fbfeaab39 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:19.967935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff6e67-a001-47e5-b565-29bf90faf4cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:19.969564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:19.969700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff6e67-a001-47e5-b565-29bf90faf4cb service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:19.971601 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a882a67a-1e14-4926-a922-899fbfeaab39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b084823b59db47038f579cf7ec0c21d0', 'request_id': 'req-a882a67a-1e14-4926-a922-899fbfeaab39'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:19.983302 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a882a67a-1e14-4926-a922-899fbfeaab39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b084823b59db47038f579cf7ec0c21d0', 'request_id': 'req-a882a67a-1e14-4926-a922-899fbfeaab39'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:19.984122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1061/2126] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:49:19.994099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a882a67a-1e14-4926-a922-899fbfeaab39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b084823b59db47038f579cf7ec0c21d0', 'request_id': 'req-a882a67a-1e14-4926-a922-899fbfeaab39'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:20.013472 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a882a67a-1e14-4926-a922-899fbfeaab39 admin admin] The token cache is being invalidate because project b084823b59db47038f579cf7ec0c21d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:20.014009 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a882a67a-1e14-4926-a922-899fbfeaab39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:20.015070 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a882a67a-1e14-4926-a922-899fbfeaab39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:20.016989 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1066/2127] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:19 2022] DELETE /identity/v3/projects/b084823b59db47038f579cf7ec0c21d0 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:20.022261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34dc56d-7fe9-4b1e-a2d4-11c3d69b961a None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:20.022731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34dc56d-7fe9-4b1e-a2d4-11c3d69b961a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:20.023118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34dc56d-7fe9-4b1e-a2d4-11c3d69b961a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:20.065584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-b34dc56d-7fe9-4b1e-a2d4-11c3d69b961a None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:20.066935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b34dc56d-7fe9-4b1e-a2d4-11c3d69b961a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:20.154702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:20.179798 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1062/2128] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:20.189706 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90f1b4-3cb3-4a8c-8d1a-36d3e2805ab1 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:20.190327 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90f1b4-3cb3-4a8c-8d1a-36d3e2805ab1 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:20.190327 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90f1b4-3cb3-4a8c-8d1a-36d3e2805ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:20.217505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-8f90f1b4-3cb3-4a8c-8d1a-36d3e2805ab1 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:20.218865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-8f90f1b4-3cb3-4a8c-8d1a-36d3e2805ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:20.234238 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1067/2129] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:20.239145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34dc56d-7fe9-4b1e-a2d4-11c3d69b961a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:20.255556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34dc56d-7fe9-4b1e-a2d4-11c3d69b961a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:20.263967 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65883eb-4c67-4957-af17-7bbb64b2fc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:20.264944 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65883eb-4c67-4957-af17-7bbb64b2fc99 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:20.265848 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65883eb-4c67-4957-af17-7bbb64b2fc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:20.267038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65883eb-4c67-4957-af17-7bbb64b2fc99 admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:20.267929 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65883eb-4c67-4957-af17-7bbb64b2fc99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:49:20.268303 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65883eb-4c67-4957-af17-7bbb64b2fc99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:20.270204 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65883eb-4c67-4957-af17-7bbb64b2fc99 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:20.285265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1063/2130] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:49:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:49:20.290997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90f1b4-3cb3-4a8c-8d1a-36d3e2805ab1 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:20.301488 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90f1b4-3cb3-4a8c-8d1a-36d3e2805ab1 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:20.315982 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7e295-d698-4d38-826a-ef8253744515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:20.317571 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7e295-d698-4d38-826a-ef8253744515 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:20.318152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7e295-d698-4d38-826a-ef8253744515 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:20.318614 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7e295-d698-4d38-826a-ef8253744515 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:20.319564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7e295-d698-4d38-826a-ef8253744515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:20.321715 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a7e295-d698-4d38-826a-ef8253744515 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:20.360925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1068/2131] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:20 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:20.364989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65883eb-4c67-4957-af17-7bbb64b2fc99 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:20.387283 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65883eb-4c67-4957-af17-7bbb64b2fc99 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:20.545425 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f432df-d924-4904-ab9a-6ce939eaa6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:20.546691 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f432df-d924-4904-ab9a-6ce939eaa6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:20.546691 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f432df-d924-4904-ab9a-6ce939eaa6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:20.547299 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f432df-d924-4904-ab9a-6ce939eaa6d5 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:20.548147 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f432df-d924-4904-ab9a-6ce939eaa6d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:20.553483 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f432df-d924-4904-ab9a-6ce939eaa6d5 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:20.607176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1064/2132] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:20 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:49:20.611789 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7e295-d698-4d38-826a-ef8253744515 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:20.629465 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7e295-d698-4d38-826a-ef8253744515 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:20.643994 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed77fe1-c387-4202-a696-57bb94ad2903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:20.646764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed77fe1-c387-4202-a696-57bb94ad2903 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:20.647177 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed77fe1-c387-4202-a696-57bb94ad2903 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:20.649729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed77fe1-c387-4202-a696-57bb94ad2903 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:20.652856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed77fe1-c387-4202-a696-57bb94ad2903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:20.656216 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed77fe1-c387-4202-a696-57bb94ad2903 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:20.689860 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1069/2133] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:20.693083 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f432df-d924-4904-ab9a-6ce939eaa6d5 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:20.719235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f432df-d924-4904-ab9a-6ce939eaa6d5 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:20.734801 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984903a-922c-42f5-8fa6-3570ec7387da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:20.735536 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984903a-922c-42f5-8fa6-3570ec7387da admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:20.735958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984903a-922c-42f5-8fa6-3570ec7387da admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:20.736273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984903a-922c-42f5-8fa6-3570ec7387da admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:20.737107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984903a-922c-42f5-8fa6-3570ec7387da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:20.738712 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984903a-922c-42f5-8fa6-3570ec7387da admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:20.756079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1065/2134] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:20.759998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed77fe1-c387-4202-a696-57bb94ad2903 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:20.773059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed77fe1-c387-4202-a696-57bb94ad2903 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:20.778379 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b9612-0f28-44a2-bb54-ec7f365c50a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:20.779548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b9612-0f28-44a2-bb54-ec7f365c50a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:20.779839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b9612-0f28-44a2-bb54-ec7f365c50a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:20.780160 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b9612-0f28-44a2-bb54-ec7f365c50a2 admin admin] PATH_INFO: `/v3/projects/e1e6216bf5534d4c800b3289efb35083/users/00fb4f668072427cb2a61c504b744e74/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:20.801494 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b9612-0f28-44a2-bb54-ec7f365c50a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e6216bf5534d4c800b3289efb35083, user_id=00fb4f668072427cb2a61c504b744e74, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:20.804877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b9612-0f28-44a2-bb54-ec7f365c50a2 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:20.832315 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1070/2135] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:20 2022] PUT /identity/v3/projects/e1e6216bf5534d4c800b3289efb35083/users/00fb4f668072427cb2a61c504b744e74/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:20.845695 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e742e4f-76d5-4cc9-8fc6-a522c3d0f3b7 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:20.845949 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e742e4f-76d5-4cc9-8fc6-a522c3d0f3b7 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:20.846235 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e742e4f-76d5-4cc9-8fc6-a522c3d0f3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:20.874493 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b9612-0f28-44a2-bb54-ec7f365c50a2 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:20.877134 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-eb6b9612-0f28-44a2-bb54-ec7f365c50a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:20.919985 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-7e742e4f-76d5-4cc9-8fc6-a522c3d0f3b7 None None] MFA Rules not processed for user `00fb4f668072427cb2a61c504b744e74`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:20.921164 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7e742e4f-76d5-4cc9-8fc6-a522c3d0f3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:21.026954 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1066/2136] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:21.027643 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b9612-0f28-44a2-bb54-ec7f365c50a2 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:21.033545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd75364-a1ef-487a-acd7-0a5c36c1bb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:21.034145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd75364-a1ef-487a-acd7-0a5c36c1bb0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:21.034504 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd75364-a1ef-487a-acd7-0a5c36c1bb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:21.034777 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd75364-a1ef-487a-acd7-0a5c36c1bb0b admin admin] PATH_INFO: `/v3/users/b065a24205364587952811c3802dbb44` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:21.036403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd75364-a1ef-487a-acd7-0a5c36c1bb0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b065a24205364587952811c3802dbb44)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:21.038752 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd75364-a1ef-487a-acd7-0a5c36c1bb0b admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:21.040275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e742e4f-76d5-4cc9-8fc6-a522c3d0f3b7 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:21.051890 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e742e4f-76d5-4cc9-8fc6-a522c3d0f3b7 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:21.058417 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43712c1a-9380-403b-9aeb-4db2bde635b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:21.059092 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43712c1a-9380-403b-9aeb-4db2bde635b3 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:21.059523 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43712c1a-9380-403b-9aeb-4db2bde635b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:21.059808 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43712c1a-9380-403b-9aeb-4db2bde635b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:21.060505 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43712c1a-9380-403b-9aeb-4db2bde635b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:21.062581 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43712c1a-9380-403b-9aeb-4db2bde635b3 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:21.092572 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-4cd75364-a1ef-487a-acd7-0a5c36c1bb0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b065a24205364587952811c3802dbb44'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:21.093588 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1067/2137] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:21 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:21.098520 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43712c1a-9380-403b-9aeb-4db2bde635b3 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:21.103306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-4cd75364-a1ef-487a-acd7-0a5c36c1bb0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b065a24205364587952811c3802dbb44'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:21.122642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-4cd75364-a1ef-487a-acd7-0a5c36c1bb0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b065a24205364587952811c3802dbb44'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:21.123639 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-4cd75364-a1ef-487a-acd7-0a5c36c1bb0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b065a24205364587952811c3802dbb44'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:21.126323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=83,keystone:INSERT=4,keystone:DELETE=13 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:21.132435 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:21.138734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-4cd75364-a1ef-487a-acd7-0a5c36c1bb0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b065a24205364587952811c3802dbb44'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:21.148855 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1071/2138] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:20 2022] DELETE /identity/v3/users/b065a24205364587952811c3802dbb44 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:21.154532 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4a166-f0cb-4a1e-abaa-b93d1242808a None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:21.155054 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4a166-f0cb-4a1e-abaa-b93d1242808a None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:21.155702 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4a166-f0cb-4a1e-abaa-b93d1242808a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:21.186958 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-a9b4a166-f0cb-4a1e-abaa-b93d1242808a None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:21.188336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-a9b4a166-f0cb-4a1e-abaa-b93d1242808a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:21.214571 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43712c1a-9380-403b-9aeb-4db2bde635b3 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:21.271509 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1072/2139] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:49:21.282910 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4a166-f0cb-4a1e-abaa-b93d1242808a None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:21.284608 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-a9b4a166-f0cb-4a1e-abaa-b93d1242808a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:21.303434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a90ad-15ef-45d6-9e31-62de04a8afc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:21.304185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a90ad-15ef-45d6-9e31-62de04a8afc1 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:21.304500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a90ad-15ef-45d6-9e31-62de04a8afc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:21.304813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a90ad-15ef-45d6-9e31-62de04a8afc1 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:21.306159 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a90ad-15ef-45d6-9e31-62de04a8afc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:21.309183 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a90ad-15ef-45d6-9e31-62de04a8afc1 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:21.341658 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1068/2140] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:21 2022] POST /identity/v3/users => generated 299 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:21.345708 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a90ad-15ef-45d6-9e31-62de04a8afc1 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:21.349524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c16a90ad-15ef-45d6-9e31-62de04a8afc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:21.369914 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a90ad-15ef-45d6-9e31-62de04a8afc1 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:21.376610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58fd14-249a-42f6-b5c1-a76e969ea3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:21.377313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58fd14-249a-42f6-b5c1-a76e969ea3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:21.377604 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58fd14-249a-42f6-b5c1-a76e969ea3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:21.378491 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58fd14-249a-42f6-b5c1-a76e969ea3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:21.379485 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58fd14-249a-42f6-b5c1-a76e969ea3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:21.381534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58fd14-249a-42f6-b5c1-a76e969ea3d1 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:21.393084 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4a166-f0cb-4a1e-abaa-b93d1242808a None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:21.398135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb8fab-e5e9-45f7-a5a1-62b625eb7668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:21.399415 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb8fab-e5e9-45f7-a5a1-62b625eb7668 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:21.399705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb8fab-e5e9-45f7-a5a1-62b625eb7668 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:21.399984 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb8fab-e5e9-45f7-a5a1-62b625eb7668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:21.404011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1069/2141] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:49:21.405269 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58fd14-249a-42f6-b5c1-a76e969ea3d1 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:21.416847 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb8fab-e5e9-45f7-a5a1-62b625eb7668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:21.418014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58fd14-249a-42f6-b5c1-a76e969ea3d1 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:21.418312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb8fab-e5e9-45f7-a5a1-62b625eb7668 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:21.423454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791057ea-d6f5-4a4e-bd08-50a870f821ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:21.431307 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1073/2142] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:49:21.431466 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791057ea-d6f5-4a4e-bd08-50a870f821ef admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:21.431771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791057ea-d6f5-4a4e-bd08-50a870f821ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:21.432066 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791057ea-d6f5-4a4e-bd08-50a870f821ef admin admin] PATH_INFO: `/v3/projects/daa6aef1086d4dc6bdf2fe4d47bb2276/users/50d57fe67ecf4b7d8201509da492afb4/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:21.452014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791057ea-d6f5-4a4e-bd08-50a870f821ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa6aef1086d4dc6bdf2fe4d47bb2276, user_id=50d57fe67ecf4b7d8201509da492afb4, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:21.463380 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791057ea-d6f5-4a4e-bd08-50a870f821ef admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:21.489723 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1070/2143] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:21 2022] PUT /identity/v3/projects/daa6aef1086d4dc6bdf2fe4d47bb2276/users/50d57fe67ecf4b7d8201509da492afb4/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:21.493410 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb8fab-e5e9-45f7-a5a1-62b625eb7668 service neutron] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:21.509539 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb8fab-e5e9-45f7-a5a1-62b625eb7668 service neutron] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:21.597915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264dd12-3652-401c-bfce-3d7f760f197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:21.598680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264dd12-3652-401c-bfce-3d7f760f197b admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:21.600389 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264dd12-3652-401c-bfce-3d7f760f197b admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:21.600695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264dd12-3652-401c-bfce-3d7f760f197b admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:21.602743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264dd12-3652-401c-bfce-3d7f760f197b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:21.604639 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264dd12-3652-401c-bfce-3d7f760f197b admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:21.623344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1074/2144] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:21.629848 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791057ea-d6f5-4a4e-bd08-50a870f821ef admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:21.661556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791057ea-d6f5-4a4e-bd08-50a870f821ef admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:21.681942 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecde65e-2ff0-492a-9c4f-c224b8d0304d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:21.683119 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecde65e-2ff0-492a-9c4f-c224b8d0304d admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:21.684070 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecde65e-2ff0-492a-9c4f-c224b8d0304d admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:21.684367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecde65e-2ff0-492a-9c4f-c224b8d0304d admin admin] PATH_INFO: `/v3/projects/daa6aef1086d4dc6bdf2fe4d47bb2276/users/50d57fe67ecf4b7d8201509da492afb4/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:21.686721 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecde65e-2ff0-492a-9c4f-c224b8d0304d admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa6aef1086d4dc6bdf2fe4d47bb2276, user_id=50d57fe67ecf4b7d8201509da492afb4, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:21.690151 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecde65e-2ff0-492a-9c4f-c224b8d0304d admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:21.718360 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1071/2145] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:21 2022] PUT /identity/v3/projects/daa6aef1086d4dc6bdf2fe4d47bb2276/users/50d57fe67ecf4b7d8201509da492afb4/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:21.729577 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205e4e7-d222-44e3-93db-3be227f15744 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:21.730112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205e4e7-d222-44e3-93db-3be227f15744 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:21.730527 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205e4e7-d222-44e3-93db-3be227f15744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:21.767524 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-0205e4e7-d222-44e3-93db-3be227f15744 None None] MFA Rules not processed for user `50d57fe67ecf4b7d8201509da492afb4`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:21.768957 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-0205e4e7-d222-44e3-93db-3be227f15744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:21.794429 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:21.796745 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecde65e-2ff0-492a-9c4f-c224b8d0304d admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:21.798578 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-eecde65e-2ff0-492a-9c4f-c224b8d0304d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:21.888418 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1075/2146] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:21.901446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205e4e7-d222-44e3-93db-3be227f15744 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:21.906146 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-0205e4e7-d222-44e3-93db-3be227f15744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:21.909624 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecde65e-2ff0-492a-9c4f-c224b8d0304d admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:21.915923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895b968-b676-4224-bfd8-ef7fec948fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:21.916816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895b968-b676-4224-bfd8-ef7fec948fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:21.917102 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895b968-b676-4224-bfd8-ef7fec948fec admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:21.917384 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895b968-b676-4224-bfd8-ef7fec948fec admin admin] PATH_INFO: `/v3/projects/66158a0525d5467c8d175c5f77bace03` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:21.918922 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895b968-b676-4224-bfd8-ef7fec948fec admin admin] RBAC: Authorizing `identity:delete_project(project_id=66158a0525d5467c8d175c5f77bace03)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:21.921168 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895b968-b676-4224-bfd8-ef7fec948fec admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:21.942420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:22.006660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-6895b968-b676-4224-bfd8-ef7fec948fec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66158a0525d5467c8d175c5f77bace03', 'request_id': 'req-6895b968-b676-4224-bfd8-ef7fec948fec'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:22.012722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205e4e7-d222-44e3-93db-3be227f15744 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:22.013762 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-6895b968-b676-4224-bfd8-ef7fec948fec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66158a0525d5467c8d175c5f77bace03', 'request_id': 'req-6895b968-b676-4224-bfd8-ef7fec948fec'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:22.026152 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-6895b968-b676-4224-bfd8-ef7fec948fec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66158a0525d5467c8d175c5f77bace03', 'request_id': 'req-6895b968-b676-4224-bfd8-ef7fec948fec'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:22.059406 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-6895b968-b676-4224-bfd8-ef7fec948fec admin admin] The token cache is being invalidate because project 66158a0525d5467c8d175c5f77bace03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:22.060085 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-6895b968-b676-4224-bfd8-ef7fec948fec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:22.062216 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-6895b968-b676-4224-bfd8-ef7fec948fec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:22.064863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1072/2147] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:21 2022] DELETE /identity/v3/projects/66158a0525d5467c8d175c5f77bace03 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:22.071184 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895b968-b676-4224-bfd8-ef7fec948fec admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:22.085022 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46558a37-75e8-4731-b557-4e8db4ed2eb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:22.085967 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46558a37-75e8-4731-b557-4e8db4ed2eb7 service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:22.086403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46558a37-75e8-4731-b557-4e8db4ed2eb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:22.086830 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46558a37-75e8-4731-b557-4e8db4ed2eb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:22.087715 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-6895b968-b676-4224-bfd8-ef7fec948fec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:22.089519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-46558a37-75e8-4731-b557-4e8db4ed2eb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:22.192683 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895b968-b676-4224-bfd8-ef7fec948fec admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:22.198336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46558a37-75e8-4731-b557-4e8db4ed2eb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:22.198918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc3dc3-733d-4d50-8568-20ffc9f0bd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:22.199856 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc3dc3-733d-4d50-8568-20ffc9f0bd65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:22.200143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc3dc3-733d-4d50-8568-20ffc9f0bd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:22.200422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc3dc3-733d-4d50-8568-20ffc9f0bd65 admin admin] PATH_INFO: `/v3/users/e4a3fd3090924a3c9d1818326acecb2c` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:22.200930 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46558a37-75e8-4731-b557-4e8db4ed2eb7 service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:22.201685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc3dc3-733d-4d50-8568-20ffc9f0bd65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4a3fd3090924a3c9d1818326acecb2c)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:22.204431 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc3dc3-733d-4d50-8568-20ffc9f0bd65 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:22.219691 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1076/2148] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:49:22.260745 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-d1cc3dc3-733d-4d50-8568-20ffc9f0bd65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4a3fd3090924a3c9d1818326acecb2c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:22.276442 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-d1cc3dc3-733d-4d50-8568-20ffc9f0bd65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4a3fd3090924a3c9d1818326acecb2c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:22.293625 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-d1cc3dc3-733d-4d50-8568-20ffc9f0bd65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4a3fd3090924a3c9d1818326acecb2c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:22.302217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-d1cc3dc3-733d-4d50-8568-20ffc9f0bd65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4a3fd3090924a3c9d1818326acecb2c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:22.303552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-d1cc3dc3-733d-4d50-8568-20ffc9f0bd65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4a3fd3090924a3c9d1818326acecb2c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:22.318769 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1073/2149] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:22 2022] DELETE /identity/v3/users/e4a3fd3090924a3c9d1818326acecb2c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:22.890345 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46558a37-75e8-4731-b557-4e8db4ed2eb7 service cinder] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:22.918861 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46558a37-75e8-4731-b557-4e8db4ed2eb7 service cinder] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:22.982377 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:23.092154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab83f2c-5741-4e3e-b5db-8aec20aa2519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:23.093052 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab83f2c-5741-4e3e-b5db-8aec20aa2519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:23.093342 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab83f2c-5741-4e3e-b5db-8aec20aa2519 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:23.098106 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab83f2c-5741-4e3e-b5db-8aec20aa2519 admin admin] PATH_INFO: `/v3/projects/c81d77a03cfd4ac4aa074c250611d1f4` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:23.100090 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab83f2c-5741-4e3e-b5db-8aec20aa2519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c81d77a03cfd4ac4aa074c250611d1f4)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:23.103949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab83f2c-5741-4e3e-b5db-8aec20aa2519 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:23.202679 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-4ab83f2c-5741-4e3e-b5db-8aec20aa2519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c81d77a03cfd4ac4aa074c250611d1f4', 'request_id': 'req-4ab83f2c-5741-4e3e-b5db-8aec20aa2519'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:23.219511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-4ab83f2c-5741-4e3e-b5db-8aec20aa2519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c81d77a03cfd4ac4aa074c250611d1f4', 'request_id': 'req-4ab83f2c-5741-4e3e-b5db-8aec20aa2519'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:23.232520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-4ab83f2c-5741-4e3e-b5db-8aec20aa2519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c81d77a03cfd4ac4aa074c250611d1f4', 'request_id': 'req-4ab83f2c-5741-4e3e-b5db-8aec20aa2519'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:23.249064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-4ab83f2c-5741-4e3e-b5db-8aec20aa2519 admin admin] The token cache is being invalidate because project c81d77a03cfd4ac4aa074c250611d1f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:23.249430 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-4ab83f2c-5741-4e3e-b5db-8aec20aa2519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:23.250201 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-4ab83f2c-5741-4e3e-b5db-8aec20aa2519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:23.255638 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1077/2150] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:22 2022] DELETE /identity/v3/projects/c81d77a03cfd4ac4aa074c250611d1f4 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:23.258744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014da2e3-1f53-4c54-b7e1-d9ae5fbda008 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:23.259425 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014da2e3-1f53-4c54-b7e1-d9ae5fbda008 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:23.260629 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014da2e3-1f53-4c54-b7e1-d9ae5fbda008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:23.303290 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab83f2c-5741-4e3e-b5db-8aec20aa2519 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:23.304423 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-4ab83f2c-5741-4e3e-b5db-8aec20aa2519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:23.310319 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-014da2e3-1f53-4c54-b7e1-d9ae5fbda008 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:23.313750 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-014da2e3-1f53-4c54-b7e1-d9ae5fbda008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:23.344085 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:23.415447 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1074/2151] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:23.419598 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a1acd-7e1b-48a2-b7cf-d510871007c9 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:23.419916 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a1acd-7e1b-48a2-b7cf-d510871007c9 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:23.420306 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a1acd-7e1b-48a2-b7cf-d510871007c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:23.443107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-c95a1acd-7e1b-48a2-b7cf-d510871007c9 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:23.443541 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab83f2c-5741-4e3e-b5db-8aec20aa2519 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:23.444961 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c95a1acd-7e1b-48a2-b7cf-d510871007c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:23.455135 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1075/2152] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:23.459199 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a1acd-7e1b-48a2-b7cf-d510871007c9 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:23.463692 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff045fc-eb3e-495c-b8d9-4a9ce7f2f38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:23.467002 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff045fc-eb3e-495c-b8d9-4a9ce7f2f38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:23.467400 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff045fc-eb3e-495c-b8d9-4a9ce7f2f38a admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:23.467819 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff045fc-eb3e-495c-b8d9-4a9ce7f2f38a admin admin] PATH_INFO: `/v3/users/00fb4f668072427cb2a61c504b744e74` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:23.470532 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a1acd-7e1b-48a2-b7cf-d510871007c9 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:23.473149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff045fc-eb3e-495c-b8d9-4a9ce7f2f38a admin admin] RBAC: Authorizing `identity:delete_user(user_id=00fb4f668072427cb2a61c504b744e74)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:23.478861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336efb3-db92-44aa-912b-4836f29685f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:23.479578 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336efb3-db92-44aa-912b-4836f29685f3 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:23.479729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff045fc-eb3e-495c-b8d9-4a9ce7f2f38a admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:23.479862 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336efb3-db92-44aa-912b-4836f29685f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:23.480848 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336efb3-db92-44aa-912b-4836f29685f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:23.481331 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336efb3-db92-44aa-912b-4836f29685f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:49:23.481646 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336efb3-db92-44aa-912b-4836f29685f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:23.484126 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336efb3-db92-44aa-912b-4836f29685f3 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:23.498987 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1076/2153] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:49:23.499896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336efb3-db92-44aa-912b-4836f29685f3 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:23.501615 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-2336efb3-db92-44aa-912b-4836f29685f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:23.515534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336efb3-db92-44aa-912b-4836f29685f3 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:23.521027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34458d85-752e-4daf-88cd-140ad96feb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:23.521994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34458d85-752e-4daf-88cd-140ad96feb58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:23.522247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34458d85-752e-4daf-88cd-140ad96feb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:23.522702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34458d85-752e-4daf-88cd-140ad96feb58 admin admin] PATH_INFO: `/v3/users/4d216c3d85f545fda11f320b159fa3f8` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:23.525131 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34458d85-752e-4daf-88cd-140ad96feb58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d216c3d85f545fda11f320b159fa3f8)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:23.527323 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34458d85-752e-4daf-88cd-140ad96feb58 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:23.544403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-2ff045fc-eb3e-495c-b8d9-4a9ce7f2f38a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00fb4f668072427cb2a61c504b744e74'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:23.555594 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-2ff045fc-eb3e-495c-b8d9-4a9ce7f2f38a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00fb4f668072427cb2a61c504b744e74'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:23.557386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:23.581620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-2ff045fc-eb3e-495c-b8d9-4a9ce7f2f38a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00fb4f668072427cb2a61c504b744e74'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:23.582453 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-2ff045fc-eb3e-495c-b8d9-4a9ce7f2f38a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00fb4f668072427cb2a61c504b744e74'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:23.588420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-34458d85-752e-4daf-88cd-140ad96feb58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d216c3d85f545fda11f320b159fa3f8'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:23.596213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-2ff045fc-eb3e-495c-b8d9-4a9ce7f2f38a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00fb4f668072427cb2a61c504b744e74'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:23.608129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1078/2154] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:23 2022] DELETE /identity/v3/users/00fb4f668072427cb2a61c504b744e74 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:23.608129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff045fc-eb3e-495c-b8d9-4a9ce7f2f38a admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:23.609347 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-34458d85-752e-4daf-88cd-140ad96feb58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d216c3d85f545fda11f320b159fa3f8'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:23.610689 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-2ff045fc-eb3e-495c-b8d9-4a9ce7f2f38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:23.633574 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-34458d85-752e-4daf-88cd-140ad96feb58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d216c3d85f545fda11f320b159fa3f8'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:23.650872 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-34458d85-752e-4daf-88cd-140ad96feb58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d216c3d85f545fda11f320b159fa3f8'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:23.651952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-34458d85-752e-4daf-88cd-140ad96feb58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d216c3d85f545fda11f320b159fa3f8'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:23.669714 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1077/2155] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:23 2022] DELETE /identity/v3/users/4d216c3d85f545fda11f320b159fa3f8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:23.671558 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28a96d-d3af-4e56-b6a2-02e279addb7f None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:23.675386 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28a96d-d3af-4e56-b6a2-02e279addb7f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:23.675676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28a96d-d3af-4e56-b6a2-02e279addb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:23.723190 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-db28a96d-d3af-4e56-b6a2-02e279addb7f None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:23.724699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-db28a96d-d3af-4e56-b6a2-02e279addb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:23.753297 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff045fc-eb3e-495c-b8d9-4a9ce7f2f38a admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:23.841547 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385375f-558e-4b4f-a82b-080bee948e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:23.842939 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1078/2156] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:23.845065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5405e7-b6d7-4984-a472-fd63bf7beb8e None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:23.845745 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5405e7-b6d7-4984-a472-fd63bf7beb8e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:23.846493 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5405e7-b6d7-4984-a472-fd63bf7beb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:23.847321 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385375f-558e-4b4f-a82b-080bee948e63 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:23.847628 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385375f-558e-4b4f-a82b-080bee948e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:23.847916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385375f-558e-4b4f-a82b-080bee948e63 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:23.848652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385375f-558e-4b4f-a82b-080bee948e63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:23.850686 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385375f-558e-4b4f-a82b-080bee948e63 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:23.872054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-5b5405e7-b6d7-4984-a472-fd63bf7beb8e None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:23.874565 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-5b5405e7-b6d7-4984-a472-fd63bf7beb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:23.890951 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1079/2157] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:23 2022] POST /identity/v3/projects => generated 387 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:23.891896 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385375f-558e-4b4f-a82b-080bee948e63 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:23.892303 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1079/2158] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:23.899120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5405e7-b6d7-4984-a472-fd63bf7beb8e None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:23.899120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-5b5405e7-b6d7-4984-a472-fd63bf7beb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:23.899361 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-4385375f-558e-4b4f-a82b-080bee948e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:23.911310 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5405e7-b6d7-4984-a472-fd63bf7beb8e None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:23.917241 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:23.990272 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5911023-64f8-49bc-87b2-fae06c92bab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:23.990961 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5911023-64f8-49bc-87b2-fae06c92bab5 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:23.993460 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5911023-64f8-49bc-87b2-fae06c92bab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:23.993837 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5911023-64f8-49bc-87b2-fae06c92bab5 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:23.994768 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5911023-64f8-49bc-87b2-fae06c92bab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:23.996916 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5911023-64f8-49bc-87b2-fae06c92bab5 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:24.004960 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385375f-558e-4b4f-a82b-080bee948e63 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:24.010460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63849bc9-269e-49d8-b358-ba384052477d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:24.011634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63849bc9-269e-49d8-b358-ba384052477d service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:24.012653 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63849bc9-269e-49d8-b358-ba384052477d service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:24.013415 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63849bc9-269e-49d8-b358-ba384052477d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:24.026275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1080/2159] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:23 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:49:24.027574 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5911023-64f8-49bc-87b2-fae06c92bab5 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:24.032491 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63849bc9-269e-49d8-b358-ba384052477d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:24.035374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63849bc9-269e-49d8-b358-ba384052477d service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:24.048856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1080/2160] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:24.050303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63849bc9-269e-49d8-b358-ba384052477d service neutron] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:24.066356 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63849bc9-269e-49d8-b358-ba384052477d service neutron] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:24.073563 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ff120-1ce8-4b3c-88fb-07351cd3124c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:24.074590 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ff120-1ce8-4b3c-88fb-07351cd3124c admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:24.074726 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5911023-64f8-49bc-87b2-fae06c92bab5 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:24.075204 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ff120-1ce8-4b3c-88fb-07351cd3124c admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:24.075698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ff120-1ce8-4b3c-88fb-07351cd3124c admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:24.076888 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ff120-1ce8-4b3c-88fb-07351cd3124c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:24.078948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ff120-1ce8-4b3c-88fb-07351cd3124c admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:24.081155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:24.089118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1748a64-f773-4dde-aee6-91c4139e96cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:24.089806 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1748a64-f773-4dde-aee6-91c4139e96cd service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:24.090098 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1748a64-f773-4dde-aee6-91c4139e96cd service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:24.090381 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1748a64-f773-4dde-aee6-91c4139e96cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:24.099210 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1081/2161] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:24.100570 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ff120-1ce8-4b3c-88fb-07351cd3124c admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:24.123154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ff120-1ce8-4b3c-88fb-07351cd3124c admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:24.128786 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1748a64-f773-4dde-aee6-91c4139e96cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:24.130244 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1748a64-f773-4dde-aee6-91c4139e96cd service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:24.130782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849286a-a2b8-4cf4-ae40-c99eae466ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:24.131373 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849286a-a2b8-4cf4-ae40-c99eae466ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:24.131754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849286a-a2b8-4cf4-ae40-c99eae466ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:24.132130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849286a-a2b8-4cf4-ae40-c99eae466ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:24.133655 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849286a-a2b8-4cf4-ae40-c99eae466ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:24.135810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849286a-a2b8-4cf4-ae40-c99eae466ef8 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:24.148012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1082/2162] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:24.152737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849286a-a2b8-4cf4-ae40-c99eae466ef8 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:24.167639 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1081/2163] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:24.174146 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849286a-a2b8-4cf4-ae40-c99eae466ef8 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:24.221947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825dcb2-5bcd-4589-8e3c-fba46f9043a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:24.223213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825dcb2-5bcd-4589-8e3c-fba46f9043a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:24.223213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825dcb2-5bcd-4589-8e3c-fba46f9043a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:24.226105 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825dcb2-5bcd-4589-8e3c-fba46f9043a9 admin admin] PATH_INFO: `/v3/projects/629c8b5fa2a944548a1fdb5f843f615d/users/24b9b69a99b049a2ab77baa11e842d42/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:24.268074 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825dcb2-5bcd-4589-8e3c-fba46f9043a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=629c8b5fa2a944548a1fdb5f843f615d, user_id=24b9b69a99b049a2ab77baa11e842d42, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:24.273383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825dcb2-5bcd-4589-8e3c-fba46f9043a9 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:24.308251 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1083/2164] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:24 2022] PUT /identity/v3/projects/629c8b5fa2a944548a1fdb5f843f615d/users/24b9b69a99b049a2ab77baa11e842d42/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:24.321509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a4023-a12e-4d86-b3e9-041fb2867fe6 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:24.322692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a4023-a12e-4d86-b3e9-041fb2867fe6 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:24.323897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a4023-a12e-4d86-b3e9-041fb2867fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:24.397446 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-ba8a4023-a12e-4d86-b3e9-041fb2867fe6 None None] MFA Rules not processed for user `24b9b69a99b049a2ab77baa11e842d42`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:24.398656 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ba8a4023-a12e-4d86-b3e9-041fb2867fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:24.505790 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1082/2165] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:24.510956 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825dcb2-5bcd-4589-8e3c-fba46f9043a9 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:24.629203 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825dcb2-5bcd-4589-8e3c-fba46f9043a9 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:24.645782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978700d-2eac-4944-92a4-73af9d00cd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:24.646401 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978700d-2eac-4944-92a4-73af9d00cd04 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:24.646689 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978700d-2eac-4944-92a4-73af9d00cd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:24.646973 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978700d-2eac-4944-92a4-73af9d00cd04 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:24.647729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978700d-2eac-4944-92a4-73af9d00cd04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:24.652923 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978700d-2eac-4944-92a4-73af9d00cd04 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:24.695645 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1084/2166] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:24 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:24.700802 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a4023-a12e-4d86-b3e9-041fb2867fe6 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:24.718929 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a4023-a12e-4d86-b3e9-041fb2867fe6 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:24.809493 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86599d2e-5c18-47cf-a14b-ce5a2706efa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:24.810221 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86599d2e-5c18-47cf-a14b-ce5a2706efa7 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:24.810511 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86599d2e-5c18-47cf-a14b-ce5a2706efa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:24.810788 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86599d2e-5c18-47cf-a14b-ce5a2706efa7 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:24.811577 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86599d2e-5c18-47cf-a14b-ce5a2706efa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:24.813044 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978700d-2eac-4944-92a4-73af9d00cd04 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:24.813931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86599d2e-5c18-47cf-a14b-ce5a2706efa7 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:24.815770 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-1978700d-2eac-4944-92a4-73af9d00cd04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:24.843774 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1083/2167] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:24 2022] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:24.850750 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978700d-2eac-4944-92a4-73af9d00cd04 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:24.852510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86599d2e-5c18-47cf-a14b-ce5a2706efa7 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:24.862598 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:24.865219 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7d24d-1b4c-49a4-b407-6c3b676811b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:24.866115 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7d24d-1b4c-49a4-b407-6c3b676811b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:24.866405 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7d24d-1b4c-49a4-b407-6c3b676811b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:24.866688 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7d24d-1b4c-49a4-b407-6c3b676811b7 admin admin] PATH_INFO: `/v3/projects/1d7ce4d860a54f86a41a2d9d3fdcc496` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:24.869331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7d24d-1b4c-49a4-b407-6c3b676811b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d7ce4d860a54f86a41a2d9d3fdcc496)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:24.871223 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7d24d-1b4c-49a4-b407-6c3b676811b7 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:24.875739 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86599d2e-5c18-47cf-a14b-ce5a2706efa7 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:24.889224 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0db735-c7bf-431d-b965-7c91c32b48d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:24.890056 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0db735-c7bf-431d-b965-7c91c32b48d2 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:24.890814 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0db735-c7bf-431d-b965-7c91c32b48d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:24.891111 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0db735-c7bf-431d-b965-7c91c32b48d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:24.892066 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0db735-c7bf-431d-b965-7c91c32b48d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:24.893813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0db735-c7bf-431d-b965-7c91c32b48d2 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:24.939871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1084/2168] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:24.939871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0db735-c7bf-431d-b965-7c91c32b48d2 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:24.956722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0db735-c7bf-431d-b965-7c91c32b48d2 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:24.995830 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-65a7d24d-1b4c-49a4-b407-6c3b676811b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d7ce4d860a54f86a41a2d9d3fdcc496', 'request_id': 'req-65a7d24d-1b4c-49a4-b407-6c3b676811b7'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.014114 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-65a7d24d-1b4c-49a4-b407-6c3b676811b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d7ce4d860a54f86a41a2d9d3fdcc496', 'request_id': 'req-65a7d24d-1b4c-49a4-b407-6c3b676811b7'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.027387 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-65a7d24d-1b4c-49a4-b407-6c3b676811b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d7ce4d860a54f86a41a2d9d3fdcc496', 'request_id': 'req-65a7d24d-1b4c-49a4-b407-6c3b676811b7'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.042055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ade39-d611-43f8-a98a-f5603213af6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:25.043090 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ade39-d611-43f8-a98a-f5603213af6a admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:25.043412 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ade39-d611-43f8-a98a-f5603213af6a admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:25.043745 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ade39-d611-43f8-a98a-f5603213af6a admin admin] PATH_INFO: `/v3/projects/f057d55e25af49ad94ed42033d591442/users/e79f61b8df1749ac948067624afda70f/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:25.060315 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-65a7d24d-1b4c-49a4-b407-6c3b676811b7 admin admin] The token cache is being invalidate because project 1d7ce4d860a54f86a41a2d9d3fdcc496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:25.060650 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-65a7d24d-1b4c-49a4-b407-6c3b676811b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.062873 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-65a7d24d-1b4c-49a4-b407-6c3b676811b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.065112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ade39-d611-43f8-a98a-f5603213af6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f057d55e25af49ad94ed42033d591442, user_id=e79f61b8df1749ac948067624afda70f, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:25.065711 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1085/2169] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:24 2022] DELETE /identity/v3/projects/1d7ce4d860a54f86a41a2d9d3fdcc496 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:25.070195 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ade39-d611-43f8-a98a-f5603213af6a admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:25.072421 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7d24d-1b4c-49a4-b407-6c3b676811b7 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:25.073864 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-65a7d24d-1b4c-49a4-b407-6c3b676811b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:25.091597 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1085/2170] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:24 2022] PUT /identity/v3/projects/f057d55e25af49ad94ed42033d591442/users/e79f61b8df1749ac948067624afda70f/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:25.092688 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ade39-d611-43f8-a98a-f5603213af6a admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:25.094612 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b66ade39-d611-43f8-a98a-f5603213af6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:25.106175 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7d24d-1b4c-49a4-b407-6c3b676811b7 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:25.163665 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:25.186165 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ade39-d611-43f8-a98a-f5603213af6a admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:25.199960 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cc95f-84fe-439a-a082-a6574570726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:25.200658 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cc95f-84fe-439a-a082-a6574570726c admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:25.200945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cc95f-84fe-439a-a082-a6574570726c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:25.201220 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cc95f-84fe-439a-a082-a6574570726c admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:25.201968 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cc95f-84fe-439a-a082-a6574570726c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:25.208139 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cc95f-84fe-439a-a082-a6574570726c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:25.227766 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7e183-167a-4146-bbae-ab17a4897a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:25.233898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7e183-167a-4146-bbae-ab17a4897a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:25.234357 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7e183-167a-4146-bbae-ab17a4897a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:25.234742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7e183-167a-4146-bbae-ab17a4897a22 admin admin] PATH_INFO: `/v3/users/5dc3b0061e71416a8264f9a560ce3e5c` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:25.236618 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7e183-167a-4146-bbae-ab17a4897a22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dc3b0061e71416a8264f9a560ce3e5c)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:25.240951 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7e183-167a-4146-bbae-ab17a4897a22 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:25.246240 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1086/2171] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:25.247165 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cc95f-84fe-439a-a082-a6574570726c admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:25.266971 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cc95f-84fe-439a-a082-a6574570726c admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:25.277887 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da322c2-c99c-43c3-863e-bfc2ae3853b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:25.278819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da322c2-c99c-43c3-863e-bfc2ae3853b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:25.279105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da322c2-c99c-43c3-863e-bfc2ae3853b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:25.279419 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da322c2-c99c-43c3-863e-bfc2ae3853b7 admin admin] PATH_INFO: `/v3/projects/f057d55e25af49ad94ed42033d591442/users/e79f61b8df1749ac948067624afda70f/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:25.292524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da322c2-c99c-43c3-863e-bfc2ae3853b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f057d55e25af49ad94ed42033d591442, user_id=e79f61b8df1749ac948067624afda70f, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:25.299550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da322c2-c99c-43c3-863e-bfc2ae3853b7 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:25.325258 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1087/2172] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:25 2022] PUT /identity/v3/projects/f057d55e25af49ad94ed42033d591442/users/e79f61b8df1749ac948067624afda70f/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:25.340064 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ce90a-798b-4b7f-b687-5fbde7906065 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:25.340064 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ce90a-798b-4b7f-b687-5fbde7906065 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:25.340259 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ce90a-798b-4b7f-b687-5fbde7906065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:25.343883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a7d7e183-167a-4146-bbae-ab17a4897a22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dc3b0061e71416a8264f9a560ce3e5c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.357717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a7d7e183-167a-4146-bbae-ab17a4897a22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dc3b0061e71416a8264f9a560ce3e5c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.386970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a7d7e183-167a-4146-bbae-ab17a4897a22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dc3b0061e71416a8264f9a560ce3e5c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.387769 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a7d7e183-167a-4146-bbae-ab17a4897a22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dc3b0061e71416a8264f9a560ce3e5c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.396480 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-a7d7e183-167a-4146-bbae-ab17a4897a22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dc3b0061e71416a8264f9a560ce3e5c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.400184 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-369ce90a-798b-4b7f-b687-5fbde7906065 None None] MFA Rules not processed for user `e79f61b8df1749ac948067624afda70f`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:25.402521 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-369ce90a-798b-4b7f-b687-5fbde7906065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:25.407527 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1086/2173] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:25 2022] DELETE /identity/v3/users/5dc3b0061e71416a8264f9a560ce3e5c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:25.491101 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:25.535425 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1088/2174] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:25.535597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7e183-167a-4146-bbae-ab17a4897a22 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:25.537823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-a7d7e183-167a-4146-bbae-ab17a4897a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:25.549748 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ce90a-798b-4b7f-b687-5fbde7906065 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:25.554705 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-369ce90a-798b-4b7f-b687-5fbde7906065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:25.668015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ce90a-798b-4b7f-b687-5fbde7906065 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:25.674152 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13141433-5cc4-4565-89dc-2383fe359777 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:25.675759 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13141433-5cc4-4565-89dc-2383fe359777 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:25.676046 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13141433-5cc4-4565-89dc-2383fe359777 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:25.676324 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13141433-5cc4-4565-89dc-2383fe359777 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:25.680792 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7e183-167a-4146-bbae-ab17a4897a22 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:25.685780 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7059481-b7de-4276-a03c-6e143ff56672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:25.686657 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7059481-b7de-4276-a03c-6e143ff56672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:25.686940 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7059481-b7de-4276-a03c-6e143ff56672 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:25.687435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7059481-b7de-4276-a03c-6e143ff56672 admin admin] PATH_INFO: `/v3/projects/e1e6216bf5534d4c800b3289efb35083` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:25.687529 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13141433-5cc4-4565-89dc-2383fe359777 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:25.688630 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7059481-b7de-4276-a03c-6e143ff56672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e6216bf5534d4c800b3289efb35083)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:25.689149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13141433-5cc4-4565-89dc-2383fe359777 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:25.690702 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7059481-b7de-4276-a03c-6e143ff56672 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:25.701003 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1089/2175] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:25.738935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13141433-5cc4-4565-89dc-2383fe359777 service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:25.741114 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-13141433-5cc4-4565-89dc-2383fe359777 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:25.756959 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13141433-5cc4-4565-89dc-2383fe359777 service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:25.781901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e7059481-b7de-4276-a03c-6e143ff56672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e6216bf5534d4c800b3289efb35083', 'request_id': 'req-e7059481-b7de-4276-a03c-6e143ff56672'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.784751 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:25.795577 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e7059481-b7de-4276-a03c-6e143ff56672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e6216bf5534d4c800b3289efb35083', 'request_id': 'req-e7059481-b7de-4276-a03c-6e143ff56672'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.805669 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e7059481-b7de-4276-a03c-6e143ff56672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e6216bf5534d4c800b3289efb35083', 'request_id': 'req-e7059481-b7de-4276-a03c-6e143ff56672'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.820010 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e7059481-b7de-4276-a03c-6e143ff56672 admin admin] The token cache is being invalidate because project e1e6216bf5534d4c800b3289efb35083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:25.820857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e7059481-b7de-4276-a03c-6e143ff56672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.821549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e7059481-b7de-4276-a03c-6e143ff56672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.823201 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1087/2176] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:25 2022] DELETE /identity/v3/projects/e1e6216bf5534d4c800b3289efb35083 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:25.827750 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7059481-b7de-4276-a03c-6e143ff56672 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:25.833314 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e7059481-b7de-4276-a03c-6e143ff56672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:25.837904 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384e03b-2c2c-4005-b880-e682d64cb5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:25.839074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384e03b-2c2c-4005-b880-e682d64cb5c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:25.839650 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384e03b-2c2c-4005-b880-e682d64cb5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:25.839990 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384e03b-2c2c-4005-b880-e682d64cb5c3 admin admin] PATH_INFO: `/v3/users/24b9b69a99b049a2ab77baa11e842d42` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:25.841247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384e03b-2c2c-4005-b880-e682d64cb5c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24b9b69a99b049a2ab77baa11e842d42)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:25.843775 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384e03b-2c2c-4005-b880-e682d64cb5c3 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:25.857212 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7059481-b7de-4276-a03c-6e143ff56672 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:25.865324 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c0a45-33f8-42ba-a3fd-314eaecefc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:25.867680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c0a45-33f8-42ba-a3fd-314eaecefc7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:25.868136 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c0a45-33f8-42ba-a3fd-314eaecefc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:25.868488 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c0a45-33f8-42ba-a3fd-314eaecefc7a admin admin] PATH_INFO: `/v3/users/50d57fe67ecf4b7d8201509da492afb4` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:25.870313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c0a45-33f8-42ba-a3fd-314eaecefc7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=50d57fe67ecf4b7d8201509da492afb4)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:25.872555 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149c0a45-33f8-42ba-a3fd-314eaecefc7a admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:25.922027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-5384e03b-2c2c-4005-b880-e682d64cb5c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24b9b69a99b049a2ab77baa11e842d42'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.935941 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-5384e03b-2c2c-4005-b880-e682d64cb5c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24b9b69a99b049a2ab77baa11e842d42'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.947391 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-149c0a45-33f8-42ba-a3fd-314eaecefc7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50d57fe67ecf4b7d8201509da492afb4'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.958182 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-5384e03b-2c2c-4005-b880-e682d64cb5c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24b9b69a99b049a2ab77baa11e842d42'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.961429 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-149c0a45-33f8-42ba-a3fd-314eaecefc7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50d57fe67ecf4b7d8201509da492afb4'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.973583 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-5384e03b-2c2c-4005-b880-e682d64cb5c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24b9b69a99b049a2ab77baa11e842d42'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.975017 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-5384e03b-2c2c-4005-b880-e682d64cb5c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24b9b69a99b049a2ab77baa11e842d42'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.983138 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-149c0a45-33f8-42ba-a3fd-314eaecefc7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50d57fe67ecf4b7d8201509da492afb4'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.986631 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1090/2177] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:25 2022] DELETE /identity/v3/users/24b9b69a99b049a2ab77baa11e842d42 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:25.986631 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384e03b-2c2c-4005-b880-e682d64cb5c3 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:25.987011 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-149c0a45-33f8-42ba-a3fd-314eaecefc7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50d57fe67ecf4b7d8201509da492afb4'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:25.987362 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-5384e03b-2c2c-4005-b880-e682d64cb5c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:25.998277 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-149c0a45-33f8-42ba-a3fd-314eaecefc7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50d57fe67ecf4b7d8201509da492afb4'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:26.000024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:26.011873 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1088/2178] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:25 2022] DELETE /identity/v3/users/50d57fe67ecf4b7d8201509da492afb4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:26.015569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4ba3e-f479-4557-ac60-d7a4e2be9386 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:26.015569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4ba3e-f479-4557-ac60-d7a4e2be9386 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:26.015569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4ba3e-f479-4557-ac60-d7a4e2be9386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:26.039103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-d5b4ba3e-f479-4557-ac60-d7a4e2be9386 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:26.040799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-d5b4ba3e-f479-4557-ac60-d7a4e2be9386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:26.076137 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384e03b-2c2c-4005-b880-e682d64cb5c3 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:26.145848 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1089/2179] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:26.156762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4ba3e-f479-4557-ac60-d7a4e2be9386 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:26.158322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-d5b4ba3e-f479-4557-ac60-d7a4e2be9386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:26.205992 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c671a-c3c0-4e9c-a8b2-6606887c50c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:26.207519 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c671a-c3c0-4e9c-a8b2-6606887c50c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:26.207902 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c671a-c3c0-4e9c-a8b2-6606887c50c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:26.208414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c671a-c3c0-4e9c-a8b2-6606887c50c0 admin admin] PATH_INFO: `/v3/projects/ec48e02429a743f88e05650a3acd6700` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:26.210782 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c671a-c3c0-4e9c-a8b2-6606887c50c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec48e02429a743f88e05650a3acd6700)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:26.213130 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c671a-c3c0-4e9c-a8b2-6606887c50c0 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:26.261153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4ba3e-f479-4557-ac60-d7a4e2be9386 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:26.267326 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8e0e5-7351-4a25-b307-4cb1073a27c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:26.268221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8e0e5-7351-4a25-b307-4cb1073a27c5 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:26.268788 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8e0e5-7351-4a25-b307-4cb1073a27c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:26.269328 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8e0e5-7351-4a25-b307-4cb1073a27c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:26.276892 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:26.282287 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8e0e5-7351-4a25-b307-4cb1073a27c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:26.287610 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8e0e5-7351-4a25-b307-4cb1073a27c5 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:26.311096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1090/2180] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:49:26.333719 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-462c671a-c3c0-4e9c-a8b2-6606887c50c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec48e02429a743f88e05650a3acd6700', 'request_id': 'req-462c671a-c3c0-4e9c-a8b2-6606887c50c0'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:26.346195 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-462c671a-c3c0-4e9c-a8b2-6606887c50c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec48e02429a743f88e05650a3acd6700', 'request_id': 'req-462c671a-c3c0-4e9c-a8b2-6606887c50c0'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:26.357744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-462c671a-c3c0-4e9c-a8b2-6606887c50c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec48e02429a743f88e05650a3acd6700', 'request_id': 'req-462c671a-c3c0-4e9c-a8b2-6606887c50c0'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:26.373363 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-462c671a-c3c0-4e9c-a8b2-6606887c50c0 admin admin] The token cache is being invalidate because project ec48e02429a743f88e05650a3acd6700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:26.373705 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-462c671a-c3c0-4e9c-a8b2-6606887c50c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:26.374434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-462c671a-c3c0-4e9c-a8b2-6606887c50c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:26.377323 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1091/2181] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:25 2022] DELETE /identity/v3/projects/ec48e02429a743f88e05650a3acd6700 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:26.381153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8e0e5-7351-4a25-b307-4cb1073a27c5 service neutron] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:26.383318 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-69a8e0e5-7351-4a25-b307-4cb1073a27c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:26.397457 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8e0e5-7351-4a25-b307-4cb1073a27c5 service neutron] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:26.482767 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84da00-6681-49a0-ac89-12e3bb461d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:26.483946 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84da00-6681-49a0-ac89-12e3bb461d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:26.484235 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84da00-6681-49a0-ac89-12e3bb461d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:26.484541 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84da00-6681-49a0-ac89-12e3bb461d64 admin admin] PATH_INFO: `/v3/users/a98109cc39144c2880cd47f0de74c7dd` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:26.486330 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84da00-6681-49a0-ac89-12e3bb461d64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a98109cc39144c2880cd47f0de74c7dd)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:26.489534 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84da00-6681-49a0-ac89-12e3bb461d64 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:26.515173 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c671a-c3c0-4e9c-a8b2-6606887c50c0 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:26.517187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-462c671a-c3c0-4e9c-a8b2-6606887c50c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:26.537449 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c671a-c3c0-4e9c-a8b2-6606887c50c0 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:26.546559 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9f9ca-af01-42d8-a383-b9f42bc1ba34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:26.547503 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9f9ca-af01-42d8-a383-b9f42bc1ba34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:26.547907 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9f9ca-af01-42d8-a383-b9f42bc1ba34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:26.548143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9f9ca-af01-42d8-a383-b9f42bc1ba34 admin admin] PATH_INFO: `/v3/projects/daa6aef1086d4dc6bdf2fe4d47bb2276` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:26.549608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9f9ca-af01-42d8-a383-b9f42bc1ba34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daa6aef1086d4dc6bdf2fe4d47bb2276)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:26.552286 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9f9ca-af01-42d8-a383-b9f42bc1ba34 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:26.599454 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-db84da00-6681-49a0-ac89-12e3bb461d64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a98109cc39144c2880cd47f0de74c7dd'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:26.609493 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:26.610794 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-db84da00-6681-49a0-ac89-12e3bb461d64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a98109cc39144c2880cd47f0de74c7dd'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:26.623112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-d4c9f9ca-af01-42d8-a383-b9f42bc1ba34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daa6aef1086d4dc6bdf2fe4d47bb2276', 'request_id': 'req-d4c9f9ca-af01-42d8-a383-b9f42bc1ba34'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:26.631544 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-d4c9f9ca-af01-42d8-a383-b9f42bc1ba34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daa6aef1086d4dc6bdf2fe4d47bb2276', 'request_id': 'req-d4c9f9ca-af01-42d8-a383-b9f42bc1ba34'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:26.646229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-d4c9f9ca-af01-42d8-a383-b9f42bc1ba34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daa6aef1086d4dc6bdf2fe4d47bb2276', 'request_id': 'req-d4c9f9ca-af01-42d8-a383-b9f42bc1ba34'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:26.646576 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-db84da00-6681-49a0-ac89-12e3bb461d64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a98109cc39144c2880cd47f0de74c7dd'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:26.647740 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-db84da00-6681-49a0-ac89-12e3bb461d64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a98109cc39144c2880cd47f0de74c7dd'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:26.663187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-db84da00-6681-49a0-ac89-12e3bb461d64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a98109cc39144c2880cd47f0de74c7dd'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:26.670800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-d4c9f9ca-af01-42d8-a383-b9f42bc1ba34 admin admin] The token cache is being invalidate because project daa6aef1086d4dc6bdf2fe4d47bb2276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:26.671447 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-d4c9f9ca-af01-42d8-a383-b9f42bc1ba34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:26.672339 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-d4c9f9ca-af01-42d8-a383-b9f42bc1ba34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:26.673682 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1091/2182] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:26 2022] DELETE /identity/v3/users/a98109cc39144c2880cd47f0de74c7dd => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:26.680457 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1092/2183] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:26 2022] DELETE /identity/v3/projects/daa6aef1086d4dc6bdf2fe4d47bb2276 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:26.681140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84da00-6681-49a0-ac89-12e3bb461d64 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:26.682709 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-db84da00-6681-49a0-ac89-12e3bb461d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:26.691837 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3651b85-53da-4d12-8f18-a60e6dbb081d None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:26.692442 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3651b85-53da-4d12-8f18-a60e6dbb081d None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:26.692889 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3651b85-53da-4d12-8f18-a60e6dbb081d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:26.718954 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-a3651b85-53da-4d12-8f18-a60e6dbb081d None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:26.720880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a3651b85-53da-4d12-8f18-a60e6dbb081d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:26.793337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84da00-6681-49a0-ac89-12e3bb461d64 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:26.803815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cc752-69d5-4c02-9a34-560093ddef15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:26.807018 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cc752-69d5-4c02-9a34-560093ddef15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:26.808445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cc752-69d5-4c02-9a34-560093ddef15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:26.808755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cc752-69d5-4c02-9a34-560093ddef15 admin admin] PATH_INFO: `/v3/projects/629c8b5fa2a944548a1fdb5f843f615d` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:26.810645 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cc752-69d5-4c02-9a34-560093ddef15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=629c8b5fa2a944548a1fdb5f843f615d)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:26.813458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cc752-69d5-4c02-9a34-560093ddef15 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:26.839391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1093/2184] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:26.839613 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:26.841582 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6e4b1-b701-44e8-8df0-f22ccd1997a6 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:26.841909 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6e4b1-b701-44e8-8df0-f22ccd1997a6 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:26.842191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6e4b1-b701-44e8-8df0-f22ccd1997a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:26.866622 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-8ce6e4b1-b701-44e8-8df0-f22ccd1997a6 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:26.868405 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-8ce6e4b1-b701-44e8-8df0-f22ccd1997a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:26.884102 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-824cc752-69d5-4c02-9a34-560093ddef15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629c8b5fa2a944548a1fdb5f843f615d', 'request_id': 'req-824cc752-69d5-4c02-9a34-560093ddef15'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:26.903925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-824cc752-69d5-4c02-9a34-560093ddef15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629c8b5fa2a944548a1fdb5f843f615d', 'request_id': 'req-824cc752-69d5-4c02-9a34-560093ddef15'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:26.928922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-824cc752-69d5-4c02-9a34-560093ddef15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629c8b5fa2a944548a1fdb5f843f615d', 'request_id': 'req-824cc752-69d5-4c02-9a34-560093ddef15'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:26.942495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-824cc752-69d5-4c02-9a34-560093ddef15 admin admin] The token cache is being invalidate because project 629c8b5fa2a944548a1fdb5f843f615d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:26.942882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-824cc752-69d5-4c02-9a34-560093ddef15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:26.943681 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-824cc752-69d5-4c02-9a34-560093ddef15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:26.946959 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1092/2185] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:26 2022] DELETE /identity/v3/projects/629c8b5fa2a944548a1fdb5f843f615d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:26.951317 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cc752-69d5-4c02-9a34-560093ddef15 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:26.952852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-824cc752-69d5-4c02-9a34-560093ddef15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:26.980035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1094/2186] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:49:26.984639 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6e4b1-b701-44e8-8df0-f22ccd1997a6 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:26.995410 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6e4b1-b701-44e8-8df0-f22ccd1997a6 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:27.001547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6c791-5cdd-4b25-a8bb-468ba9ad2e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:27.002017 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6c791-5cdd-4b25-a8bb-468ba9ad2e74 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:27.002299 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6c791-5cdd-4b25-a8bb-468ba9ad2e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:27.002647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6c791-5cdd-4b25-a8bb-468ba9ad2e74 admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:27.003789 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6c791-5cdd-4b25-a8bb-468ba9ad2e74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:49:27.003963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6c791-5cdd-4b25-a8bb-468ba9ad2e74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:27.005632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6c791-5cdd-4b25-a8bb-468ba9ad2e74 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:27.023873 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1095/2187] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:49:27.027554 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6c791-5cdd-4b25-a8bb-468ba9ad2e74 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:27.032281 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cc752-69d5-4c02-9a34-560093ddef15 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:27.039939 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c973c-3838-4fe0-99b7-64ee42261bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:27.040843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c973c-3838-4fe0-99b7-64ee42261bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:27.041127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c973c-3838-4fe0-99b7-64ee42261bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:27.041402 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714c973c-3838-4fe0-99b7-64ee42261bbc admin admin] PATH_INFO: `/v3/users/e79f61b8df1749ac948067624afda70f` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:27.041976 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6c791-5cdd-4b25-a8bb-468ba9ad2e74 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:27.042904 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c973c-3838-4fe0-99b7-64ee42261bbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e79f61b8df1749ac948067624afda70f)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:27.044902 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714c973c-3838-4fe0-99b7-64ee42261bbc admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:27.047483 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dbe13-da6a-47ab-902b-04982440e506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:27.048157 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dbe13-da6a-47ab-902b-04982440e506 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:27.048611 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dbe13-da6a-47ab-902b-04982440e506 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:27.048895 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216dbe13-da6a-47ab-902b-04982440e506 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:27.049598 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216dbe13-da6a-47ab-902b-04982440e506 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:27.052130 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216dbe13-da6a-47ab-902b-04982440e506 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:27.083302 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1096/2188] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:27 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:49:27.087722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dbe13-da6a-47ab-902b-04982440e506 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:27.123761 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-714c973c-3838-4fe0-99b7-64ee42261bbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e79f61b8df1749ac948067624afda70f'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:27.137246 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-714c973c-3838-4fe0-99b7-64ee42261bbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e79f61b8df1749ac948067624afda70f'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:27.139292 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:27.156849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-714c973c-3838-4fe0-99b7-64ee42261bbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e79f61b8df1749ac948067624afda70f'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:27.158297 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-714c973c-3838-4fe0-99b7-64ee42261bbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e79f61b8df1749ac948067624afda70f'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:27.172296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-714c973c-3838-4fe0-99b7-64ee42261bbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e79f61b8df1749ac948067624afda70f'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:27.178091 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216dbe13-da6a-47ab-902b-04982440e506 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:27.179861 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1093/2189] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:26 2022] DELETE /identity/v3/users/e79f61b8df1749ac948067624afda70f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:27.180861 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c973c-3838-4fe0-99b7-64ee42261bbc admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:27.182231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-714c973c-3838-4fe0-99b7-64ee42261bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:27.212469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:27.275691 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d4cdd-936b-476a-986b-06e42078c89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:27.276458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714c973c-3838-4fe0-99b7-64ee42261bbc admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:27.276579 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d4cdd-936b-476a-986b-06e42078c89c admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:27.276826 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d4cdd-936b-476a-986b-06e42078c89c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:27.277144 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d4cdd-936b-476a-986b-06e42078c89c admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:27.278246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d4cdd-936b-476a-986b-06e42078c89c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:27.281356 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edb5d1-a4b4-44ae-8011-a850feb9cd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:27.282102 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d4cdd-936b-476a-986b-06e42078c89c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:27.282221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edb5d1-a4b4-44ae-8011-a850feb9cd00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:27.282513 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edb5d1-a4b4-44ae-8011-a850feb9cd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:27.282794 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edb5d1-a4b4-44ae-8011-a850feb9cd00 admin admin] PATH_INFO: `/v3/projects/1389fa51bc164cc48a4cc0bedde83dbb` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:27.284173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edb5d1-a4b4-44ae-8011-a850feb9cd00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1389fa51bc164cc48a4cc0bedde83dbb)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:27.286461 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edb5d1-a4b4-44ae-8011-a850feb9cd00 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:27.320651 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1097/2190] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:27 2022] POST /identity/v3/users => generated 284 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:27.326042 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d4cdd-936b-476a-986b-06e42078c89c admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:27.332871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-371d4cdd-936b-476a-986b-06e42078c89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:27.353797 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d4cdd-936b-476a-986b-06e42078c89c admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:27.355943 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-33edb5d1-a4b4-44ae-8011-a850feb9cd00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1389fa51bc164cc48a4cc0bedde83dbb', 'request_id': 'req-33edb5d1-a4b4-44ae-8011-a850feb9cd00'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:27.377883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-33edb5d1-a4b4-44ae-8011-a850feb9cd00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1389fa51bc164cc48a4cc0bedde83dbb', 'request_id': 'req-33edb5d1-a4b4-44ae-8011-a850feb9cd00'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:27.392546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-33edb5d1-a4b4-44ae-8011-a850feb9cd00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1389fa51bc164cc48a4cc0bedde83dbb', 'request_id': 'req-33edb5d1-a4b4-44ae-8011-a850feb9cd00'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:27.407025 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-33edb5d1-a4b4-44ae-8011-a850feb9cd00 admin admin] The token cache is being invalidate because project 1389fa51bc164cc48a4cc0bedde83dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:27.407491 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-33edb5d1-a4b4-44ae-8011-a850feb9cd00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:27.408438 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-33edb5d1-a4b4-44ae-8011-a850feb9cd00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:27.410487 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1094/2191] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:27 2022] DELETE /identity/v3/projects/1389fa51bc164cc48a4cc0bedde83dbb => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:27.416895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92971427-de55-416b-8ac2-5fe197306beb None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:27.417336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92971427-de55-416b-8ac2-5fe197306beb None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:27.417719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92971427-de55-416b-8ac2-5fe197306beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:27.446027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-92971427-de55-416b-8ac2-5fe197306beb None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:27.450874 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-92971427-de55-416b-8ac2-5fe197306beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:27.462710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f8215-21f1-4dad-abfd-237586a788ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:27.463988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f8215-21f1-4dad-abfd-237586a788ca admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:27.463988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f8215-21f1-4dad-abfd-237586a788ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:27.464189 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f8215-21f1-4dad-abfd-237586a788ca admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:27.464886 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f8215-21f1-4dad-abfd-237586a788ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:27.466746 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f8215-21f1-4dad-abfd-237586a788ca admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:27.483522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1098/2192] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:27.487245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f8215-21f1-4dad-abfd-237586a788ca admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:27.489242 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-425f8215-21f1-4dad-abfd-237586a788ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:27.505491 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f8215-21f1-4dad-abfd-237586a788ca admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:27.513958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd7e06-8ef3-46d2-9474-72db8ac653bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:27.514778 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd7e06-8ef3-46d2-9474-72db8ac653bf admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:27.515123 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd7e06-8ef3-46d2-9474-72db8ac653bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:27.515491 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd7e06-8ef3-46d2-9474-72db8ac653bf admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:27.516738 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd7e06-8ef3-46d2-9474-72db8ac653bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:27.518408 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd7e06-8ef3-46d2-9474-72db8ac653bf admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:27.537449 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1099/2193] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:27.541707 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd7e06-8ef3-46d2-9474-72db8ac653bf admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:27.558236 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd7e06-8ef3-46d2-9474-72db8ac653bf admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:27.568010 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1095/2194] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:27.569839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9081ba-a239-4d34-bfff-e909d0835af0 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:27.570854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9081ba-a239-4d34-bfff-e909d0835af0 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:27.571515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9081ba-a239-4d34-bfff-e909d0835af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:27.571654 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc566b20-b5c3-425d-8059-7fd490c23c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:27.574172 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc566b20-b5c3-425d-8059-7fd490c23c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:27.574468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc566b20-b5c3-425d-8059-7fd490c23c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:27.575217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc566b20-b5c3-425d-8059-7fd490c23c1c admin admin] PATH_INFO: `/v3/projects/8d59eb54e5244996b5a4e5413ad0d36c/users/6a755e07d2e7415685443009051638c6/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:27.597108 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-6a9081ba-a239-4d34-bfff-e909d0835af0 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:27.598559 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-6a9081ba-a239-4d34-bfff-e909d0835af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:27.599337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc566b20-b5c3-425d-8059-7fd490c23c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d59eb54e5244996b5a4e5413ad0d36c, user_id=6a755e07d2e7415685443009051638c6, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:27.602606 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc566b20-b5c3-425d-8059-7fd490c23c1c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:27.607909 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1096/2195] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:49:27.612515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9081ba-a239-4d34-bfff-e909d0835af0 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:27.619867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1100/2196] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:27 2022] PUT /identity/v3/projects/8d59eb54e5244996b5a4e5413ad0d36c/users/6a755e07d2e7415685443009051638c6/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:27.626092 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9081ba-a239-4d34-bfff-e909d0835af0 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:27.630065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a6d3f-b109-483c-bfa1-a6e29069d66d None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:27.630376 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a6d3f-b109-483c-bfa1-a6e29069d66d None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:27.630646 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a6d3f-b109-483c-bfa1-a6e29069d66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:27.669162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-758a6d3f-b109-483c-bfa1-a6e29069d66d None None] MFA Rules not processed for user `6a755e07d2e7415685443009051638c6`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:27.672056 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-758a6d3f-b109-483c-bfa1-a6e29069d66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:27.685234 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:27.700693 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:27.712445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70763aa5-0ab9-4d93-bf55-39784fc71d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:27.713666 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70763aa5-0ab9-4d93-bf55-39784fc71d26 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:27.714507 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70763aa5-0ab9-4d93-bf55-39784fc71d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:27.714796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70763aa5-0ab9-4d93-bf55-39784fc71d26 admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:27.715659 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70763aa5-0ab9-4d93-bf55-39784fc71d26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:49:27.716054 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70763aa5-0ab9-4d93-bf55-39784fc71d26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:27.718958 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70763aa5-0ab9-4d93-bf55-39784fc71d26 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:27.740508 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1097/2197] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:49:27.741699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70763aa5-0ab9-4d93-bf55-39784fc71d26 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:27.754914 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70763aa5-0ab9-4d93-bf55-39784fc71d26 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:27.761185 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea80938-6d85-40bd-bef3-f7f6e00c7826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:27.761979 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea80938-6d85-40bd-bef3-f7f6e00c7826 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:27.762447 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea80938-6d85-40bd-bef3-f7f6e00c7826 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:27.762735 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea80938-6d85-40bd-bef3-f7f6e00c7826 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:27.763535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea80938-6d85-40bd-bef3-f7f6e00c7826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:27.765174 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1101/2198] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:49:27.765720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea80938-6d85-40bd-bef3-f7f6e00c7826 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:27.778998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a6d3f-b109-483c-bfa1-a6e29069d66d None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:27.780468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-758a6d3f-b109-483c-bfa1-a6e29069d66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:27.806170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1098/2199] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:27 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:27.807310 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea80938-6d85-40bd-bef3-f7f6e00c7826 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:27.912225 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea80938-6d85-40bd-bef3-f7f6e00c7826 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:27.921953 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082deee-3f86-4d28-839e-21248dcc0985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:27.922970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082deee-3f86-4d28-839e-21248dcc0985 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:27.923481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082deee-3f86-4d28-839e-21248dcc0985 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:27.923931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082deee-3f86-4d28-839e-21248dcc0985 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:27.925336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082deee-3f86-4d28-839e-21248dcc0985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:27.927781 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1082deee-3f86-4d28-839e-21248dcc0985 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:27.940089 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a6d3f-b109-483c-bfa1-a6e29069d66d None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:27.957719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1099/2200] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:27 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:49:27.958671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082deee-3f86-4d28-839e-21248dcc0985 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:27.962296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-1082deee-3f86-4d28-839e-21248dcc0985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:27.977798 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082deee-3f86-4d28-839e-21248dcc0985 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:27.983061 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a437c-0b83-4581-a60a-b1551ad872d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:27.984077 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a437c-0b83-4581-a60a-b1551ad872d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:27.984411 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a437c-0b83-4581-a60a-b1551ad872d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:27.984939 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a437c-0b83-4581-a60a-b1551ad872d8 admin admin] PATH_INFO: `/v3/projects/f057d55e25af49ad94ed42033d591442` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:27.986294 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a437c-0b83-4581-a60a-b1551ad872d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f057d55e25af49ad94ed42033d591442)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:27.988574 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a437c-0b83-4581-a60a-b1551ad872d8 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:28.005249 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e547a9b-4a07-499e-ab57-66f4d1a4f3df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d9a41e10cb64ee9972debaf856503d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:28.006266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e547a9b-4a07-499e-ab57-66f4d1a4f3df service glance] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:28.006848 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e547a9b-4a07-499e-ab57-66f4d1a4f3df service glance] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:28.007429 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e547a9b-4a07-499e-ab57-66f4d1a4f3df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:28.048684 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-791a437c-0b83-4581-a60a-b1551ad872d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f057d55e25af49ad94ed42033d591442', 'request_id': 'req-791a437c-0b83-4581-a60a-b1551ad872d8'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:28.060002 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-791a437c-0b83-4581-a60a-b1551ad872d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f057d55e25af49ad94ed42033d591442', 'request_id': 'req-791a437c-0b83-4581-a60a-b1551ad872d8'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:28.068677 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-791a437c-0b83-4581-a60a-b1551ad872d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f057d55e25af49ad94ed42033d591442', 'request_id': 'req-791a437c-0b83-4581-a60a-b1551ad872d8'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:28.091290 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-791a437c-0b83-4581-a60a-b1551ad872d8 admin admin] The token cache is being invalidate because project f057d55e25af49ad94ed42033d591442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:28.091499 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-791a437c-0b83-4581-a60a-b1551ad872d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:28.092170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-791a437c-0b83-4581-a60a-b1551ad872d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:28.097002 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1100/2201] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:27 2022] DELETE /identity/v3/projects/f057d55e25af49ad94ed42033d591442 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:28.097002 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a437c-0b83-4581-a60a-b1551ad872d8 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:28.097240 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e547a9b-4a07-499e-ab57-66f4d1a4f3df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:28.097326 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-791a437c-0b83-4581-a60a-b1551ad872d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:28.097400 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e547a9b-4a07-499e-ab57-66f4d1a4f3df service glance] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:28.108131 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1102/2202] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:27 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:28.109702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc7d8b-00e8-453a-82ed-852817ece900 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:28.109997 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc7d8b-00e8-453a-82ed-852817ece900 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:28.110274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc7d8b-00e8-453a-82ed-852817ece900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:28.129203 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-33dc7d8b-00e8-453a-82ed-852817ece900 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:28.130412 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-33dc7d8b-00e8-453a-82ed-852817ece900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:28.136620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:28.147441 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:28.213157 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a437c-0b83-4581-a60a-b1551ad872d8 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:28.219162 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f6563-4d47-42ec-a83f-695af677c31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:28.220775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f6563-4d47-42ec-a83f-695af677c31e admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:28.221350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f6563-4d47-42ec-a83f-695af677c31e admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:28.221818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f6563-4d47-42ec-a83f-695af677c31e admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:28.223184 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f6563-4d47-42ec-a83f-695af677c31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:28.224931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f6563-4d47-42ec-a83f-695af677c31e admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:28.239059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1101/2203] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:28.247396 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f6563-4d47-42ec-a83f-695af677c31e admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:28.259161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1103/2204] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:28.259874 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f6563-4d47-42ec-a83f-695af677c31e admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:28.261596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e5bab-be81-40ac-b829-e954ed4f34bf None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:28.263383 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e5bab-be81-40ac-b829-e954ed4f34bf None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:28.263860 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e5bab-be81-40ac-b829-e954ed4f34bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:28.265014 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13367ad3-9b74-4b17-bc2b-8dddaaf18584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:28.266027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13367ad3-9b74-4b17-bc2b-8dddaaf18584 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:28.266694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13367ad3-9b74-4b17-bc2b-8dddaaf18584 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:28.266694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13367ad3-9b74-4b17-bc2b-8dddaaf18584 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:28.268314 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13367ad3-9b74-4b17-bc2b-8dddaaf18584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:28.270202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13367ad3-9b74-4b17-bc2b-8dddaaf18584 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:28.287684 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1102/2205] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:49:28.288651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13367ad3-9b74-4b17-bc2b-8dddaaf18584 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:28.293334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-608e5bab-be81-40ac-b829-e954ed4f34bf None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:28.294928 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-608e5bab-be81-40ac-b829-e954ed4f34bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:28.300396 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13367ad3-9b74-4b17-bc2b-8dddaaf18584 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:28.307221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc647d-6301-4b40-bba9-e72505ff6dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:28.308216 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc647d-6301-4b40-bba9-e72505ff6dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:28.308571 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc647d-6301-4b40-bba9-e72505ff6dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:28.308947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc647d-6301-4b40-bba9-e72505ff6dbe admin admin] PATH_INFO: `/v3/projects/b746389b41884c7b9fd3237221d2b35d/users/6962bd696d6a480fa1b268addd906a27/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:28.321722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1104/2206] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:28.326003 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e5bab-be81-40ac-b829-e954ed4f34bf None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:28.329843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc647d-6301-4b40-bba9-e72505ff6dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b746389b41884c7b9fd3237221d2b35d, user_id=6962bd696d6a480fa1b268addd906a27, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:28.332620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc647d-6301-4b40-bba9-e72505ff6dbe admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:28.342372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e5bab-be81-40ac-b829-e954ed4f34bf None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:28.350130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1103/2207] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:28 2022] PUT /identity/v3/projects/b746389b41884c7b9fd3237221d2b35d/users/6962bd696d6a480fa1b268addd906a27/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:28.362669 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683b434-0197-4aaf-a1b8-463b37c84c50 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:28.362669 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683b434-0197-4aaf-a1b8-463b37c84c50 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:28.363018 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683b434-0197-4aaf-a1b8-463b37c84c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:28.407520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-9683b434-0197-4aaf-a1b8-463b37c84c50 None None] MFA Rules not processed for user `6962bd696d6a480fa1b268addd906a27`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:28.408963 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9683b434-0197-4aaf-a1b8-463b37c84c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:28.442383 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5079eef-1cd0-42ed-a157-d2e882fa4ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:28.443646 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5079eef-1cd0-42ed-a157-d2e882fa4ebe admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:28.444147 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5079eef-1cd0-42ed-a157-d2e882fa4ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:28.445350 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5079eef-1cd0-42ed-a157-d2e882fa4ebe admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:28.446365 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5079eef-1cd0-42ed-a157-d2e882fa4ebe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:49:28.446888 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5079eef-1cd0-42ed-a157-d2e882fa4ebe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:28.448771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5079eef-1cd0-42ed-a157-d2e882fa4ebe admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:28.465025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1105/2208] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:49:28.470097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5079eef-1cd0-42ed-a157-d2e882fa4ebe admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:28.483390 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5079eef-1cd0-42ed-a157-d2e882fa4ebe admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:28.488519 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f7bb6-4d93-4612-bab9-420ccf4343be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:28.489290 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f7bb6-4d93-4612-bab9-420ccf4343be admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:28.489633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f7bb6-4d93-4612-bab9-420ccf4343be admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:28.489991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f7bb6-4d93-4612-bab9-420ccf4343be admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:28.490779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f7bb6-4d93-4612-bab9-420ccf4343be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:28.493448 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f7bb6-4d93-4612-bab9-420ccf4343be admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:28.531245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1106/2209] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:28 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:28.536127 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f7bb6-4d93-4612-bab9-420ccf4343be admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:28.539463 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1104/2210] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:28.544768 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683b434-0197-4aaf-a1b8-463b37c84c50 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:28.579502 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683b434-0197-4aaf-a1b8-463b37c84c50 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:28.655975 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f7bb6-4d93-4612-bab9-420ccf4343be admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:28.669297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e30f58-bdda-4397-a1fb-499176abd4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:28.673714 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e30f58-bdda-4397-a1fb-499176abd4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:28.675296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e30f58-bdda-4397-a1fb-499176abd4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:28.677165 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e30f58-bdda-4397-a1fb-499176abd4b1 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:28.678760 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e30f58-bdda-4397-a1fb-499176abd4b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:28.684038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e30f58-bdda-4397-a1fb-499176abd4b1 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:28.731105 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98473ec9-e475-4faa-b873-ef1b293ecfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:28.732465 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98473ec9-e475-4faa-b873-ef1b293ecfcc admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:28.732756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98473ec9-e475-4faa-b873-ef1b293ecfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:28.733025 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98473ec9-e475-4faa-b873-ef1b293ecfcc admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:28.733726 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98473ec9-e475-4faa-b873-ef1b293ecfcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:28.735711 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98473ec9-e475-4faa-b873-ef1b293ecfcc admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:28.738289 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1107/2211] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:28 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:49:28.742767 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e30f58-bdda-4397-a1fb-499176abd4b1 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:28.761114 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e30f58-bdda-4397-a1fb-499176abd4b1 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:28.769738 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8d1d3-d381-497d-a30e-5f5b22404f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:28.770414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8d1d3-d381-497d-a30e-5f5b22404f42 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:28.770725 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8d1d3-d381-497d-a30e-5f5b22404f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:28.771993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8d1d3-d381-497d-a30e-5f5b22404f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:28.773351 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8d1d3-d381-497d-a30e-5f5b22404f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:28.777019 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8d1d3-d381-497d-a30e-5f5b22404f42 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:28.777770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:28.797735 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1108/2212] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:49:28.798982 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8d1d3-d381-497d-a30e-5f5b22404f42 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:28.799785 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1105/2213] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:28 2022] POST /identity/v3/projects => generated 381 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:28.804100 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98473ec9-e475-4faa-b873-ef1b293ecfcc admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:28.821036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8d1d3-d381-497d-a30e-5f5b22404f42 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:28.825596 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:28.925642 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a80b0-2b5b-4b5b-bc7a-863744ebd779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:28.926329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a80b0-2b5b-4b5b-bc7a-863744ebd779 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:28.926616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a80b0-2b5b-4b5b-bc7a-863744ebd779 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:28.926950 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a80b0-2b5b-4b5b-bc7a-863744ebd779 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:28.927834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a80b0-2b5b-4b5b-bc7a-863744ebd779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:28.929938 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a80b0-2b5b-4b5b-bc7a-863744ebd779 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:28.944203 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1109/2214] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:28.949311 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a80b0-2b5b-4b5b-bc7a-863744ebd779 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:28.965267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a80b0-2b5b-4b5b-bc7a-863744ebd779 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:28.971760 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf4e66-1f17-4ca1-97b4-cd69742c8ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:28.973652 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf4e66-1f17-4ca1-97b4-cd69742c8ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:28.973866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf4e66-1f17-4ca1-97b4-cd69742c8ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:28.974198 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf4e66-1f17-4ca1-97b4-cd69742c8ec7 admin admin] PATH_INFO: `/v3/projects/aee1381dcc5f4adba324cd47cdf53e47/users/5225dd865c9a4fbf8fb6cd6c7df9aea7/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:28.982834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98473ec9-e475-4faa-b873-ef1b293ecfcc admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:28.999999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dbb17-2197-4424-b4b8-cf59de24314b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:29.000707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dbb17-2197-4424-b4b8-cf59de24314b admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:29.001046 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dbb17-2197-4424-b4b8-cf59de24314b admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:29.001331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dbb17-2197-4424-b4b8-cf59de24314b admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:29.002048 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953dbb17-2197-4424-b4b8-cf59de24314b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:29.004081 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953dbb17-2197-4424-b4b8-cf59de24314b admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:29.013983 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf4e66-1f17-4ca1-97b4-cd69742c8ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee1381dcc5f4adba324cd47cdf53e47, user_id=5225dd865c9a4fbf8fb6cd6c7df9aea7, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:29.018026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf4e66-1f17-4ca1-97b4-cd69742c8ec7 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:29.031323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1106/2215] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:28 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:49:29.032561 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dbb17-2197-4424-b4b8-cf59de24314b admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:29.035332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1110/2216] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:28 2022] PUT /identity/v3/projects/aee1381dcc5f4adba324cd47cdf53e47/users/5225dd865c9a4fbf8fb6cd6c7df9aea7/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:29.044360 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6f4b1-b97d-478a-b0cd-19ec388be44a None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:29.044544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dbb17-2197-4424-b4b8-cf59de24314b admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:29.044631 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6f4b1-b97d-478a-b0cd-19ec388be44a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:29.045079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6f4b1-b97d-478a-b0cd-19ec388be44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:29.078391 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-84e6f4b1-b97d-478a-b0cd-19ec388be44a None None] MFA Rules not processed for user `5225dd865c9a4fbf8fb6cd6c7df9aea7`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:29.079666 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-84e6f4b1-b97d-478a-b0cd-19ec388be44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:29.115192 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3b36c-8da3-46f2-a467-edeaba6f66e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:29.116109 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3b36c-8da3-46f2-a467-edeaba6f66e9 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:29.116393 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3b36c-8da3-46f2-a467-edeaba6f66e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:29.116672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3b36c-8da3-46f2-a467-edeaba6f66e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:29.118103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3b36c-8da3-46f2-a467-edeaba6f66e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:29.119869 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3b36c-8da3-46f2-a467-edeaba6f66e9 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:29.135537 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1107/2217] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:29.139551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3b36c-8da3-46f2-a467-edeaba6f66e9 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:29.150586 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3b36c-8da3-46f2-a467-edeaba6f66e9 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:29.154667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1111/2218] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:29.157246 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce286f-759b-4b43-806b-e8a56f2b3716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:29.158478 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce286f-759b-4b43-806b-e8a56f2b3716 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:29.158921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce286f-759b-4b43-806b-e8a56f2b3716 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:29.159382 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce286f-759b-4b43-806b-e8a56f2b3716 admin admin] PATH_INFO: `/v3/projects/204efe3b38004694a3342ee5ff636894/users/b4cfd2d41f284f598bf1eeabbe5cf8d5/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:29.161098 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6f4b1-b97d-478a-b0cd-19ec388be44a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:29.191835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce286f-759b-4b43-806b-e8a56f2b3716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=204efe3b38004694a3342ee5ff636894, user_id=b4cfd2d41f284f598bf1eeabbe5cf8d5, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:29.193859 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e6f4b1-b97d-478a-b0cd-19ec388be44a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:29.194993 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce286f-759b-4b43-806b-e8a56f2b3716 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:29.202746 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f007a-3f29-4fff-85d6-ff0492fa3b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:29.207340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f007a-3f29-4fff-85d6-ff0492fa3b79 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:29.208120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f007a-3f29-4fff-85d6-ff0492fa3b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:29.208687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f007a-3f29-4fff-85d6-ff0492fa3b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:29.209613 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f007a-3f29-4fff-85d6-ff0492fa3b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:29.212795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f007a-3f29-4fff-85d6-ff0492fa3b79 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:29.215128 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1108/2219] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:29 2022] PUT /identity/v3/projects/204efe3b38004694a3342ee5ff636894/users/b4cfd2d41f284f598bf1eeabbe5cf8d5/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:29.216378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce286f-759b-4b43-806b-e8a56f2b3716 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:29.272665 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1112/2220] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:29 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:29.273996 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f007a-3f29-4fff-85d6-ff0492fa3b79 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:29.355329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:29.366091 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce286f-759b-4b43-806b-e8a56f2b3716 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:29.390939 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:29.400192 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f007a-3f29-4fff-85d6-ff0492fa3b79 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:29.406599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfb661-3fc2-4a75-9607-9492078f0ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:29.407900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfb661-3fc2-4a75-9607-9492078f0ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:29.408193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfb661-3fc2-4a75-9607-9492078f0ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:29.408478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfb661-3fc2-4a75-9607-9492078f0ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:29.409194 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfb661-3fc2-4a75-9607-9492078f0ce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:29.412301 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfb661-3fc2-4a75-9607-9492078f0ce7 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:29.444497 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1113/2221] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:29 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:29.446360 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfb661-3fc2-4a75-9607-9492078f0ce7 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:29.453029 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfd536-e5ec-4eab-9660-e77e6fe36d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:29.454189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfd536-e5ec-4eab-9660-e77e6fe36d22 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:29.454885 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfd536-e5ec-4eab-9660-e77e6fe36d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:29.455194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfd536-e5ec-4eab-9660-e77e6fe36d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:29.455992 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfd536-e5ec-4eab-9660-e77e6fe36d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:29.458158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edfd536-e5ec-4eab-9660-e77e6fe36d22 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:29.460707 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfb661-3fc2-4a75-9607-9492078f0ce7 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:29.466362 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b38d2d-6bd6-4753-9ad0-421dea2c9c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:29.467398 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b38d2d-6bd6-4753-9ad0-421dea2c9c58 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:29.467879 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b38d2d-6bd6-4753-9ad0-421dea2c9c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:29.468339 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b38d2d-6bd6-4753-9ad0-421dea2c9c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:29.471359 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1109/2222] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:29.472467 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b38d2d-6bd6-4753-9ad0-421dea2c9c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:29.474280 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b38d2d-6bd6-4753-9ad0-421dea2c9c58 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:29.475870 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfd536-e5ec-4eab-9660-e77e6fe36d22 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:29.491548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfd536-e5ec-4eab-9660-e77e6fe36d22 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:29.492702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1114/2223] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:29.493826 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b38d2d-6bd6-4753-9ad0-421dea2c9c58 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:29.494970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a9dc5-1ac7-4051-ae69-257572686c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:29.496036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a9dc5-1ac7-4051-ae69-257572686c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:29.496324 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a9dc5-1ac7-4051-ae69-257572686c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:29.496605 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a9dc5-1ac7-4051-ae69-257572686c5e admin admin] PATH_INFO: `/v3/projects/204efe3b38004694a3342ee5ff636894/users/b4cfd2d41f284f598bf1eeabbe5cf8d5/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:29.498677 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a9dc5-1ac7-4051-ae69-257572686c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=204efe3b38004694a3342ee5ff636894, user_id=b4cfd2d41f284f598bf1eeabbe5cf8d5, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:29.501385 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a9dc5-1ac7-4051-ae69-257572686c5e admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:29.506020 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b38d2d-6bd6-4753-9ad0-421dea2c9c58 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:29.512865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1110/2224] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:29 2022] PUT /identity/v3/projects/204efe3b38004694a3342ee5ff636894/users/b4cfd2d41f284f598bf1eeabbe5cf8d5/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:29.524539 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08134c-08a2-4978-83d3-3fe71f0df396 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:29.524904 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08134c-08a2-4978-83d3-3fe71f0df396 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:29.525273 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08134c-08a2-4978-83d3-3fe71f0df396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:29.556618 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-5d08134c-08a2-4978-83d3-3fe71f0df396 None None] MFA Rules not processed for user `b4cfd2d41f284f598bf1eeabbe5cf8d5`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:29.558005 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-5d08134c-08a2-4978-83d3-3fe71f0df396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:29.595949 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246b7d7-ed91-4816-84e6-4d1647d1933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:29.596977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246b7d7-ed91-4816-84e6-4d1647d1933a admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:29.597267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246b7d7-ed91-4816-84e6-4d1647d1933a admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:29.597545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246b7d7-ed91-4816-84e6-4d1647d1933a admin admin] PATH_INFO: `/v3/projects/44bc732634734ee59046afaf6142ea32/users/7399ac9db2874b42bf3aceb1e197f4f3/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:29.637381 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246b7d7-ed91-4816-84e6-4d1647d1933a admin admin] RBAC: Authorizing `identity:create_grant(project_id=44bc732634734ee59046afaf6142ea32, user_id=7399ac9db2874b42bf3aceb1e197f4f3, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:29.647230 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246b7d7-ed91-4816-84e6-4d1647d1933a admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:29.672020 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1111/2225] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:29.683299 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1115/2226] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:29 2022] PUT /identity/v3/projects/44bc732634734ee59046afaf6142ea32/users/7399ac9db2874b42bf3aceb1e197f4f3/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:29.687252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246b7d7-ed91-4816-84e6-4d1647d1933a admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:29.687529 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08134c-08a2-4978-83d3-3fe71f0df396 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:29.690369 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-5d08134c-08a2-4978-83d3-3fe71f0df396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:29.794940 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08134c-08a2-4978-83d3-3fe71f0df396 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:29.841777 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246b7d7-ed91-4816-84e6-4d1647d1933a admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:29.849142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb647791-00ea-4e9a-ae66-c869fca7a1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:29.850265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb647791-00ea-4e9a-ae66-c869fca7a1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:29.850799 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb647791-00ea-4e9a-ae66-c869fca7a1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:29.851154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb647791-00ea-4e9a-ae66-c869fca7a1b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:29.852103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb647791-00ea-4e9a-ae66-c869fca7a1b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:29.853747 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb647791-00ea-4e9a-ae66-c869fca7a1b0 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:29.868632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1116/2227] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:29.869130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:29.875240 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb647791-00ea-4e9a-ae66-c869fca7a1b0 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:29.914894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e5c00-102f-4827-a280-ef2e775c389c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:29.915768 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e5c00-102f-4827-a280-ef2e775c389c service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:29.916046 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb647791-00ea-4e9a-ae66-c869fca7a1b0 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:29.919251 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e5c00-102f-4827-a280-ef2e775c389c service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:29.919612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e5c00-102f-4827-a280-ef2e775c389c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:29.926464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b73a8f-9d2c-45d6-8180-2df8c0d2a1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:29.927475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b73a8f-9d2c-45d6-8180-2df8c0d2a1f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:29.927758 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b73a8f-9d2c-45d6-8180-2df8c0d2a1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:29.928033 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b73a8f-9d2c-45d6-8180-2df8c0d2a1f7 admin admin] PATH_INFO: `/v3/projects/44bc732634734ee59046afaf6142ea32/users/7399ac9db2874b42bf3aceb1e197f4f3/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:29.930771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b73a8f-9d2c-45d6-8180-2df8c0d2a1f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44bc732634734ee59046afaf6142ea32, user_id=7399ac9db2874b42bf3aceb1e197f4f3, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:29.933962 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b73a8f-9d2c-45d6-8180-2df8c0d2a1f7 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:29.951906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1117/2228] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:29 2022] PUT /identity/v3/projects/44bc732634734ee59046afaf6142ea32/users/7399ac9db2874b42bf3aceb1e197f4f3/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:29.964436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8656c6c-8085-4e5e-b5f0-6d966c15a9a3 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:29.964756 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8656c6c-8085-4e5e-b5f0-6d966c15a9a3 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:29.965018 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8656c6c-8085-4e5e-b5f0-6d966c15a9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:30.023316 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-d8656c6c-8085-4e5e-b5f0-6d966c15a9a3 None None] MFA Rules not processed for user `7399ac9db2874b42bf3aceb1e197f4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:30.024974 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d8656c6c-8085-4e5e-b5f0-6d966c15a9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:30.036846 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e5c00-102f-4827-a280-ef2e775c389c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:30.038564 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:30.040064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e5c00-102f-4827-a280-ef2e775c389c service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:30.062693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1112/2229] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:30.152016 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1118/2230] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:49:30.181453 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e5c00-102f-4827-a280-ef2e775c389c service cinder] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:30.190728 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e5c00-102f-4827-a280-ef2e775c389c service cinder] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:30.256544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42884709-92dd-4a0a-b26b-62ef3eb6d00a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:30.257203 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42884709-92dd-4a0a-b26b-62ef3eb6d00a service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:30.257484 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42884709-92dd-4a0a-b26b-62ef3eb6d00a service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:30.257782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42884709-92dd-4a0a-b26b-62ef3eb6d00a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:30.329195 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42884709-92dd-4a0a-b26b-62ef3eb6d00a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:30.330678 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42884709-92dd-4a0a-b26b-62ef3eb6d00a service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:30.341811 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1113/2231] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:30.424429 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8656c6c-8085-4e5e-b5f0-6d966c15a9a3 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:30.424429 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d8656c6c-8085-4e5e-b5f0-6d966c15a9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:30.543187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8656c6c-8085-4e5e-b5f0-6d966c15a9a3 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:30.564750 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502da032-aa94-4a9a-af46-2c2323eb7c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:30.564750 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502da032-aa94-4a9a-af46-2c2323eb7c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:30.564750 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502da032-aa94-4a9a-af46-2c2323eb7c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:30.564750 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502da032-aa94-4a9a-af46-2c2323eb7c9b admin admin] PATH_INFO: `/v3/users/2eddc6b1a64c42e482fed95b6a8c58ed` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:30.566574 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502da032-aa94-4a9a-af46-2c2323eb7c9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eddc6b1a64c42e482fed95b6a8c58ed)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:30.568747 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502da032-aa94-4a9a-af46-2c2323eb7c9b admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:30.656378 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-502da032-aa94-4a9a-af46-2c2323eb7c9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eddc6b1a64c42e482fed95b6a8c58ed'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:30.668613 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-502da032-aa94-4a9a-af46-2c2323eb7c9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eddc6b1a64c42e482fed95b6a8c58ed'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:30.687092 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-502da032-aa94-4a9a-af46-2c2323eb7c9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eddc6b1a64c42e482fed95b6a8c58ed'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:30.703545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-502da032-aa94-4a9a-af46-2c2323eb7c9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eddc6b1a64c42e482fed95b6a8c58ed'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:30.704625 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-502da032-aa94-4a9a-af46-2c2323eb7c9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eddc6b1a64c42e482fed95b6a8c58ed'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:30.714395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1119/2232] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:30 2022] DELETE /identity/v3/users/2eddc6b1a64c42e482fed95b6a8c58ed => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:30.718876 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392012b-c57c-4a62-ab80-cb535fc76891 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:30.719166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392012b-c57c-4a62-ab80-cb535fc76891 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:30.719485 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392012b-c57c-4a62-ab80-cb535fc76891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:30.745481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-8392012b-c57c-4a62-ab80-cb535fc76891 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:30.746896 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-8392012b-c57c-4a62-ab80-cb535fc76891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:30.836479 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:30.857232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502da032-aa94-4a9a-af46-2c2323eb7c9b admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:30.858651 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-502da032-aa94-4a9a-af46-2c2323eb7c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:30.865793 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1114/2233] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:30.874080 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502da032-aa94-4a9a-af46-2c2323eb7c9b admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:30.879010 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392012b-c57c-4a62-ab80-cb535fc76891 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:30.880206 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f987efe-87da-492d-b3a8-6294c030b399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:30.881093 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f987efe-87da-492d-b3a8-6294c030b399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:30.881407 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f987efe-87da-492d-b3a8-6294c030b399 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:30.881737 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f987efe-87da-492d-b3a8-6294c030b399 admin admin] PATH_INFO: `/v3/users/6962bd696d6a480fa1b268addd906a27` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:30.883617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f987efe-87da-492d-b3a8-6294c030b399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6962bd696d6a480fa1b268addd906a27)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:30.884141 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-8392012b-c57c-4a62-ab80-cb535fc76891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:30.885864 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f987efe-87da-492d-b3a8-6294c030b399 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:30.915015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:30.953747 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2f987efe-87da-492d-b3a8-6294c030b399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6962bd696d6a480fa1b268addd906a27'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:30.960903 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392012b-c57c-4a62-ab80-cb535fc76891 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:30.962295 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2f987efe-87da-492d-b3a8-6294c030b399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6962bd696d6a480fa1b268addd906a27'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:30.966922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a62203-89cb-43f5-b13d-f294a59990bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:30.967803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a62203-89cb-43f5-b13d-f294a59990bf service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:30.968163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a62203-89cb-43f5-b13d-f294a59990bf service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:30.968634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a62203-89cb-43f5-b13d-f294a59990bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:30.980896 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a62203-89cb-43f5-b13d-f294a59990bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:30.983991 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a62203-89cb-43f5-b13d-f294a59990bf service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:30.992805 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2f987efe-87da-492d-b3a8-6294c030b399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6962bd696d6a480fa1b268addd906a27'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:30.997836 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1115/2234] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:49:31.003731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2f987efe-87da-492d-b3a8-6294c030b399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6962bd696d6a480fa1b268addd906a27'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:31.004585 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2f987efe-87da-492d-b3a8-6294c030b399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6962bd696d6a480fa1b268addd906a27'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:31.011901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1120/2235] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:30 2022] DELETE /identity/v3/users/6962bd696d6a480fa1b268addd906a27 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:31.018712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18415-f80b-49da-b7bf-2ca345e43c5c None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:31.019041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18415-f80b-49da-b7bf-2ca345e43c5c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:31.019359 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18415-f80b-49da-b7bf-2ca345e43c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:31.049976 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-67f18415-f80b-49da-b7bf-2ca345e43c5c None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:31.051444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-67f18415-f80b-49da-b7bf-2ca345e43c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:31.125298 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1116/2236] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:31.135635 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f987efe-87da-492d-b3a8-6294c030b399 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:31.137192 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-2f987efe-87da-492d-b3a8-6294c030b399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:31.200241 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f987efe-87da-492d-b3a8-6294c030b399 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:31.204299 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9096b-cc9a-4a29-84b3-3a7aaf22d798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:31.205012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9096b-cc9a-4a29-84b3-3a7aaf22d798 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:31.205303 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9096b-cc9a-4a29-84b3-3a7aaf22d798 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:31.206613 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9096b-cc9a-4a29-84b3-3a7aaf22d798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:31.219648 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9096b-cc9a-4a29-84b3-3a7aaf22d798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:31.221218 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9096b-cc9a-4a29-84b3-3a7aaf22d798 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:31.232094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1121/2237] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:31.419843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f18415-f80b-49da-b7bf-2ca345e43c5c None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:31.421949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-67f18415-f80b-49da-b7bf-2ca345e43c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:31.436625 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f18415-f80b-49da-b7bf-2ca345e43c5c None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:31.456542 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dde2cf-a96f-4ccf-a0b2-62ff88a4a11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:31.457405 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dde2cf-a96f-4ccf-a0b2-62ff88a4a11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:31.458365 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dde2cf-a96f-4ccf-a0b2-62ff88a4a11e admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:31.458713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dde2cf-a96f-4ccf-a0b2-62ff88a4a11e admin admin] PATH_INFO: `/v3/projects/79af921d2c884570b3d055afdfdc152b` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:31.460209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dde2cf-a96f-4ccf-a0b2-62ff88a4a11e admin admin] RBAC: Authorizing `identity:delete_project(project_id=79af921d2c884570b3d055afdfdc152b)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:31.462744 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dde2cf-a96f-4ccf-a0b2-62ff88a4a11e admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:31.521374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-93dde2cf-a96f-4ccf-a0b2-62ff88a4a11e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79af921d2c884570b3d055afdfdc152b', 'request_id': 'req-93dde2cf-a96f-4ccf-a0b2-62ff88a4a11e'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:31.532720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-93dde2cf-a96f-4ccf-a0b2-62ff88a4a11e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79af921d2c884570b3d055afdfdc152b', 'request_id': 'req-93dde2cf-a96f-4ccf-a0b2-62ff88a4a11e'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:31.539467 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-93dde2cf-a96f-4ccf-a0b2-62ff88a4a11e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79af921d2c884570b3d055afdfdc152b', 'request_id': 'req-93dde2cf-a96f-4ccf-a0b2-62ff88a4a11e'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:31.550751 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-93dde2cf-a96f-4ccf-a0b2-62ff88a4a11e admin admin] The token cache is being invalidate because project 79af921d2c884570b3d055afdfdc152b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:31.551050 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-93dde2cf-a96f-4ccf-a0b2-62ff88a4a11e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:31.552368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-93dde2cf-a96f-4ccf-a0b2-62ff88a4a11e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:31.554188 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1117/2238] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:31 2022] DELETE /identity/v3/projects/79af921d2c884570b3d055afdfdc152b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:31.559171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b36a1-856a-4a24-b8d7-03b557b26d4a None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:31.561433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b36a1-856a-4a24-b8d7-03b557b26d4a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:31.561433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b36a1-856a-4a24-b8d7-03b557b26d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:31.586955 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-ea2b36a1-856a-4a24-b8d7-03b557b26d4a None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:31.588219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ea2b36a1-856a-4a24-b8d7-03b557b26d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:31.623484 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dde2cf-a96f-4ccf-a0b2-62ff88a4a11e admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:31.625542 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-93dde2cf-a96f-4ccf-a0b2-62ff88a4a11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:31.647395 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:31.689330 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1122/2239] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:31.699490 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24338e55-1398-4eec-a7f4-9d73d5c4e7dd None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:31.700659 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24338e55-1398-4eec-a7f4-9d73d5c4e7dd None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:31.700952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24338e55-1398-4eec-a7f4-9d73d5c4e7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:31.731172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dde2cf-a96f-4ccf-a0b2-62ff88a4a11e admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:31.736679 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07047c93-9a2a-4c83-a9f8-824d4470fa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:31.737537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-24338e55-1398-4eec-a7f4-9d73d5c4e7dd None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:31.737654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07047c93-9a2a-4c83-a9f8-824d4470fa54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:31.737838 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07047c93-9a2a-4c83-a9f8-824d4470fa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:31.738114 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07047c93-9a2a-4c83-a9f8-824d4470fa54 admin admin] PATH_INFO: `/v3/projects/b746389b41884c7b9fd3237221d2b35d` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:31.739193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-24338e55-1398-4eec-a7f4-9d73d5c4e7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:31.739516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07047c93-9a2a-4c83-a9f8-824d4470fa54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b746389b41884c7b9fd3237221d2b35d)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:31.741620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07047c93-9a2a-4c83-a9f8-824d4470fa54 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:31.750114 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1123/2240] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:31.754503 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24338e55-1398-4eec-a7f4-9d73d5c4e7dd None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:31.771071 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24338e55-1398-4eec-a7f4-9d73d5c4e7dd None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:31.777407 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3e4d8-d8b9-4c29-b3ed-ddf50b756087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:31.778101 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3e4d8-d8b9-4c29-b3ed-ddf50b756087 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:31.778405 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3e4d8-d8b9-4c29-b3ed-ddf50b756087 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:31.778679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3e4d8-d8b9-4c29-b3ed-ddf50b756087 admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:31.779459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3e4d8-d8b9-4c29-b3ed-ddf50b756087 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:49:31.779775 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3e4d8-d8b9-4c29-b3ed-ddf50b756087 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:31.781404 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3e4d8-d8b9-4c29-b3ed-ddf50b756087 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:31.794521 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1124/2241] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:49:31.797647 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-07047c93-9a2a-4c83-a9f8-824d4470fa54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b746389b41884c7b9fd3237221d2b35d', 'request_id': 'req-07047c93-9a2a-4c83-a9f8-824d4470fa54'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:31.799063 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3e4d8-d8b9-4c29-b3ed-ddf50b756087 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:31.806964 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-07047c93-9a2a-4c83-a9f8-824d4470fa54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b746389b41884c7b9fd3237221d2b35d', 'request_id': 'req-07047c93-9a2a-4c83-a9f8-824d4470fa54'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:31.813008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3e4d8-d8b9-4c29-b3ed-ddf50b756087 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:31.813327 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-07047c93-9a2a-4c83-a9f8-824d4470fa54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b746389b41884c7b9fd3237221d2b35d', 'request_id': 'req-07047c93-9a2a-4c83-a9f8-824d4470fa54'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:31.825755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-07047c93-9a2a-4c83-a9f8-824d4470fa54 admin admin] The token cache is being invalidate because project b746389b41884c7b9fd3237221d2b35d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:31.826047 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-07047c93-9a2a-4c83-a9f8-824d4470fa54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:31.826724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-07047c93-9a2a-4c83-a9f8-824d4470fa54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:31.828375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1118/2242] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:31 2022] DELETE /identity/v3/projects/b746389b41884c7b9fd3237221d2b35d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:31.832421 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07047c93-9a2a-4c83-a9f8-824d4470fa54 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:31.834025 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-07047c93-9a2a-4c83-a9f8-824d4470fa54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:31.834809 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:31.911187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbea7b-49c8-4730-a82e-76d21bded942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:31.911534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbea7b-49c8-4730-a82e-76d21bded942 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:31.911746 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbea7b-49c8-4730-a82e-76d21bded942 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:31.912043 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbea7b-49c8-4730-a82e-76d21bded942 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:31.913028 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbea7b-49c8-4730-a82e-76d21bded942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:31.915138 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbea7b-49c8-4730-a82e-76d21bded942 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:31.926866 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07047c93-9a2a-4c83-a9f8-824d4470fa54 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:31.932502 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8b3f7-35c4-45bd-9142-d6ed09b02c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:31.933362 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8b3f7-35c4-45bd-9142-d6ed09b02c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:31.933653 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8b3f7-35c4-45bd-9142-d6ed09b02c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:31.933934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8b3f7-35c4-45bd-9142-d6ed09b02c4a admin admin] PATH_INFO: `/v3/users/b4cfd2d41f284f598bf1eeabbe5cf8d5` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:31.935196 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8b3f7-35c4-45bd-9142-d6ed09b02c4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4cfd2d41f284f598bf1eeabbe5cf8d5)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:31.937188 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8b3f7-35c4-45bd-9142-d6ed09b02c4a admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:31.953561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1125/2243] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:31 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:49:31.954578 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbea7b-49c8-4730-a82e-76d21bded942 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:31.956720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-18cbea7b-49c8-4730-a82e-76d21bded942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:32.018869 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:32.022741 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-52e8b3f7-35c4-45bd-9142-d6ed09b02c4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4cfd2d41f284f598bf1eeabbe5cf8d5'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:32.033364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-52e8b3f7-35c4-45bd-9142-d6ed09b02c4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4cfd2d41f284f598bf1eeabbe5cf8d5'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:32.041903 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbea7b-49c8-4730-a82e-76d21bded942 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:32.047151 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb05d29-a066-45a4-a75b-e7861ab5ca78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:32.048035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb05d29-a066-45a4-a75b-e7861ab5ca78 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:32.048172 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb05d29-a066-45a4-a75b-e7861ab5ca78 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:32.048736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb05d29-a066-45a4-a75b-e7861ab5ca78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:32.050555 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-52e8b3f7-35c4-45bd-9142-d6ed09b02c4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4cfd2d41f284f598bf1eeabbe5cf8d5'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:32.052096 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-4bb05d29-a066-45a4-a75b-e7861ab5ca78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:32.060453 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-52e8b3f7-35c4-45bd-9142-d6ed09b02c4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4cfd2d41f284f598bf1eeabbe5cf8d5'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:32.072363 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-52e8b3f7-35c4-45bd-9142-d6ed09b02c4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4cfd2d41f284f598bf1eeabbe5cf8d5'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:32.081630 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1119/2244] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:31 2022] DELETE /identity/v3/users/b4cfd2d41f284f598bf1eeabbe5cf8d5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:32.082920 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8b3f7-35c4-45bd-9142-d6ed09b02c4a admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:32.085568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-52e8b3f7-35c4-45bd-9142-d6ed09b02c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:32.170252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb05d29-a066-45a4-a75b-e7861ab5ca78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:32.172888 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb05d29-a066-45a4-a75b-e7861ab5ca78 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:32.188892 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8b3f7-35c4-45bd-9142-d6ed09b02c4a admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:32.194496 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08da3df-bbe9-438e-a36b-a1ef2c0e502f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:32.195403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08da3df-bbe9-438e-a36b-a1ef2c0e502f admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:32.195694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08da3df-bbe9-438e-a36b-a1ef2c0e502f admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:32.195979 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08da3df-bbe9-438e-a36b-a1ef2c0e502f admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:32.196755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08da3df-bbe9-438e-a36b-a1ef2c0e502f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:32.198895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08da3df-bbe9-438e-a36b-a1ef2c0e502f admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:32.202585 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1126/2245] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:32.239636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1120/2246] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:32 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:32.243595 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb05d29-a066-45a4-a75b-e7861ab5ca78 service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:32.245602 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-4bb05d29-a066-45a4-a75b-e7861ab5ca78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:32.331893 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:32.338494 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb05d29-a066-45a4-a75b-e7861ab5ca78 service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:32.354523 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11424a10-996e-40f2-a0fb-5f3a14894762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:32.355674 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11424a10-996e-40f2-a0fb-5f3a14894762 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:32.355963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11424a10-996e-40f2-a0fb-5f3a14894762 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:32.356239 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11424a10-996e-40f2-a0fb-5f3a14894762 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:32.357588 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11424a10-996e-40f2-a0fb-5f3a14894762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:32.358923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11424a10-996e-40f2-a0fb-5f3a14894762 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:32.370813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1127/2247] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:32.381391 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08da3df-bbe9-438e-a36b-a1ef2c0e502f admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:32.402317 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08da3df-bbe9-438e-a36b-a1ef2c0e502f admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:32.407651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ed618-afaa-453f-b84e-90e4baf2644d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:32.408347 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ed618-afaa-453f-b84e-90e4baf2644d admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:32.408628 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ed618-afaa-453f-b84e-90e4baf2644d admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:32.408901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ed618-afaa-453f-b84e-90e4baf2644d admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:32.409640 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ed618-afaa-453f-b84e-90e4baf2644d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:32.411547 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ed618-afaa-453f-b84e-90e4baf2644d admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:32.431333 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1121/2248] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:32.433284 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11424a10-996e-40f2-a0fb-5f3a14894762 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:32.444384 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11424a10-996e-40f2-a0fb-5f3a14894762 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:32.450868 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183efe94-7957-461a-9125-c5062aae7c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:32.452591 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183efe94-7957-461a-9125-c5062aae7c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:32.452901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183efe94-7957-461a-9125-c5062aae7c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:32.453176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183efe94-7957-461a-9125-c5062aae7c31 admin admin] PATH_INFO: `/v3/projects/87de422e29e3422499a89b5aad4818c7/users/38eab7dcfb494cf8b7b86980bce55489/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:32.475924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183efe94-7957-461a-9125-c5062aae7c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87de422e29e3422499a89b5aad4818c7, user_id=38eab7dcfb494cf8b7b86980bce55489, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:32.479958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183efe94-7957-461a-9125-c5062aae7c31 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:32.502544 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1128/2249] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:32 2022] PUT /identity/v3/projects/87de422e29e3422499a89b5aad4818c7/users/38eab7dcfb494cf8b7b86980bce55489/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:32.513748 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bcb89-9e7a-4e88-8b5b-50f1ea551f15 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:32.514093 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bcb89-9e7a-4e88-8b5b-50f1ea551f15 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:32.514497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bcb89-9e7a-4e88-8b5b-50f1ea551f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:32.562404 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-b16bcb89-9e7a-4e88-8b5b-50f1ea551f15 None None] MFA Rules not processed for user `38eab7dcfb494cf8b7b86980bce55489`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:32.563787 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b16bcb89-9e7a-4e88-8b5b-50f1ea551f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:32.603300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183efe94-7957-461a-9125-c5062aae7c31 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:32.606628 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-183efe94-7957-461a-9125-c5062aae7c31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:32.673807 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1122/2250] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:32.682603 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bcb89-9e7a-4e88-8b5b-50f1ea551f15 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:32.684067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b16bcb89-9e7a-4e88-8b5b-50f1ea551f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:32.723529 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183efe94-7957-461a-9125-c5062aae7c31 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:32.728835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:32.729274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d147401-b052-4d10-a953-324ec5190aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:32.730698 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d147401-b052-4d10-a953-324ec5190aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:32.731058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d147401-b052-4d10-a953-324ec5190aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:32.731484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d147401-b052-4d10-a953-324ec5190aa3 admin admin] PATH_INFO: `/v3/projects/204efe3b38004694a3342ee5ff636894` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:32.733073 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d147401-b052-4d10-a953-324ec5190aa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=204efe3b38004694a3342ee5ff636894)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:32.743612 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d147401-b052-4d10-a953-324ec5190aa3 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:32.774790 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bcb89-9e7a-4e88-8b5b-50f1ea551f15 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:32.794340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-4d147401-b052-4d10-a953-324ec5190aa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '204efe3b38004694a3342ee5ff636894', 'request_id': 'req-4d147401-b052-4d10-a953-324ec5190aa3'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:32.800586 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-4d147401-b052-4d10-a953-324ec5190aa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '204efe3b38004694a3342ee5ff636894', 'request_id': 'req-4d147401-b052-4d10-a953-324ec5190aa3'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:32.809034 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-4d147401-b052-4d10-a953-324ec5190aa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '204efe3b38004694a3342ee5ff636894', 'request_id': 'req-4d147401-b052-4d10-a953-324ec5190aa3'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:32.822348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-4d147401-b052-4d10-a953-324ec5190aa3 admin admin] The token cache is being invalidate because project 204efe3b38004694a3342ee5ff636894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:32.822652 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-4d147401-b052-4d10-a953-324ec5190aa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:32.824126 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-4d147401-b052-4d10-a953-324ec5190aa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:32.825329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1129/2251] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:32 2022] DELETE /identity/v3/projects/204efe3b38004694a3342ee5ff636894 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:32.832923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb240cad-b5cc-4747-9831-b3a9230e8558 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:32.833139 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb240cad-b5cc-4747-9831-b3a9230e8558 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:32.833490 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb240cad-b5cc-4747-9831-b3a9230e8558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:32.843936 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d34795-ffb5-4bf9-b127-badb237ccfd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:32.844775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d34795-ffb5-4bf9-b127-badb237ccfd8 service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:32.845130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d34795-ffb5-4bf9-b127-badb237ccfd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:32.845476 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d34795-ffb5-4bf9-b127-badb237ccfd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:32.847448 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-34d34795-ffb5-4bf9-b127-badb237ccfd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:32.855092 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-eb240cad-b5cc-4747-9831-b3a9230e8558 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:32.856132 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-eb240cad-b5cc-4747-9831-b3a9230e8558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:32.925822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:32.932649 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d34795-ffb5-4bf9-b127-badb237ccfd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:32.934392 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d34795-ffb5-4bf9-b127-badb237ccfd8 service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:32.946124 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1130/2252] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:32.947434 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1123/2253] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:49:32.948225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ea24a-abd8-4782-b300-a5323c81a9d4 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:32.948891 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ea24a-abd8-4782-b300-a5323c81a9d4 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:32.949240 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ea24a-abd8-4782-b300-a5323c81a9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:32.972219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-067ea24a-abd8-4782-b300-a5323c81a9d4 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:32.973437 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-067ea24a-abd8-4782-b300-a5323c81a9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:32.983047 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1131/2254] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:32.988053 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d34795-ffb5-4bf9-b127-badb237ccfd8 service cinder] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:32.999672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d34795-ffb5-4bf9-b127-badb237ccfd8 service cinder] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:33.004405 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b41647-3f63-4b20-91b1-df014ab796ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:33.005090 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b41647-3f63-4b20-91b1-df014ab796ea admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:33.005379 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b41647-3f63-4b20-91b1-df014ab796ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:33.005663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b41647-3f63-4b20-91b1-df014ab796ea admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:33.006399 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b41647-3f63-4b20-91b1-df014ab796ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:49:33.006711 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b41647-3f63-4b20-91b1-df014ab796ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:33.008959 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b41647-3f63-4b20-91b1-df014ab796ea admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:33.029825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1124/2255] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:49:33.034498 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ea24a-abd8-4782-b300-a5323c81a9d4 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:33.048311 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ea24a-abd8-4782-b300-a5323c81a9d4 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:33.055661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00ac7f-ece7-4a83-ae31-40b6ebbf8c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:33.056744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00ac7f-ece7-4a83-ae31-40b6ebbf8c5e admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:33.057070 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00ac7f-ece7-4a83-ae31-40b6ebbf8c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:33.057484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e00ac7f-ece7-4a83-ae31-40b6ebbf8c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:33.058300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00ac7f-ece7-4a83-ae31-40b6ebbf8c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:33.060778 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e00ac7f-ece7-4a83-ae31-40b6ebbf8c5e admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:33.098430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1132/2256] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:33 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:49:33.104028 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b41647-3f63-4b20-91b1-df014ab796ea admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:33.134430 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b41647-3f63-4b20-91b1-df014ab796ea admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:33.223746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9fd38-5769-4ce7-8079-00843fb162ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:33.224945 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9fd38-5769-4ce7-8079-00843fb162ca admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:33.225643 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9fd38-5769-4ce7-8079-00843fb162ca admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:33.225935 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf9fd38-5769-4ce7-8079-00843fb162ca admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:33.227362 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9fd38-5769-4ce7-8079-00843fb162ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:33.229436 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf9fd38-5769-4ce7-8079-00843fb162ca admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:33.257748 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1125/2257] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:33 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:33.261642 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00ac7f-ece7-4a83-ae31-40b6ebbf8c5e admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:33.287511 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e00ac7f-ece7-4a83-ae31-40b6ebbf8c5e admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:33.308850 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86d42f-9227-4cc9-9661-e17cb1508f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:33.309779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86d42f-9227-4cc9-9661-e17cb1508f08 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:33.310090 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86d42f-9227-4cc9-9661-e17cb1508f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:33.310523 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86d42f-9227-4cc9-9661-e17cb1508f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:33.311305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86d42f-9227-4cc9-9661-e17cb1508f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:33.313009 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86d42f-9227-4cc9-9661-e17cb1508f08 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:33.348035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1133/2258] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:33.348655 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9fd38-5769-4ce7-8079-00843fb162ca admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:33.362603 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf9fd38-5769-4ce7-8079-00843fb162ca admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:33.379469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae1ff0-86cd-4bd7-8965-0bd51c0b8ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:33.380163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae1ff0-86cd-4bd7-8965-0bd51c0b8ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:33.380484 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae1ff0-86cd-4bd7-8965-0bd51c0b8ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:33.380863 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae1ff0-86cd-4bd7-8965-0bd51c0b8ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:33.381623 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae1ff0-86cd-4bd7-8965-0bd51c0b8ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:33.383574 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dae1ff0-86cd-4bd7-8965-0bd51c0b8ac1 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:33.416661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1126/2259] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:49:33.420666 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86d42f-9227-4cc9-9661-e17cb1508f08 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:33.432525 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86d42f-9227-4cc9-9661-e17cb1508f08 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:33.439157 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20c2ad-811c-42ac-a3af-d0b41f58e564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:33.440675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20c2ad-811c-42ac-a3af-d0b41f58e564 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:33.441167 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20c2ad-811c-42ac-a3af-d0b41f58e564 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:33.441672 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20c2ad-811c-42ac-a3af-d0b41f58e564 admin admin] PATH_INFO: `/v3/projects/78a567d5817246699467a6eead86044a/users/aa370363c76b4e86b68015b490aa9a06/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:33.458528 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20c2ad-811c-42ac-a3af-d0b41f58e564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a567d5817246699467a6eead86044a, user_id=aa370363c76b4e86b68015b490aa9a06, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:33.467633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20c2ad-811c-42ac-a3af-d0b41f58e564 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:33.484029 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1134/2260] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:33 2022] PUT /identity/v3/projects/78a567d5817246699467a6eead86044a/users/aa370363c76b4e86b68015b490aa9a06/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:33.489169 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd73a2a-484d-4c63-9a27-8821823c8c23 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:33.489623 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd73a2a-484d-4c63-9a27-8821823c8c23 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:33.489851 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd73a2a-484d-4c63-9a27-8821823c8c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:33.498415 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:33.524174 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-7bd73a2a-484d-4c63-9a27-8821823c8c23 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:33.525771 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-7bd73a2a-484d-4c63-9a27-8821823c8c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:33.603581 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1127/2261] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:33.611463 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20c2ad-811c-42ac-a3af-d0b41f58e564 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:33.614526 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-5d20c2ad-811c-42ac-a3af-d0b41f58e564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:33.686521 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20c2ad-811c-42ac-a3af-d0b41f58e564 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:33.690321 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a7a56-79cc-431f-b11b-de9ab3c66239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:33.690992 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a7a56-79cc-431f-b11b-de9ab3c66239 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:33.691270 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a7a56-79cc-431f-b11b-de9ab3c66239 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:33.691557 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a7a56-79cc-431f-b11b-de9ab3c66239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:33.702514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a7a56-79cc-431f-b11b-de9ab3c66239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:33.703976 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a7a56-79cc-431f-b11b-de9ab3c66239 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:33.717125 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1135/2262] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:49:34.393655 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1eebb4-fedf-4f0d-9850-71d511fecea0 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:34.394567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1eebb4-fedf-4f0d-9850-71d511fecea0 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:34.395076 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1eebb4-fedf-4f0d-9850-71d511fecea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:34.427018 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-2e1eebb4-fedf-4f0d-9850-71d511fecea0 None None] MFA Rules not processed for user `aa370363c76b4e86b68015b490aa9a06`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:34.428694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-2e1eebb4-fedf-4f0d-9850-71d511fecea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:34.524644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1128/2263] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:34.531776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a7a56-79cc-431f-b11b-de9ab3c66239 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:34.533337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-2a7a7a56-79cc-431f-b11b-de9ab3c66239 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:34.623856 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a7a56-79cc-431f-b11b-de9ab3c66239 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:34.628129 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0aac5-6d5a-4974-a8cc-6464d6c85b33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:34.629152 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0aac5-6d5a-4974-a8cc-6464d6c85b33 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:34.629370 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0aac5-6d5a-4974-a8cc-6464d6c85b33 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:34.629632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0aac5-6d5a-4974-a8cc-6464d6c85b33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:34.645699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0aac5-6d5a-4974-a8cc-6464d6c85b33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:34.647201 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0aac5-6d5a-4974-a8cc-6464d6c85b33 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:34.662649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1136/2264] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:36.097270 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1936a9c-24e2-484d-8e4e-0c58f02d8894 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:36.097845 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1936a9c-24e2-484d-8e4e-0c58f02d8894 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:36.098112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1936a9c-24e2-484d-8e4e-0c58f02d8894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:36.138859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-b1936a9c-24e2-484d-8e4e-0c58f02d8894 None None] MFA Rules not processed for user `aa370363c76b4e86b68015b490aa9a06`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:36.140339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b1936a9c-24e2-484d-8e4e-0c58f02d8894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:36.147881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1129/2265] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:36.322924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0aac5-6d5a-4974-a8cc-6464d6c85b33 service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:36.324449 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-07c0aac5-6d5a-4974-a8cc-6464d6c85b33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:36.339779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0aac5-6d5a-4974-a8cc-6464d6c85b33 service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:36.344577 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6bb65-a1be-4b5a-bb25-46be6e24e7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:36.345527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6bb65-a1be-4b5a-bb25-46be6e24e7b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:36.345877 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6bb65-a1be-4b5a-bb25-46be6e24e7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:36.346219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6bb65-a1be-4b5a-bb25-46be6e24e7b0 admin admin] PATH_INFO: `/v3/users/38eab7dcfb494cf8b7b86980bce55489` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:36.347631 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6bb65-a1be-4b5a-bb25-46be6e24e7b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38eab7dcfb494cf8b7b86980bce55489)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:36.349691 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6bb65-a1be-4b5a-bb25-46be6e24e7b0 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:36.390782 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:36.404044 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2fd6bb65-a1be-4b5a-bb25-46be6e24e7b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38eab7dcfb494cf8b7b86980bce55489'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:36.411160 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2fd6bb65-a1be-4b5a-bb25-46be6e24e7b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38eab7dcfb494cf8b7b86980bce55489'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:36.426465 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2fd6bb65-a1be-4b5a-bb25-46be6e24e7b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38eab7dcfb494cf8b7b86980bce55489'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:36.435841 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2fd6bb65-a1be-4b5a-bb25-46be6e24e7b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38eab7dcfb494cf8b7b86980bce55489'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:36.436549 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2fd6bb65-a1be-4b5a-bb25-46be6e24e7b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38eab7dcfb494cf8b7b86980bce55489'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:36.446807 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1137/2266] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:36 2022] DELETE /identity/v3/users/38eab7dcfb494cf8b7b86980bce55489 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:36.448560 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d0d92-120a-48e3-9fb1-800bf0ce8a84 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:36.448930 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d0d92-120a-48e3-9fb1-800bf0ce8a84 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:36.449236 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d0d92-120a-48e3-9fb1-800bf0ce8a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:36.471239 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-6f6d0d92-120a-48e3-9fb1-800bf0ce8a84 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:36.472937 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-6f6d0d92-120a-48e3-9fb1-800bf0ce8a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:36.548186 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1130/2267] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:36.556117 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6bb65-a1be-4b5a-bb25-46be6e24e7b0 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:36.558008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-2fd6bb65-a1be-4b5a-bb25-46be6e24e7b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:36.641058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6bb65-a1be-4b5a-bb25-46be6e24e7b0 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:36.645433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de205307-295d-48c5-8a93-8c7633d2f3bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:36.646103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de205307-295d-48c5-8a93-8c7633d2f3bd service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:36.646384 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de205307-295d-48c5-8a93-8c7633d2f3bd service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:36.646662 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de205307-295d-48c5-8a93-8c7633d2f3bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:36.659315 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de205307-295d-48c5-8a93-8c7633d2f3bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:36.661068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de205307-295d-48c5-8a93-8c7633d2f3bd service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:36.671863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1138/2268] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:36.997876 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d0d92-120a-48e3-9fb1-800bf0ce8a84 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:36.999569 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-6f6d0d92-120a-48e3-9fb1-800bf0ce8a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:37.020440 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d0d92-120a-48e3-9fb1-800bf0ce8a84 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:37.037093 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8646872-b9f0-48d2-a19d-88c373e0f7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:37.038025 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8646872-b9f0-48d2-a19d-88c373e0f7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:37.038312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8646872-b9f0-48d2-a19d-88c373e0f7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:37.038620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8646872-b9f0-48d2-a19d-88c373e0f7bd admin admin] PATH_INFO: `/v3/projects/87de422e29e3422499a89b5aad4818c7` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:37.040630 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8646872-b9f0-48d2-a19d-88c373e0f7bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=87de422e29e3422499a89b5aad4818c7)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:37.042877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8646872-b9f0-48d2-a19d-88c373e0f7bd admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:37.079766 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:37.113687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b8646872-b9f0-48d2-a19d-88c373e0f7bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87de422e29e3422499a89b5aad4818c7', 'request_id': 'req-b8646872-b9f0-48d2-a19d-88c373e0f7bd'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:37.121631 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b8646872-b9f0-48d2-a19d-88c373e0f7bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87de422e29e3422499a89b5aad4818c7', 'request_id': 'req-b8646872-b9f0-48d2-a19d-88c373e0f7bd'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:37.130241 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b8646872-b9f0-48d2-a19d-88c373e0f7bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87de422e29e3422499a89b5aad4818c7', 'request_id': 'req-b8646872-b9f0-48d2-a19d-88c373e0f7bd'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:37.146837 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b8646872-b9f0-48d2-a19d-88c373e0f7bd admin admin] The token cache is being invalidate because project 87de422e29e3422499a89b5aad4818c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:37.147128 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b8646872-b9f0-48d2-a19d-88c373e0f7bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:37.147835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b8646872-b9f0-48d2-a19d-88c373e0f7bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:37.149914 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1131/2269] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:36 2022] DELETE /identity/v3/projects/87de422e29e3422499a89b5aad4818c7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:37.254117 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de205307-295d-48c5-8a93-8c7633d2f3bd service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:37.259137 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-de205307-295d-48c5-8a93-8c7633d2f3bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:37.287617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de205307-295d-48c5-8a93-8c7633d2f3bd service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:37.383671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b1e09-30ce-4f73-b601-2661627275a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:37.384834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b1e09-30ce-4f73-b601-2661627275a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:37.385192 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b1e09-30ce-4f73-b601-2661627275a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:37.385572 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b1e09-30ce-4f73-b601-2661627275a5 admin admin] PATH_INFO: `/v3/users/5225dd865c9a4fbf8fb6cd6c7df9aea7` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:37.386928 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b1e09-30ce-4f73-b601-2661627275a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5225dd865c9a4fbf8fb6cd6c7df9aea7)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:37.389018 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b1e09-30ce-4f73-b601-2661627275a5 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:37.444025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-8a9b1e09-30ce-4f73-b601-2661627275a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5225dd865c9a4fbf8fb6cd6c7df9aea7'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:37.452502 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-8a9b1e09-30ce-4f73-b601-2661627275a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5225dd865c9a4fbf8fb6cd6c7df9aea7'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:37.453690 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:37.469193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-8a9b1e09-30ce-4f73-b601-2661627275a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5225dd865c9a4fbf8fb6cd6c7df9aea7'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:37.478470 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-8a9b1e09-30ce-4f73-b601-2661627275a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5225dd865c9a4fbf8fb6cd6c7df9aea7'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:37.479754 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-8a9b1e09-30ce-4f73-b601-2661627275a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5225dd865c9a4fbf8fb6cd6c7df9aea7'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:37.493861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1139/2270] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:37 2022] DELETE /identity/v3/users/5225dd865c9a4fbf8fb6cd6c7df9aea7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:37.495510 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4132960-d263-491c-aff3-27b301f78f10 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:37.495802 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4132960-d263-491c-aff3-27b301f78f10 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:37.496104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4132960-d263-491c-aff3-27b301f78f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:37.516174 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-a4132960-d263-491c-aff3-27b301f78f10 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:37.517467 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-a4132960-d263-491c-aff3-27b301f78f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:37.595097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1132/2271] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:37.607798 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b1e09-30ce-4f73-b601-2661627275a5 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:37.610194 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-8a9b1e09-30ce-4f73-b601-2661627275a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:37.685115 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b1e09-30ce-4f73-b601-2661627275a5 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:37.697173 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1aa0d-61cc-4895-8c33-7d50c7bdff00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:37.697854 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1aa0d-61cc-4895-8c33-7d50c7bdff00 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:37.698135 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1aa0d-61cc-4895-8c33-7d50c7bdff00 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:37.698403 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee1aa0d-61cc-4895-8c33-7d50c7bdff00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:37.710233 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1aa0d-61cc-4895-8c33-7d50c7bdff00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:37.727638 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee1aa0d-61cc-4895-8c33-7d50c7bdff00 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:37.741384 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1140/2272] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:38.381423 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4132960-d263-491c-aff3-27b301f78f10 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:38.383579 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-a4132960-d263-491c-aff3-27b301f78f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:38.401734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4132960-d263-491c-aff3-27b301f78f10 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:38.407628 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1003bf-30a9-49d1-972c-9b53a2bf126d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:38.408336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1003bf-30a9-49d1-972c-9b53a2bf126d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:38.408614 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1003bf-30a9-49d1-972c-9b53a2bf126d admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:38.408896 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1003bf-30a9-49d1-972c-9b53a2bf126d admin admin] PATH_INFO: `/v3/projects/aee1381dcc5f4adba324cd47cdf53e47` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:38.415626 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1003bf-30a9-49d1-972c-9b53a2bf126d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aee1381dcc5f4adba324cd47cdf53e47)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:38.419154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1003bf-30a9-49d1-972c-9b53a2bf126d admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:38.471703 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ee1003bf-30a9-49d1-972c-9b53a2bf126d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee1381dcc5f4adba324cd47cdf53e47', 'request_id': 'req-ee1003bf-30a9-49d1-972c-9b53a2bf126d'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:38.481329 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ee1003bf-30a9-49d1-972c-9b53a2bf126d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee1381dcc5f4adba324cd47cdf53e47', 'request_id': 'req-ee1003bf-30a9-49d1-972c-9b53a2bf126d'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:38.488346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ee1003bf-30a9-49d1-972c-9b53a2bf126d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee1381dcc5f4adba324cd47cdf53e47', 'request_id': 'req-ee1003bf-30a9-49d1-972c-9b53a2bf126d'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:38.503057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ee1003bf-30a9-49d1-972c-9b53a2bf126d admin admin] The token cache is being invalidate because project aee1381dcc5f4adba324cd47cdf53e47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:38.503476 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ee1003bf-30a9-49d1-972c-9b53a2bf126d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:38.504290 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ee1003bf-30a9-49d1-972c-9b53a2bf126d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:38.506135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1133/2273] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:38 2022] DELETE /identity/v3/projects/aee1381dcc5f4adba324cd47cdf53e47 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:38.510384 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1aa0d-61cc-4895-8c33-7d50c7bdff00 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:38.520924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee1aa0d-61cc-4895-8c33-7d50c7bdff00 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:38.611201 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b9792-0dd8-4257-b597-70ffaecdaf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:38.612229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b9792-0dd8-4257-b597-70ffaecdaf9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:38.612697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b9792-0dd8-4257-b597-70ffaecdaf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:38.612977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b9792-0dd8-4257-b597-70ffaecdaf9f admin admin] PATH_INFO: `/v3/users/7399ac9db2874b42bf3aceb1e197f4f3` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:38.614362 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b9792-0dd8-4257-b597-70ffaecdaf9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7399ac9db2874b42bf3aceb1e197f4f3)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:38.616528 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b9792-0dd8-4257-b597-70ffaecdaf9f admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:38.693508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-432b9792-0dd8-4257-b597-70ffaecdaf9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7399ac9db2874b42bf3aceb1e197f4f3'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:38.703044 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-432b9792-0dd8-4257-b597-70ffaecdaf9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7399ac9db2874b42bf3aceb1e197f4f3'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:38.728487 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-432b9792-0dd8-4257-b597-70ffaecdaf9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7399ac9db2874b42bf3aceb1e197f4f3'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:38.734411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:38.741937 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-432b9792-0dd8-4257-b597-70ffaecdaf9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7399ac9db2874b42bf3aceb1e197f4f3'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:38.744201 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-432b9792-0dd8-4257-b597-70ffaecdaf9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7399ac9db2874b42bf3aceb1e197f4f3'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:38.752098 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1141/2274] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:38 2022] DELETE /identity/v3/users/7399ac9db2874b42bf3aceb1e197f4f3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:39.123090 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1003bf-30a9-49d1-972c-9b53a2bf126d admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:39.124838 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-ee1003bf-30a9-49d1-972c-9b53a2bf126d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:39.145922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1003bf-30a9-49d1-972c-9b53a2bf126d admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:39.194366 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:39.226383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11fd4e-7f8d-4fba-9f3c-168214ef9a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:39.227485 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11fd4e-7f8d-4fba-9f3c-168214ef9a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:39.228078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11fd4e-7f8d-4fba-9f3c-168214ef9a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:39.228459 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11fd4e-7f8d-4fba-9f3c-168214ef9a1e admin admin] PATH_INFO: `/v3/projects/44bc732634734ee59046afaf6142ea32` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:39.230966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11fd4e-7f8d-4fba-9f3c-168214ef9a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=44bc732634734ee59046afaf6142ea32)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:39.233489 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11fd4e-7f8d-4fba-9f3c-168214ef9a1e admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:39.299902 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ec11fd4e-7f8d-4fba-9f3c-168214ef9a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44bc732634734ee59046afaf6142ea32', 'request_id': 'req-ec11fd4e-7f8d-4fba-9f3c-168214ef9a1e'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:39.313004 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ec11fd4e-7f8d-4fba-9f3c-168214ef9a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44bc732634734ee59046afaf6142ea32', 'request_id': 'req-ec11fd4e-7f8d-4fba-9f3c-168214ef9a1e'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:39.321584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ec11fd4e-7f8d-4fba-9f3c-168214ef9a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44bc732634734ee59046afaf6142ea32', 'request_id': 'req-ec11fd4e-7f8d-4fba-9f3c-168214ef9a1e'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:39.335940 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ec11fd4e-7f8d-4fba-9f3c-168214ef9a1e admin admin] The token cache is being invalidate because project 44bc732634734ee59046afaf6142ea32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:39.336393 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ec11fd4e-7f8d-4fba-9f3c-168214ef9a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:39.337270 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ec11fd4e-7f8d-4fba-9f3c-168214ef9a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:39.342551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1134/2275] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:39 2022] DELETE /identity/v3/projects/44bc732634734ee59046afaf6142ea32 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:39.345376 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b81f6f-5cad-4213-9f56-6fd6126cebd1 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:39.345856 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b81f6f-5cad-4213-9f56-6fd6126cebd1 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:39.346142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b81f6f-5cad-4213-9f56-6fd6126cebd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:39.365290 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-27b81f6f-5cad-4213-9f56-6fd6126cebd1 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:39.366558 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-27b81f6f-5cad-4213-9f56-6fd6126cebd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:39.452060 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1142/2276] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:49:39.459705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb62b47-2bb4-46b7-b3d9-514205998467 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:39.460618 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb62b47-2bb4-46b7-b3d9-514205998467 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:39.461281 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb62b47-2bb4-46b7-b3d9-514205998467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:39.480826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-9eb62b47-2bb4-46b7-b3d9-514205998467 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:39.482085 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9eb62b47-2bb4-46b7-b3d9-514205998467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:39.490549 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1135/2277] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:39.495699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b81f6f-5cad-4213-9f56-6fd6126cebd1 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:39.510263 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b81f6f-5cad-4213-9f56-6fd6126cebd1 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:39.516780 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917122a-dded-4052-b649-693556117df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:39.518128 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917122a-dded-4052-b649-693556117df8 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:39.518567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917122a-dded-4052-b649-693556117df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:39.519020 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917122a-dded-4052-b649-693556117df8 admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:39.519951 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917122a-dded-4052-b649-693556117df8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:49:39.520254 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917122a-dded-4052-b649-693556117df8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:39.521885 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917122a-dded-4052-b649-693556117df8 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:39.536011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1143/2278] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:49:39.540256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb62b47-2bb4-46b7-b3d9-514205998467 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:39.554921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb62b47-2bb4-46b7-b3d9-514205998467 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:39.561368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8685a7-88c2-4747-9934-84fc6a5ab001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:39.562133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8685a7-88c2-4747-9934-84fc6a5ab001 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:39.562500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8685a7-88c2-4747-9934-84fc6a5ab001 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:39.562692 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8685a7-88c2-4747-9934-84fc6a5ab001 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:39.563556 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8685a7-88c2-4747-9934-84fc6a5ab001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:39.565922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8685a7-88c2-4747-9934-84fc6a5ab001 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:39.602285 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917122a-dded-4052-b649-693556117df8 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:39.612907 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917122a-dded-4052-b649-693556117df8 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:39.613827 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1136/2279] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:39 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:49:39.740110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f29ac5-f6c9-4def-b6cf-1224f5e02f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:39.741073 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f29ac5-f6c9-4def-b6cf-1224f5e02f75 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:39.741683 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f29ac5-f6c9-4def-b6cf-1224f5e02f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:39.742497 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f29ac5-f6c9-4def-b6cf-1224f5e02f75 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:39.745143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f29ac5-f6c9-4def-b6cf-1224f5e02f75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:39.748625 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f29ac5-f6c9-4def-b6cf-1224f5e02f75 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:39.778139 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1144/2280] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:39 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:49:39.782007 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8685a7-88c2-4747-9934-84fc6a5ab001 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:39.795164 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8685a7-88c2-4747-9934-84fc6a5ab001 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:39.800441 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3362c4-87d1-4a55-9ef9-08d6e6418f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:39.801209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3362c4-87d1-4a55-9ef9-08d6e6418f31 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:39.801508 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3362c4-87d1-4a55-9ef9-08d6e6418f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:39.801785 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3362c4-87d1-4a55-9ef9-08d6e6418f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:39.802532 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3362c4-87d1-4a55-9ef9-08d6e6418f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:39.804208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3362c4-87d1-4a55-9ef9-08d6e6418f31 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:39.825368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1137/2281] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:39.828300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f29ac5-f6c9-4def-b6cf-1224f5e02f75 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:39.846160 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f29ac5-f6c9-4def-b6cf-1224f5e02f75 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:39.853030 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead56d0-8003-489e-8521-94247352ab8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:39.853493 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead56d0-8003-489e-8521-94247352ab8a admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:39.853880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead56d0-8003-489e-8521-94247352ab8a admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:39.854264 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead56d0-8003-489e-8521-94247352ab8a admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:39.855152 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead56d0-8003-489e-8521-94247352ab8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:39.856955 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead56d0-8003-489e-8521-94247352ab8a admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:39.878398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3362c4-87d1-4a55-9ef9-08d6e6418f31 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:39.890025 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3362c4-87d1-4a55-9ef9-08d6e6418f31 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:39.890335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1145/2282] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:39.900276 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ba48f-6003-40b7-835a-858f571c1aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:39.906469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ba48f-6003-40b7-835a-858f571c1aae admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:39.906977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ba48f-6003-40b7-835a-858f571c1aae admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:39.907402 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ba48f-6003-40b7-835a-858f571c1aae admin admin] PATH_INFO: `/v3/projects/81a429ff9b9d442d85ce84c0fe2f4c63/users/8235147125cc4390aae1adec93a71459/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:39.938833 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ba48f-6003-40b7-835a-858f571c1aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a429ff9b9d442d85ce84c0fe2f4c63, user_id=8235147125cc4390aae1adec93a71459, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:39.938833 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ba48f-6003-40b7-835a-858f571c1aae admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:39.967580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1138/2283] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:39 2022] PUT /identity/v3/projects/81a429ff9b9d442d85ce84c0fe2f4c63/users/8235147125cc4390aae1adec93a71459/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:39.973054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79383208-91d5-4f56-b447-698c526106cd None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:39.973218 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79383208-91d5-4f56-b447-698c526106cd None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:39.973569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79383208-91d5-4f56-b447-698c526106cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:40.029815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-79383208-91d5-4f56-b447-698c526106cd None None] MFA Rules not processed for user `8235147125cc4390aae1adec93a71459`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:40.032753 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-79383208-91d5-4f56-b447-698c526106cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:40.102733 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:40.122417 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1146/2284] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:40.127386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ba48f-6003-40b7-835a-858f571c1aae admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:40.198524 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ba48f-6003-40b7-835a-858f571c1aae admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:40.203817 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6777a-097e-4244-905a-2cfc3c661f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:40.204499 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6777a-097e-4244-905a-2cfc3c661f3d admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:40.204820 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6777a-097e-4244-905a-2cfc3c661f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:40.205306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6777a-097e-4244-905a-2cfc3c661f3d admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:40.206194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6777a-097e-4244-905a-2cfc3c661f3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:40.208274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6777a-097e-4244-905a-2cfc3c661f3d admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:40.213934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:40.246595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1139/2285] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:40 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:40.248399 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79383208-91d5-4f56-b447-698c526106cd None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:40.259738 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79383208-91d5-4f56-b447-698c526106cd None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:40.325216 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92566898-f69b-45d9-91fe-9fe19e87284c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:40.325899 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92566898-f69b-45d9-91fe-9fe19e87284c admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:40.326186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92566898-f69b-45d9-91fe-9fe19e87284c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:40.326466 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92566898-f69b-45d9-91fe-9fe19e87284c admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:40.327199 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92566898-f69b-45d9-91fe-9fe19e87284c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:40.329161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92566898-f69b-45d9-91fe-9fe19e87284c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:40.355609 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1147/2286] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:40 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:40.356617 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6777a-097e-4244-905a-2cfc3c661f3d admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:40.367883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6777a-097e-4244-905a-2cfc3c661f3d admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:40.372736 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa350f89-884f-4013-9df9-4af1d12e5493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:40.373418 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa350f89-884f-4013-9df9-4af1d12e5493 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:40.373701 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa350f89-884f-4013-9df9-4af1d12e5493 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:40.373976 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa350f89-884f-4013-9df9-4af1d12e5493 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:40.374706 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa350f89-884f-4013-9df9-4af1d12e5493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:40.376690 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa350f89-884f-4013-9df9-4af1d12e5493 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:40.394234 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1140/2287] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:40.396742 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92566898-f69b-45d9-91fe-9fe19e87284c admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:40.407788 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92566898-f69b-45d9-91fe-9fe19e87284c admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:40.413562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a33a76-46fa-4830-b9de-ec62f4e97b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:40.414982 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a33a76-46fa-4830-b9de-ec62f4e97b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:40.415388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a33a76-46fa-4830-b9de-ec62f4e97b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:40.415643 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a33a76-46fa-4830-b9de-ec62f4e97b4a admin admin] PATH_INFO: `/v3/projects/31389dd7661449b9b319520af173b951/users/84346d1413fb42dbb6c096540f01f39d/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:40.433324 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a33a76-46fa-4830-b9de-ec62f4e97b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=31389dd7661449b9b319520af173b951, user_id=84346d1413fb42dbb6c096540f01f39d, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:40.436595 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a33a76-46fa-4830-b9de-ec62f4e97b4a admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:40.452568 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1148/2288] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:40 2022] PUT /identity/v3/projects/31389dd7661449b9b319520af173b951/users/84346d1413fb42dbb6c096540f01f39d/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:40.456551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa350f89-884f-4013-9df9-4af1d12e5493 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:40.467170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa350f89-884f-4013-9df9-4af1d12e5493 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:40.542468 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd410c-6975-4540-b092-27669295d7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:40.543173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd410c-6975-4540-b092-27669295d7cc admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:40.543497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd410c-6975-4540-b092-27669295d7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:40.543773 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd410c-6975-4540-b092-27669295d7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:40.544512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd410c-6975-4540-b092-27669295d7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:40.546123 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd410c-6975-4540-b092-27669295d7cc admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:40.559307 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1141/2289] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:40.562127 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a33a76-46fa-4830-b9de-ec62f4e97b4a admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:40.572948 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a33a76-46fa-4830-b9de-ec62f4e97b4a admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:40.577759 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d335b-9682-45d9-8f79-445a9c621dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:40.578661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d335b-9682-45d9-8f79-445a9c621dc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:40.578944 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d335b-9682-45d9-8f79-445a9c621dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:40.579219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d335b-9682-45d9-8f79-445a9c621dc1 admin admin] PATH_INFO: `/v3/projects/31389dd7661449b9b319520af173b951/users/84346d1413fb42dbb6c096540f01f39d/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:40.581366 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d335b-9682-45d9-8f79-445a9c621dc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31389dd7661449b9b319520af173b951, user_id=84346d1413fb42dbb6c096540f01f39d, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:40.584053 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d335b-9682-45d9-8f79-445a9c621dc1 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:40.599350 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1149/2290] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:40 2022] PUT /identity/v3/projects/31389dd7661449b9b319520af173b951/users/84346d1413fb42dbb6c096540f01f39d/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:40.609229 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99944d0-3777-4af0-9cc1-3f8d7c5c63f4 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:40.609448 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99944d0-3777-4af0-9cc1-3f8d7c5c63f4 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:40.609729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99944d0-3777-4af0-9cc1-3f8d7c5c63f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:40.639443 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-a99944d0-3777-4af0-9cc1-3f8d7c5c63f4 None None] MFA Rules not processed for user `84346d1413fb42dbb6c096540f01f39d`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:40.640668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-a99944d0-3777-4af0-9cc1-3f8d7c5c63f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:40.774408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1142/2291] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:40.790005 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d335b-9682-45d9-8f79-445a9c621dc1 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:40.791971 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-9b3d335b-9682-45d9-8f79-445a9c621dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:40.914750 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d335b-9682-45d9-8f79-445a9c621dc1 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:40.919085 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67e597-a635-4f1a-b3e0-0432b3a723cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:40.920207 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67e597-a635-4f1a-b3e0-0432b3a723cd service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:40.920987 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67e597-a635-4f1a-b3e0-0432b3a723cd service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:40.920987 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67e597-a635-4f1a-b3e0-0432b3a723cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:40.934086 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67e597-a635-4f1a-b3e0-0432b3a723cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:40.936683 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67e597-a635-4f1a-b3e0-0432b3a723cd service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:40.953539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1150/2292] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:41.481326 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99944d0-3777-4af0-9cc1-3f8d7c5c63f4 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:41.495663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99944d0-3777-4af0-9cc1-3f8d7c5c63f4 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:41.510641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa54648-70a3-45fc-b888-af154c49273c tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84346d1413fb42dbb6c096540f01f39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31389dd7661449b9b319520af173b951', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:41.511644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa54648-70a3-45fc-b888-af154c49273c tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:41.512072 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa54648-70a3-45fc-b888-af154c49273c tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:41.512498 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa54648-70a3-45fc-b888-af154c49273c tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:41.513445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa54648-70a3-45fc-b888-af154c49273c tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:49:41.513901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa54648-70a3-45fc-b888-af154c49273c tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:41.516218 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa54648-70a3-45fc-b888-af154c49273c tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:41.530240 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1143/2293] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:49:41.538396 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67e597-a635-4f1a-b3e0-0432b3a723cd service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:41.553585 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67e597-a635-4f1a-b3e0-0432b3a723cd service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:41.560137 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd97fe7-4f8a-4e5b-879c-3715f1d2f366 tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84346d1413fb42dbb6c096540f01f39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31389dd7661449b9b319520af173b951', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:41.561350 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd97fe7-4f8a-4e5b-879c-3715f1d2f366 tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:41.561675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd97fe7-4f8a-4e5b-879c-3715f1d2f366 tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:41.562029 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd97fe7-4f8a-4e5b-879c-3715f1d2f366 tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:41.563097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd97fe7-4f8a-4e5b-879c-3715f1d2f366 tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:41.565308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd97fe7-4f8a-4e5b-879c-3715f1d2f366 tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:41.615494 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1151/2294] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:41 2022] POST /identity/v3/projects => generated 353 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:41.622184 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa54648-70a3-45fc-b888-af154c49273c tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:41.661537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd97fe7-4f8a-4e5b-879c-3715f1d2f366 tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:41.665841 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-acd97fe7-4f8a-4e5b-879c-3715f1d2f366 tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:41.667782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa54648-70a3-45fc-b888-af154c49273c tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:41.731610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:41.770821 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd97fe7-4f8a-4e5b-879c-3715f1d2f366 tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:41.777792 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:41.781731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183dc251-2995-4e4e-bf03-7d4eb6df88f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:41.784360 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dc251-2995-4e4e-bf03-7d4eb6df88f5 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:41.784720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dc251-2995-4e4e-bf03-7d4eb6df88f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:41.785717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dc251-2995-4e4e-bf03-7d4eb6df88f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:41.790945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-183dc251-2995-4e4e-bf03-7d4eb6df88f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:41.810323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d739da-5a8b-4c4d-a83e-e7d0a4ea9a77 tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84346d1413fb42dbb6c096540f01f39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31389dd7661449b9b319520af173b951', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:41.812476 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d739da-5a8b-4c4d-a83e-e7d0a4ea9a77 tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:41.812955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d739da-5a8b-4c4d-a83e-e7d0a4ea9a77 tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:41.813513 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d739da-5a8b-4c4d-a83e-e7d0a4ea9a77 tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:41.816819 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d739da-5a8b-4c4d-a83e-e7d0a4ea9a77 tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:49:41.818015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d739da-5a8b-4c4d-a83e-e7d0a4ea9a77 tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:41.824381 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d739da-5a8b-4c4d-a83e-e7d0a4ea9a77 tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:41.845316 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1144/2295] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:49:41.846389 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d739da-5a8b-4c4d-a83e-e7d0a4ea9a77 tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:41.848564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-06d739da-5a8b-4c4d-a83e-e7d0a4ea9a77 tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:41.919457 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183dc251-2995-4e4e-bf03-7d4eb6df88f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:41.921264 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183dc251-2995-4e4e-bf03-7d4eb6df88f5 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:41.935478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1152/2296] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:41.938374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183dc251-2995-4e4e-bf03-7d4eb6df88f5 service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:41.970325 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183dc251-2995-4e4e-bf03-7d4eb6df88f5 service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:41.972984 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d739da-5a8b-4c4d-a83e-e7d0a4ea9a77 tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:41.976122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5db1e1-c818-44db-961f-5a9771ce732b tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '84346d1413fb42dbb6c096540f01f39d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31389dd7661449b9b319520af173b951', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:41.977029 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5db1e1-c818-44db-961f-5a9771ce732b tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:41.977432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5db1e1-c818-44db-961f-5a9771ce732b tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:41.977613 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5db1e1-c818-44db-961f-5a9771ce732b tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] PATH_INFO: `/v3/projects/994d404704a34266a49e120a00627ae6` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:41.983715 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406723f-fae8-41f5-8372-7ce36940bab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:41.985693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406723f-fae8-41f5-8372-7ce36940bab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:41.985983 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406723f-fae8-41f5-8372-7ce36940bab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:41.986262 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406723f-fae8-41f5-8372-7ce36940bab9 admin admin] PATH_INFO: `/v3/users/ceb44c6507d844b5a2e2b3ccfa64bdd2` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:41.987700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5db1e1-c818-44db-961f-5a9771ce732b tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] RBAC: Authorizing `identity:delete_project(project_id=994d404704a34266a49e120a00627ae6)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:41.987877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6406723f-fae8-41f5-8372-7ce36940bab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceb44c6507d844b5a2e2b3ccfa64bdd2)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:41.989890 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6406723f-fae8-41f5-8372-7ce36940bab9 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:41.990124 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5db1e1-c818-44db-961f-5a9771ce732b tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:42.069067 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-6a5db1e1-c818-44db-961f-5a9771ce732b tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '994d404704a34266a49e120a00627ae6', 'request_id': 'req-6a5db1e1-c818-44db-961f-5a9771ce732b'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:42.079691 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-6406723f-fae8-41f5-8372-7ce36940bab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceb44c6507d844b5a2e2b3ccfa64bdd2'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:42.081601 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-6a5db1e1-c818-44db-961f-5a9771ce732b tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '994d404704a34266a49e120a00627ae6', 'request_id': 'req-6a5db1e1-c818-44db-961f-5a9771ce732b'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:42.089160 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-6406723f-fae8-41f5-8372-7ce36940bab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceb44c6507d844b5a2e2b3ccfa64bdd2'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:42.094167 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-6a5db1e1-c818-44db-961f-5a9771ce732b tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '994d404704a34266a49e120a00627ae6', 'request_id': 'req-6a5db1e1-c818-44db-961f-5a9771ce732b'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:42.108744 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-6406723f-fae8-41f5-8372-7ce36940bab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceb44c6507d844b5a2e2b3ccfa64bdd2'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:42.109730 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-6406723f-fae8-41f5-8372-7ce36940bab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceb44c6507d844b5a2e2b3ccfa64bdd2'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:42.110663 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-6a5db1e1-c818-44db-961f-5a9771ce732b tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] The token cache is being invalidate because project 994d404704a34266a49e120a00627ae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:42.111285 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-6a5db1e1-c818-44db-961f-5a9771ce732b tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:42.112061 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-6a5db1e1-c818-44db-961f-5a9771ce732b tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:42.115552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1153/2297] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:41 2022] DELETE /identity/v3/projects/994d404704a34266a49e120a00627ae6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:42.123466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-6406723f-fae8-41f5-8372-7ce36940bab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceb44c6507d844b5a2e2b3ccfa64bdd2'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:42.136397 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1145/2298] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:41 2022] DELETE /identity/v3/users/ceb44c6507d844b5a2e2b3ccfa64bdd2 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:42.342939 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5db1e1-c818-44db-961f-5a9771ce732b tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:42.345565 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-6a5db1e1-c818-44db-961f-5a9771ce732b tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:42.369815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406723f-fae8-41f5-8372-7ce36940bab9 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:42.371597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-6406723f-fae8-41f5-8372-7ce36940bab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:42.461922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:42.468948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406723f-fae8-41f5-8372-7ce36940bab9 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:42.476136 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561b7e6-0c92-49b7-a203-92ba30b248ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:42.479239 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561b7e6-0c92-49b7-a203-92ba30b248ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:42.480459 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561b7e6-0c92-49b7-a203-92ba30b248ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:42.481105 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561b7e6-0c92-49b7-a203-92ba30b248ff admin admin] PATH_INFO: `/v3/users/8235147125cc4390aae1adec93a71459` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:42.482965 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561b7e6-0c92-49b7-a203-92ba30b248ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=8235147125cc4390aae1adec93a71459)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:42.484949 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:42.485213 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561b7e6-0c92-49b7-a203-92ba30b248ff admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:42.518220 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5db1e1-c818-44db-961f-5a9771ce732b tempest-VolumeQuotaClassesTest-108209428 tempest-VolumeQuotaClassesTest-108209428-project-admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:42.524679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4c6e6-9784-46ec-85d5-e26ff1319cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:42.525355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4c6e6-9784-46ec-85d5-e26ff1319cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:42.525634 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4c6e6-9784-46ec-85d5-e26ff1319cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:42.526111 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4c6e6-9784-46ec-85d5-e26ff1319cbd admin admin] PATH_INFO: `/v3/projects/6778b4968e9d4abaad68b475c910f443` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:42.527891 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4c6e6-9784-46ec-85d5-e26ff1319cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6778b4968e9d4abaad68b475c910f443)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:42.533542 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4c6e6-9784-46ec-85d5-e26ff1319cbd admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:42.559219 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e561b7e6-0c92-49b7-a203-92ba30b248ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8235147125cc4390aae1adec93a71459'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:42.584737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e561b7e6-0c92-49b7-a203-92ba30b248ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8235147125cc4390aae1adec93a71459'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:42.604797 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-bbb4c6e6-9784-46ec-85d5-e26ff1319cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6778b4968e9d4abaad68b475c910f443', 'request_id': 'req-bbb4c6e6-9784-46ec-85d5-e26ff1319cbd'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:42.610329 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e561b7e6-0c92-49b7-a203-92ba30b248ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8235147125cc4390aae1adec93a71459'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:42.611403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e561b7e6-0c92-49b7-a203-92ba30b248ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8235147125cc4390aae1adec93a71459'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:42.611536 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-bbb4c6e6-9784-46ec-85d5-e26ff1319cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6778b4968e9d4abaad68b475c910f443', 'request_id': 'req-bbb4c6e6-9784-46ec-85d5-e26ff1319cbd'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:42.619942 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e561b7e6-0c92-49b7-a203-92ba30b248ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8235147125cc4390aae1adec93a71459'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:42.621493 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-bbb4c6e6-9784-46ec-85d5-e26ff1319cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6778b4968e9d4abaad68b475c910f443', 'request_id': 'req-bbb4c6e6-9784-46ec-85d5-e26ff1319cbd'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:42.626269 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1146/2299] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:42 2022] DELETE /identity/v3/users/8235147125cc4390aae1adec93a71459 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:42.631771 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ee271-4bd4-4e0f-b536-f35db1fc8e4d None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:42.632143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ee271-4bd4-4e0f-b536-f35db1fc8e4d None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:42.633167 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ee271-4bd4-4e0f-b536-f35db1fc8e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:42.635593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-bbb4c6e6-9784-46ec-85d5-e26ff1319cbd admin admin] The token cache is being invalidate because project 6778b4968e9d4abaad68b475c910f443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:42.636063 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-bbb4c6e6-9784-46ec-85d5-e26ff1319cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:42.637030 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-bbb4c6e6-9784-46ec-85d5-e26ff1319cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:42.642638 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1154/2300] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:42 2022] DELETE /identity/v3/projects/6778b4968e9d4abaad68b475c910f443 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:42.644171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2544850-980f-44ee-9b22-0e2a22f3510b None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:42.644653 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2544850-980f-44ee-9b22-0e2a22f3510b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:42.645152 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2544850-980f-44ee-9b22-0e2a22f3510b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:42.658071 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-4e3ee271-4bd4-4e0f-b536-f35db1fc8e4d None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:42.660416 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-4e3ee271-4bd4-4e0f-b536-f35db1fc8e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:42.674630 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-c2544850-980f-44ee-9b22-0e2a22f3510b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:42.676647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c2544850-980f-44ee-9b22-0e2a22f3510b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:42.738622 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1147/2301] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:42.749599 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ee271-4bd4-4e0f-b536-f35db1fc8e4d None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:42.751081 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-4e3ee271-4bd4-4e0f-b536-f35db1fc8e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:42.795620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1155/2302] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:49:42.797983 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc953c-3785-463b-a0d9-8dd01d1cbdd2 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:42.798832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc953c-3785-463b-a0d9-8dd01d1cbdd2 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:42.799270 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc953c-3785-463b-a0d9-8dd01d1cbdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:42.826535 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-a6fc953c-3785-463b-a0d9-8dd01d1cbdd2 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:42.828197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a6fc953c-3785-463b-a0d9-8dd01d1cbdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:42.836845 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ee271-4bd4-4e0f-b536-f35db1fc8e4d None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:42.837358 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1156/2303] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:42.841431 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc953c-3785-463b-a0d9-8dd01d1cbdd2 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:42.853267 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438ad06-7b2a-454f-af5c-ccc0c3579d80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:42.853267 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438ad06-7b2a-454f-af5c-ccc0c3579d80 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:42.853976 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438ad06-7b2a-454f-af5c-ccc0c3579d80 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:42.854272 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438ad06-7b2a-454f-af5c-ccc0c3579d80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:42.859500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc953c-3785-463b-a0d9-8dd01d1cbdd2 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:42.874201 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438ad06-7b2a-454f-af5c-ccc0c3579d80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:42.876583 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438ad06-7b2a-454f-af5c-ccc0c3579d80 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:42.883336 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63dec0-fa33-4f11-9037-0301ec7b0102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:42.887100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63dec0-fa33-4f11-9037-0301ec7b0102 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:42.887100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63dec0-fa33-4f11-9037-0301ec7b0102 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:42.887100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63dec0-fa33-4f11-9037-0301ec7b0102 admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:42.888772 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63dec0-fa33-4f11-9037-0301ec7b0102 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:49:42.889174 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63dec0-fa33-4f11-9037-0301ec7b0102 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:42.890812 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63dec0-fa33-4f11-9037-0301ec7b0102 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:42.901499 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1148/2304] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:49:42.933831 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438ad06-7b2a-454f-af5c-ccc0c3579d80 service neutron] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:42.945590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1157/2305] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:49:42.946187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438ad06-7b2a-454f-af5c-ccc0c3579d80 service neutron] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:42.951563 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2ec1d-7663-463c-a121-d9d353783d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:42.952225 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ec1d-7663-463c-a121-d9d353783d8d admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:42.952506 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ec1d-7663-463c-a121-d9d353783d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:42.952782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ec1d-7663-463c-a121-d9d353783d8d admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:42.953844 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2ec1d-7663-463c-a121-d9d353783d8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:42.955797 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2ec1d-7663-463c-a121-d9d353783d8d admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:42.978180 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:42.995633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63dec0-fa33-4f11-9037-0301ec7b0102 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:43.002720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1149/2306] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:42 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:43.010680 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63dec0-fa33-4f11-9037-0301ec7b0102 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:43.116170 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217d028-e1c2-4654-bb09-713e2af1e4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:43.117379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217d028-e1c2-4654-bb09-713e2af1e4a2 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:43.117698 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217d028-e1c2-4654-bb09-713e2af1e4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:43.117976 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217d028-e1c2-4654-bb09-713e2af1e4a2 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:43.118684 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217d028-e1c2-4654-bb09-713e2af1e4a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:43.123322 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217d028-e1c2-4654-bb09-713e2af1e4a2 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:43.142584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:43.154398 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1158/2307] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:42 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:43.156362 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2ec1d-7663-463c-a121-d9d353783d8d admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:43.170012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2ec1d-7663-463c-a121-d9d353783d8d admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:43.176162 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad41a4-d364-4ec2-b56f-923a9a0ccfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:43.176889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad41a4-d364-4ec2-b56f-923a9a0ccfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:43.177305 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad41a4-d364-4ec2-b56f-923a9a0ccfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:43.177660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad41a4-d364-4ec2-b56f-923a9a0ccfd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:43.178468 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad41a4-d364-4ec2-b56f-923a9a0ccfd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:43.180769 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad41a4-d364-4ec2-b56f-923a9a0ccfd6 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:43.202807 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1150/2308] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:43.207037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217d028-e1c2-4654-bb09-713e2af1e4a2 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:43.217654 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217d028-e1c2-4654-bb09-713e2af1e4a2 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:43.232326 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281f17b-bc05-4b8f-a3b1-58768a7d355e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:43.233550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281f17b-bc05-4b8f-a3b1-58768a7d355e admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:43.233840 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281f17b-bc05-4b8f-a3b1-58768a7d355e admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:43.234123 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281f17b-bc05-4b8f-a3b1-58768a7d355e admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:43.235024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281f17b-bc05-4b8f-a3b1-58768a7d355e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:43.239208 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281f17b-bc05-4b8f-a3b1-58768a7d355e admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:43.252241 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1159/2309] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:43.257858 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad41a4-d364-4ec2-b56f-923a9a0ccfd6 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:43.272654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad41a4-d364-4ec2-b56f-923a9a0ccfd6 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:43.273525 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281f17b-bc05-4b8f-a3b1-58768a7d355e admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:43.275344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-f281f17b-bc05-4b8f-a3b1-58768a7d355e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:43.277865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b10359-83dc-45e8-b303-bde04aca7afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:43.278907 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b10359-83dc-45e8-b303-bde04aca7afb admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:43.279343 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b10359-83dc-45e8-b303-bde04aca7afb admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:43.279871 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b10359-83dc-45e8-b303-bde04aca7afb admin admin] PATH_INFO: `/v3/projects/c18db8feb06040198f3bc00c84792de0/users/51a4587770ba48f480de96dfd5162bf3/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:43.290906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281f17b-bc05-4b8f-a3b1-58768a7d355e admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:43.296643 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91452a38-ff83-4ad3-9b92-95ef8b69ca3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:43.297685 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91452a38-ff83-4ad3-9b92-95ef8b69ca3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:43.298536 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91452a38-ff83-4ad3-9b92-95ef8b69ca3b admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:43.298913 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91452a38-ff83-4ad3-9b92-95ef8b69ca3b admin admin] PATH_INFO: `/v3/projects/81a429ff9b9d442d85ce84c0fe2f4c63` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:43.300388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91452a38-ff83-4ad3-9b92-95ef8b69ca3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=81a429ff9b9d442d85ce84c0fe2f4c63)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:43.302791 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91452a38-ff83-4ad3-9b92-95ef8b69ca3b admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:43.304034 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b10359-83dc-45e8-b303-bde04aca7afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c18db8feb06040198f3bc00c84792de0, user_id=51a4587770ba48f480de96dfd5162bf3, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:43.307331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b10359-83dc-45e8-b303-bde04aca7afb admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:43.344726 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1151/2310] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:43 2022] PUT /identity/v3/projects/c18db8feb06040198f3bc00c84792de0/users/51a4587770ba48f480de96dfd5162bf3/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:43.350475 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de079e-9408-4b67-98ff-b74d5d488699 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:43.351290 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de079e-9408-4b67-98ff-b74d5d488699 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:43.351290 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de079e-9408-4b67-98ff-b74d5d488699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:43.374148 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-19de079e-9408-4b67-98ff-b74d5d488699 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:43.375392 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-19de079e-9408-4b67-98ff-b74d5d488699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:43.378959 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-91452a38-ff83-4ad3-9b92-95ef8b69ca3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a429ff9b9d442d85ce84c0fe2f4c63', 'request_id': 'req-91452a38-ff83-4ad3-9b92-95ef8b69ca3b'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:43.385902 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-91452a38-ff83-4ad3-9b92-95ef8b69ca3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a429ff9b9d442d85ce84c0fe2f4c63', 'request_id': 'req-91452a38-ff83-4ad3-9b92-95ef8b69ca3b'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:43.394733 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-91452a38-ff83-4ad3-9b92-95ef8b69ca3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a429ff9b9d442d85ce84c0fe2f4c63', 'request_id': 'req-91452a38-ff83-4ad3-9b92-95ef8b69ca3b'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:43.408980 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-91452a38-ff83-4ad3-9b92-95ef8b69ca3b admin admin] The token cache is being invalidate because project 81a429ff9b9d442d85ce84c0fe2f4c63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:43.409200 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-91452a38-ff83-4ad3-9b92-95ef8b69ca3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:43.410152 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-91452a38-ff83-4ad3-9b92-95ef8b69ca3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:43.411798 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1160/2311] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:43 2022] DELETE /identity/v3/projects/81a429ff9b9d442d85ce84c0fe2f4c63 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:43.416336 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91452a38-ff83-4ad3-9b92-95ef8b69ca3b admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:43.417828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-91452a38-ff83-4ad3-9b92-95ef8b69ca3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:43.443936 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1152/2312] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:43.453753 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de079e-9408-4b67-98ff-b74d5d488699 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:43.455661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-19de079e-9408-4b67-98ff-b74d5d488699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:43.488500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91452a38-ff83-4ad3-9b92-95ef8b69ca3b admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:43.494017 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f63e7c-1fbd-49b0-b2e3-16b253c49aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:43.494893 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f63e7c-1fbd-49b0-b2e3-16b253c49aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:43.495201 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f63e7c-1fbd-49b0-b2e3-16b253c49aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:43.495534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f63e7c-1fbd-49b0-b2e3-16b253c49aa7 admin admin] PATH_INFO: `/v3/users/84346d1413fb42dbb6c096540f01f39d` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:43.496843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f63e7c-1fbd-49b0-b2e3-16b253c49aa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84346d1413fb42dbb6c096540f01f39d)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:43.498961 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f63e7c-1fbd-49b0-b2e3-16b253c49aa7 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:43.513005 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de079e-9408-4b67-98ff-b74d5d488699 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:43.516943 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e20e4-fd16-4d18-b649-c1cf0745b7ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:43.517674 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e20e4-fd16-4d18-b649-c1cf0745b7ae service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:43.518039 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e20e4-fd16-4d18-b649-c1cf0745b7ae service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:43.518317 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e20e4-fd16-4d18-b649-c1cf0745b7ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:43.529522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e20e4-fd16-4d18-b649-c1cf0745b7ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:43.531088 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e20e4-fd16-4d18-b649-c1cf0745b7ae service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:43.543394 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1153/2313] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:49:43.549926 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-99f63e7c-1fbd-49b0-b2e3-16b253c49aa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84346d1413fb42dbb6c096540f01f39d'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:43.558741 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-99f63e7c-1fbd-49b0-b2e3-16b253c49aa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84346d1413fb42dbb6c096540f01f39d'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:43.572119 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:43.574083 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-99f63e7c-1fbd-49b0-b2e3-16b253c49aa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84346d1413fb42dbb6c096540f01f39d'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:43.582030 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-99f63e7c-1fbd-49b0-b2e3-16b253c49aa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84346d1413fb42dbb6c096540f01f39d'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:43.582791 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-99f63e7c-1fbd-49b0-b2e3-16b253c49aa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84346d1413fb42dbb6c096540f01f39d'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:43.589741 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1161/2314] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:43 2022] DELETE /identity/v3/users/84346d1413fb42dbb6c096540f01f39d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:43.956002 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e20e4-fd16-4d18-b649-c1cf0745b7ae service neutron] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:43.972390 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e20e4-fd16-4d18-b649-c1cf0745b7ae service neutron] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:44.045561 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465f792-a0ac-4965-bcf9-56f23306e6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:44.046440 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465f792-a0ac-4965-bcf9-56f23306e6db admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:44.046747 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465f792-a0ac-4965-bcf9-56f23306e6db admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:44.047012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465f792-a0ac-4965-bcf9-56f23306e6db admin admin] PATH_INFO: `/v3/projects/31389dd7661449b9b319520af173b951` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:44.048324 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465f792-a0ac-4965-bcf9-56f23306e6db admin admin] RBAC: Authorizing `identity:delete_project(project_id=31389dd7661449b9b319520af173b951)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:44.050573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465f792-a0ac-4965-bcf9-56f23306e6db admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:44.059823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:44.109004 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d465f792-a0ac-4965-bcf9-56f23306e6db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31389dd7661449b9b319520af173b951', 'request_id': 'req-d465f792-a0ac-4965-bcf9-56f23306e6db'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:44.118012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d465f792-a0ac-4965-bcf9-56f23306e6db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31389dd7661449b9b319520af173b951', 'request_id': 'req-d465f792-a0ac-4965-bcf9-56f23306e6db'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:44.125599 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d465f792-a0ac-4965-bcf9-56f23306e6db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31389dd7661449b9b319520af173b951', 'request_id': 'req-d465f792-a0ac-4965-bcf9-56f23306e6db'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:44.141004 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d465f792-a0ac-4965-bcf9-56f23306e6db admin admin] The token cache is being invalidate because project 31389dd7661449b9b319520af173b951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:44.141292 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d465f792-a0ac-4965-bcf9-56f23306e6db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:44.141957 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d465f792-a0ac-4965-bcf9-56f23306e6db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:44.146278 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1154/2315] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:43 2022] DELETE /identity/v3/projects/31389dd7661449b9b319520af173b951 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:44.150531 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce526b-4774-43c9-bc24-97c51495c84d None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:44.151131 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce526b-4774-43c9-bc24-97c51495c84d None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:44.151238 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce526b-4774-43c9-bc24-97c51495c84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:44.169842 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-37ce526b-4774-43c9-bc24-97c51495c84d None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:44.171170 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-37ce526b-4774-43c9-bc24-97c51495c84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:44.233514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1162/2316] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:44.242280 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf9159-a924-46ee-824b-1ae8c84ee53f None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:44.242576 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf9159-a924-46ee-824b-1ae8c84ee53f None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:44.242862 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf9159-a924-46ee-824b-1ae8c84ee53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:44.265683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-2abf9159-a924-46ee-824b-1ae8c84ee53f None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:44.266937 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-2abf9159-a924-46ee-824b-1ae8c84ee53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:44.277462 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1155/2317] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:44.283867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce526b-4774-43c9-bc24-97c51495c84d None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:44.299507 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce526b-4774-43c9-bc24-97c51495c84d None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:44.305132 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d44d6-54cc-4725-bc43-7d8b6a6d14ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:44.306009 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d44d6-54cc-4725-bc43-7d8b6a6d14ab admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:44.306803 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d44d6-54cc-4725-bc43-7d8b6a6d14ab admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:44.306803 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d44d6-54cc-4725-bc43-7d8b6a6d14ab admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:44.307608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d44d6-54cc-4725-bc43-7d8b6a6d14ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:49:44.307916 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d44d6-54cc-4725-bc43-7d8b6a6d14ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:44.309832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d44d6-54cc-4725-bc43-7d8b6a6d14ab admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:44.326583 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1163/2318] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:49:44.331294 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf9159-a924-46ee-824b-1ae8c84ee53f None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:44.341638 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf9159-a924-46ee-824b-1ae8c84ee53f None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:44.347377 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd80771-82ad-4e87-a2cb-c5b56932fe23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:44.348055 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd80771-82ad-4e87-a2cb-c5b56932fe23 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:44.348341 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd80771-82ad-4e87-a2cb-c5b56932fe23 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:44.348616 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd80771-82ad-4e87-a2cb-c5b56932fe23 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:44.349317 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd80771-82ad-4e87-a2cb-c5b56932fe23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:44.351523 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd80771-82ad-4e87-a2cb-c5b56932fe23 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:44.390603 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1156/2319] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:44 2022] POST /identity/v3/projects => generated 399 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:49:44.395074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d44d6-54cc-4725-bc43-7d8b6a6d14ab admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:44.408950 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d44d6-54cc-4725-bc43-7d8b6a6d14ab admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:44.489681 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac42e4-34c8-4a21-b238-88182eaf9858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:44.490440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac42e4-34c8-4a21-b238-88182eaf9858 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:44.490818 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac42e4-34c8-4a21-b238-88182eaf9858 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:44.491188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac42e4-34c8-4a21-b238-88182eaf9858 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:44.492071 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac42e4-34c8-4a21-b238-88182eaf9858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:44.494305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beac42e4-34c8-4a21-b238-88182eaf9858 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:44.520205 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1164/2320] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:44 2022] POST /identity/v3/users => generated 300 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:44.524854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd80771-82ad-4e87-a2cb-c5b56932fe23 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:44.538358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd80771-82ad-4e87-a2cb-c5b56932fe23 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:44.544901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347e300-243b-4d01-a6a6-3320aa646d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:44.546378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347e300-243b-4d01-a6a6-3320aa646d5e admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:44.546892 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347e300-243b-4d01-a6a6-3320aa646d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:44.547360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347e300-243b-4d01-a6a6-3320aa646d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:44.548481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347e300-243b-4d01-a6a6-3320aa646d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:44.551073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347e300-243b-4d01-a6a6-3320aa646d5e admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:44.574194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1157/2321] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:44.576057 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac42e4-34c8-4a21-b238-88182eaf9858 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:44.590244 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac42e4-34c8-4a21-b238-88182eaf9858 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:44.595924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4383f7-a5c5-4324-98b9-04444c378e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:44.597118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4383f7-a5c5-4324-98b9-04444c378e83 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:44.597599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4383f7-a5c5-4324-98b9-04444c378e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:44.598068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4383f7-a5c5-4324-98b9-04444c378e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:44.598988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4383f7-a5c5-4324-98b9-04444c378e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:44.601083 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4383f7-a5c5-4324-98b9-04444c378e83 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:44.614424 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1165/2322] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:44.620074 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347e300-243b-4d01-a6a6-3320aa646d5e admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:44.643108 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347e300-243b-4d01-a6a6-3320aa646d5e admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:44.649460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d600b-14de-4963-8fed-4a891928e551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:44.651080 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d600b-14de-4963-8fed-4a891928e551 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:44.651622 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d600b-14de-4963-8fed-4a891928e551 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:44.652188 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d600b-14de-4963-8fed-4a891928e551 admin admin] PATH_INFO: `/v3/projects/83f209e2181f4211aa160004f8e91b73/users/aad2002829c44385a4062c3d1a6c248a/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:44.680169 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d600b-14de-4963-8fed-4a891928e551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f209e2181f4211aa160004f8e91b73, user_id=aad2002829c44385a4062c3d1a6c248a, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:44.683725 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d600b-14de-4963-8fed-4a891928e551 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:44.713462 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1158/2323] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:44 2022] PUT /identity/v3/projects/83f209e2181f4211aa160004f8e91b73/users/aad2002829c44385a4062c3d1a6c248a/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:44.717365 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234570d7-e62a-4e6b-9cd5-f7093e32f721 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:44.718350 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234570d7-e62a-4e6b-9cd5-f7093e32f721 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:44.718833 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234570d7-e62a-4e6b-9cd5-f7093e32f721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:44.763739 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-234570d7-e62a-4e6b-9cd5-f7093e32f721 None None] MFA Rules not processed for user `aad2002829c44385a4062c3d1a6c248a`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:44.765353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-234570d7-e62a-4e6b-9cd5-f7093e32f721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:44.820782 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:44.871894 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1166/2324] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:44.872914 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d600b-14de-4963-8fed-4a891928e551 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:44.950979 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d600b-14de-4963-8fed-4a891928e551 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:44.956138 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd317a02-7ab6-4472-b6ff-5180f4c55eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:44.956889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd317a02-7ab6-4472-b6ff-5180f4c55eae admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:44.957197 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd317a02-7ab6-4472-b6ff-5180f4c55eae admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:44.957465 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd317a02-7ab6-4472-b6ff-5180f4c55eae admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:44.958195 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd317a02-7ab6-4472-b6ff-5180f4c55eae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:44.960381 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd317a02-7ab6-4472-b6ff-5180f4c55eae admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:44.995698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1159/2325] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:44 2022] POST /identity/v3/projects => generated 401 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:44.999945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234570d7-e62a-4e6b-9cd5-f7093e32f721 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:45.012267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234570d7-e62a-4e6b-9cd5-f7093e32f721 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:45.095767 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e632d-2cc2-4e15-a918-cd2f5b62a2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:45.097269 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e632d-2cc2-4e15-a918-cd2f5b62a2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:45.097825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e632d-2cc2-4e15-a918-cd2f5b62a2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:45.098258 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e632d-2cc2-4e15-a918-cd2f5b62a2d0 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:45.099210 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e632d-2cc2-4e15-a918-cd2f5b62a2d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:45.102652 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e632d-2cc2-4e15-a918-cd2f5b62a2d0 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:45.126159 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1167/2326] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:44 2022] POST /identity/v3/users => generated 307 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:49:45.130336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd317a02-7ab6-4472-b6ff-5180f4c55eae admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:45.147348 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd317a02-7ab6-4472-b6ff-5180f4c55eae admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:45.153644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae5fa8-6f8e-4491-8c10-e6915efb8ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:45.153644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae5fa8-6f8e-4491-8c10-e6915efb8ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:45.154294 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae5fa8-6f8e-4491-8c10-e6915efb8ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:45.154480 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae5fa8-6f8e-4491-8c10-e6915efb8ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:45.155248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae5fa8-6f8e-4491-8c10-e6915efb8ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:45.156898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae5fa8-6f8e-4491-8c10-e6915efb8ba6 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:45.169602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1160/2327] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:45.174106 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e632d-2cc2-4e15-a918-cd2f5b62a2d0 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:45.186053 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e632d-2cc2-4e15-a918-cd2f5b62a2d0 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:45.191645 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca3e4a-d5c3-4d05-a5e1-4cf34124e0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:45.192596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca3e4a-d5c3-4d05-a5e1-4cf34124e0a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:45.192880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca3e4a-d5c3-4d05-a5e1-4cf34124e0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:45.193158 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca3e4a-d5c3-4d05-a5e1-4cf34124e0a6 admin admin] PATH_INFO: `/v3/projects/b7303acefc40461ab0fc8cd91d87b203/users/af2b4d11f7f54a9b8881db8e57065196/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:45.214775 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca3e4a-d5c3-4d05-a5e1-4cf34124e0a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7303acefc40461ab0fc8cd91d87b203, user_id=af2b4d11f7f54a9b8881db8e57065196, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:45.217407 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca3e4a-d5c3-4d05-a5e1-4cf34124e0a6 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:45.234917 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1168/2328] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:45 2022] PUT /identity/v3/projects/b7303acefc40461ab0fc8cd91d87b203/users/af2b4d11f7f54a9b8881db8e57065196/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:45.241681 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae5fa8-6f8e-4491-8c10-e6915efb8ba6 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:45.255084 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae5fa8-6f8e-4491-8c10-e6915efb8ba6 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:45.259680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:45.363783 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c634e24-6705-43cd-b483-79538345d392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:45.364476 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c634e24-6705-43cd-b483-79538345d392 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:45.364759 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c634e24-6705-43cd-b483-79538345d392 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:45.365618 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c634e24-6705-43cd-b483-79538345d392 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:45.366110 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c634e24-6705-43cd-b483-79538345d392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:45.370993 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c634e24-6705-43cd-b483-79538345d392 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:45.384595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1161/2329] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:45.388656 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca3e4a-d5c3-4d05-a5e1-4cf34124e0a6 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:45.404109 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca3e4a-d5c3-4d05-a5e1-4cf34124e0a6 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:45.420792 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa99b01-0db9-4e0a-aa0b-4cca3fc45170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:45.421893 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa99b01-0db9-4e0a-aa0b-4cca3fc45170 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:45.422186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa99b01-0db9-4e0a-aa0b-4cca3fc45170 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:45.422515 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa99b01-0db9-4e0a-aa0b-4cca3fc45170 admin admin] PATH_INFO: `/v3/projects/b7303acefc40461ab0fc8cd91d87b203/users/af2b4d11f7f54a9b8881db8e57065196/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:45.424960 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa99b01-0db9-4e0a-aa0b-4cca3fc45170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7303acefc40461ab0fc8cd91d87b203, user_id=af2b4d11f7f54a9b8881db8e57065196, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:45.430384 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa99b01-0db9-4e0a-aa0b-4cca3fc45170 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:45.447864 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1169/2330] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:45 2022] PUT /identity/v3/projects/b7303acefc40461ab0fc8cd91d87b203/users/af2b4d11f7f54a9b8881db8e57065196/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:45.464644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90f6a6-6353-4fe6-86a7-6dea0b740328 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:45.464984 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90f6a6-6353-4fe6-86a7-6dea0b740328 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:45.465402 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b90f6a6-6353-4fe6-86a7-6dea0b740328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:45.514089 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-8b90f6a6-6353-4fe6-86a7-6dea0b740328 None None] MFA Rules not processed for user `af2b4d11f7f54a9b8881db8e57065196`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:45.515771 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-8b90f6a6-6353-4fe6-86a7-6dea0b740328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:45.637023 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1162/2331] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:45 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:45.663311 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa99b01-0db9-4e0a-aa0b-4cca3fc45170 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:45.665210 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3aa99b01-0db9-4e0a-aa0b-4cca3fc45170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:45.739959 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa99b01-0db9-4e0a-aa0b-4cca3fc45170 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:45.744615 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f2c26-039b-4c25-b49a-76333a4daf55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:45.745384 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f2c26-039b-4c25-b49a-76333a4daf55 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:45.745751 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f2c26-039b-4c25-b49a-76333a4daf55 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:45.746034 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f2c26-039b-4c25-b49a-76333a4daf55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:45.777170 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f2c26-039b-4c25-b49a-76333a4daf55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:45.778674 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f2c26-039b-4c25-b49a-76333a4daf55 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:45.798469 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1170/2332] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:45 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:45.908098 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90f6a6-6353-4fe6-86a7-6dea0b740328 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:45.922996 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b90f6a6-6353-4fe6-86a7-6dea0b740328 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:45.928780 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d71c6-2e96-4853-ba01-1dac9aae5c75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:45.929689 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d71c6-2e96-4853-ba01-1dac9aae5c75 service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:45.930765 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d71c6-2e96-4853-ba01-1dac9aae5c75 service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:45.931157 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d71c6-2e96-4853-ba01-1dac9aae5c75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:46.028562 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d71c6-2e96-4853-ba01-1dac9aae5c75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:46.030280 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d71c6-2e96-4853-ba01-1dac9aae5c75 service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:46.042098 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1163/2333] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:48.934978 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eb2c0-6bbd-48b1-b0f2-53e0cbb0e728 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:48.935508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eb2c0-6bbd-48b1-b0f2-53e0cbb0e728 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:48.935625 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eb2c0-6bbd-48b1-b0f2-53e0cbb0e728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:48.967381 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-e51eb2c0-6bbd-48b1-b0f2-53e0cbb0e728 None None] MFA Rules not processed for user `51a4587770ba48f480de96dfd5162bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:48.968814 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e51eb2c0-6bbd-48b1-b0f2-53e0cbb0e728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:48.999536 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:49.042136 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1171/2334] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:49.056997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d71c6-2e96-4853-ba01-1dac9aae5c75 service cinder] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:49.058476 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-932d71c6-2e96-4853-ba01-1dac9aae5c75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:49.124934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:49.199608 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d71c6-2e96-4853-ba01-1dac9aae5c75 service cinder] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:49.205314 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2556c790-6905-4dd0-89ec-9d50be1d4580 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:49.206160 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556c790-6905-4dd0-89ec-9d50be1d4580 service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:49.206476 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556c790-6905-4dd0-89ec-9d50be1d4580 service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:49.206850 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2556c790-6905-4dd0-89ec-9d50be1d4580 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:49.221234 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556c790-6905-4dd0-89ec-9d50be1d4580 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:49.222865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2556c790-6905-4dd0-89ec-9d50be1d4580 service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:49.234335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1164/2335] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:50.611082 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eb2c0-6bbd-48b1-b0f2-53e0cbb0e728 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:50.691056 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eb2c0-6bbd-48b1-b0f2-53e0cbb0e728 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:50.696034 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a9048-ea71-4685-a1f5-282399c93f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:50.696939 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a9048-ea71-4685-a1f5-282399c93f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:50.697219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a9048-ea71-4685-a1f5-282399c93f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:50.697495 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a9048-ea71-4685-a1f5-282399c93f9b admin admin] PATH_INFO: `/v3/users/aad2002829c44385a4062c3d1a6c248a` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:50.699023 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a9048-ea71-4685-a1f5-282399c93f9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad2002829c44385a4062c3d1a6c248a)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:50.701024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a9048-ea71-4685-a1f5-282399c93f9b admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:50.756241 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-192a9048-ea71-4685-a1f5-282399c93f9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad2002829c44385a4062c3d1a6c248a'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:50.764908 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-192a9048-ea71-4685-a1f5-282399c93f9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad2002829c44385a4062c3d1a6c248a'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:50.785941 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-192a9048-ea71-4685-a1f5-282399c93f9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad2002829c44385a4062c3d1a6c248a'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:50.804032 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-192a9048-ea71-4685-a1f5-282399c93f9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad2002829c44385a4062c3d1a6c248a'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:50.805393 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-192a9048-ea71-4685-a1f5-282399c93f9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad2002829c44385a4062c3d1a6c248a'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:50.831194 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1172/2336] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:50 2022] DELETE /identity/v3/users/aad2002829c44385a4062c3d1a6c248a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:50.836796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2ec34-51a1-4064-ab69-0f4eac67551f None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:50.837363 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2ec34-51a1-4064-ab69-0f4eac67551f None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:50.837583 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2ec34-51a1-4064-ab69-0f4eac67551f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:50.869760 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-78c2ec34-51a1-4064-ab69-0f4eac67551f None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:50.871889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-78c2ec34-51a1-4064-ab69-0f4eac67551f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:50.891460 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57ecfd-0b4b-490e-9307-60989bcfb136 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:50.891460 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57ecfd-0b4b-490e-9307-60989bcfb136 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:50.891460 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57ecfd-0b4b-490e-9307-60989bcfb136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:50.923964 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-2b57ecfd-0b4b-490e-9307-60989bcfb136 None None] MFA Rules not processed for user `51a4587770ba48f480de96dfd5162bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:50.925428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-2b57ecfd-0b4b-490e-9307-60989bcfb136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:50.993979 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:50.996148 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1165/2337] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:51.012038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2ec34-51a1-4064-ab69-0f4eac67551f None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:51.013403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-78c2ec34-51a1-4064-ab69-0f4eac67551f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:51.023338 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1173/2338] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:51.094347 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2ec34-51a1-4064-ab69-0f4eac67551f None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:51.098399 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bb638-391c-4391-bf48-992ea2677768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:51.098943 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb638-391c-4391-bf48-992ea2677768 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:51.099644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb638-391c-4391-bf48-992ea2677768 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:51.099883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bb638-391c-4391-bf48-992ea2677768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:51.115227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bb638-391c-4391-bf48-992ea2677768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:51.121921 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bb638-391c-4391-bf48-992ea2677768 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:51.136898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1166/2339] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:49:51.547547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57ecfd-0b4b-490e-9307-60989bcfb136 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:51.549278 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-2b57ecfd-0b4b-490e-9307-60989bcfb136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:51.567410 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57ecfd-0b4b-490e-9307-60989bcfb136 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:51.576045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf21d93-5840-4b2b-86c8-36acebedc4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:51.578975 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf21d93-5840-4b2b-86c8-36acebedc4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:51.580536 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf21d93-5840-4b2b-86c8-36acebedc4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:51.581266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf21d93-5840-4b2b-86c8-36acebedc4bd admin admin] PATH_INFO: `/v3/projects/83f209e2181f4211aa160004f8e91b73` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:51.582828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf21d93-5840-4b2b-86c8-36acebedc4bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=83f209e2181f4211aa160004f8e91b73)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:51.585646 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf21d93-5840-4b2b-86c8-36acebedc4bd admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:51.700465 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-9cf21d93-5840-4b2b-86c8-36acebedc4bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83f209e2181f4211aa160004f8e91b73', 'request_id': 'req-9cf21d93-5840-4b2b-86c8-36acebedc4bd'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:51.706834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-9cf21d93-5840-4b2b-86c8-36acebedc4bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83f209e2181f4211aa160004f8e91b73', 'request_id': 'req-9cf21d93-5840-4b2b-86c8-36acebedc4bd'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:51.716624 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-9cf21d93-5840-4b2b-86c8-36acebedc4bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83f209e2181f4211aa160004f8e91b73', 'request_id': 'req-9cf21d93-5840-4b2b-86c8-36acebedc4bd'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:51.744204 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-9cf21d93-5840-4b2b-86c8-36acebedc4bd admin admin] The token cache is being invalidate because project 83f209e2181f4211aa160004f8e91b73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:51.744710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-9cf21d93-5840-4b2b-86c8-36acebedc4bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:51.745548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-9cf21d93-5840-4b2b-86c8-36acebedc4bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:51.750586 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1174/2340] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:51 2022] DELETE /identity/v3/projects/83f209e2181f4211aa160004f8e91b73 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:51.751949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bb638-391c-4391-bf48-992ea2677768 service neutron] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:51.765474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bb638-391c-4391-bf48-992ea2677768 service neutron] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:51.870031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:51.884378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ab35f-8790-4356-a61f-68958b9005f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:51.887031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ab35f-8790-4356-a61f-68958b9005f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:51.887634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ab35f-8790-4356-a61f-68958b9005f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:51.888221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ab35f-8790-4356-a61f-68958b9005f9 admin admin] PATH_INFO: `/v3/users/af2b4d11f7f54a9b8881db8e57065196` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:51.894941 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ab35f-8790-4356-a61f-68958b9005f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2b4d11f7f54a9b8881db8e57065196)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:51.901562 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ab35f-8790-4356-a61f-68958b9005f9 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:52.006456 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-0b9ab35f-8790-4356-a61f-68958b9005f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2b4d11f7f54a9b8881db8e57065196'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:52.021370 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-0b9ab35f-8790-4356-a61f-68958b9005f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2b4d11f7f54a9b8881db8e57065196'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:52.043453 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-0b9ab35f-8790-4356-a61f-68958b9005f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2b4d11f7f54a9b8881db8e57065196'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:52.043837 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-0b9ab35f-8790-4356-a61f-68958b9005f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2b4d11f7f54a9b8881db8e57065196'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:52.056853 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-0b9ab35f-8790-4356-a61f-68958b9005f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2b4d11f7f54a9b8881db8e57065196'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:52.072693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1167/2341] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:51 2022] DELETE /identity/v3/users/af2b4d11f7f54a9b8881db8e57065196 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:52.888195 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf21d93-5840-4b2b-86c8-36acebedc4bd admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:52.892425 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-9cf21d93-5840-4b2b-86c8-36acebedc4bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:52.937646 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf21d93-5840-4b2b-86c8-36acebedc4bd admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:53.104933 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e10d67-e56b-4934-91cc-2968933eb60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:53.106288 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e10d67-e56b-4934-91cc-2968933eb60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:53.106867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e10d67-e56b-4934-91cc-2968933eb60c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:53.107487 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e10d67-e56b-4934-91cc-2968933eb60c admin admin] PATH_INFO: `/v3/projects/b7303acefc40461ab0fc8cd91d87b203` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:53.109243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e10d67-e56b-4934-91cc-2968933eb60c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7303acefc40461ab0fc8cd91d87b203)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:53.111818 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e10d67-e56b-4934-91cc-2968933eb60c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:53.175702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-a6e10d67-e56b-4934-91cc-2968933eb60c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7303acefc40461ab0fc8cd91d87b203', 'request_id': 'req-a6e10d67-e56b-4934-91cc-2968933eb60c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:53.188546 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-a6e10d67-e56b-4934-91cc-2968933eb60c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7303acefc40461ab0fc8cd91d87b203', 'request_id': 'req-a6e10d67-e56b-4934-91cc-2968933eb60c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:53.199595 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-a6e10d67-e56b-4934-91cc-2968933eb60c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7303acefc40461ab0fc8cd91d87b203', 'request_id': 'req-a6e10d67-e56b-4934-91cc-2968933eb60c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:53.227804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-a6e10d67-e56b-4934-91cc-2968933eb60c admin admin] The token cache is being invalidate because project b7303acefc40461ab0fc8cd91d87b203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:53.228190 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-a6e10d67-e56b-4934-91cc-2968933eb60c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:53.229993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-a6e10d67-e56b-4934-91cc-2968933eb60c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:53.235340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1175/2342] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:52 2022] DELETE /identity/v3/projects/b7303acefc40461ab0fc8cd91d87b203 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:53.245315 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ccfc4-0921-43ea-859e-147cde4b5741 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:53.245791 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ccfc4-0921-43ea-859e-147cde4b5741 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:53.246361 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ccfc4-0921-43ea-859e-147cde4b5741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:53.277420 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-135ccfc4-0921-43ea-859e-147cde4b5741 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:53.278991 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-135ccfc4-0921-43ea-859e-147cde4b5741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:53.398415 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1168/2343] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:53.400010 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2e123-790b-496b-b1da-d8d4bde13a45 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:53.400300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2e123-790b-496b-b1da-d8d4bde13a45 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:53.400797 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2e123-790b-496b-b1da-d8d4bde13a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:53.418928 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:53.426469 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-3bc2e123-790b-496b-b1da-d8d4bde13a45 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:53.428501 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3bc2e123-790b-496b-b1da-d8d4bde13a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:53.453471 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ccfc4-0921-43ea-859e-147cde4b5741 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:53.461894 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1176/2344] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:53.470258 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ccfc4-0921-43ea-859e-147cde4b5741 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:53.475591 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c327cc-4b96-4463-9c88-864a2a4145c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:53.477186 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c327cc-4b96-4463-9c88-864a2a4145c7 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:53.477703 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c327cc-4b96-4463-9c88-864a2a4145c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:53.478177 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c327cc-4b96-4463-9c88-864a2a4145c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:53.479137 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c327cc-4b96-4463-9c88-864a2a4145c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:49:53.479683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c327cc-4b96-4463-9c88-864a2a4145c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:53.481841 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c327cc-4b96-4463-9c88-864a2a4145c7 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:53.504818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1169/2345] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:49:53.506534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2e123-790b-496b-b1da-d8d4bde13a45 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:53.516891 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2e123-790b-496b-b1da-d8d4bde13a45 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:53.523420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08e5f0-050d-485e-b6fb-535220ffee73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:53.524103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08e5f0-050d-485e-b6fb-535220ffee73 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:53.524377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08e5f0-050d-485e-b6fb-535220ffee73 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:53.524650 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08e5f0-050d-485e-b6fb-535220ffee73 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:53.525350 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08e5f0-050d-485e-b6fb-535220ffee73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:53.527291 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f08e5f0-050d-485e-b6fb-535220ffee73 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:53.563761 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1177/2346] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:53 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:53.568051 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c327cc-4b96-4463-9c88-864a2a4145c7 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:53.587442 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c327cc-4b96-4463-9c88-864a2a4145c7 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:53.691955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d09bd8-e860-45ba-abd9-175f60ce6160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:53.692780 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d09bd8-e860-45ba-abd9-175f60ce6160 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:53.693137 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d09bd8-e860-45ba-abd9-175f60ce6160 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:53.693490 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d09bd8-e860-45ba-abd9-175f60ce6160 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:53.694287 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d09bd8-e860-45ba-abd9-175f60ce6160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:53.696473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d09bd8-e860-45ba-abd9-175f60ce6160 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:53.706018 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:53.733997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1170/2347] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:53 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:49:53.738279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08e5f0-050d-485e-b6fb-535220ffee73 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:53.759081 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08e5f0-050d-485e-b6fb-535220ffee73 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:53.777101 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805b2ee-0707-4d6c-b9b0-1288c489c76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:53.778437 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805b2ee-0707-4d6c-b9b0-1288c489c76e admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:53.778784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805b2ee-0707-4d6c-b9b0-1288c489c76e admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:53.779064 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805b2ee-0707-4d6c-b9b0-1288c489c76e admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:53.779906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805b2ee-0707-4d6c-b9b0-1288c489c76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:53.781891 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805b2ee-0707-4d6c-b9b0-1288c489c76e admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:53.801968 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1178/2348] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:53.806024 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d09bd8-e860-45ba-abd9-175f60ce6160 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:53.819294 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d09bd8-e860-45ba-abd9-175f60ce6160 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:53.826793 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba2597-fc9d-46ef-ad9b-295fb6ff2faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:53.827746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba2597-fc9d-46ef-ad9b-295fb6ff2faf admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:53.828180 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba2597-fc9d-46ef-ad9b-295fb6ff2faf admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:53.828555 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba2597-fc9d-46ef-ad9b-295fb6ff2faf admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:53.829499 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba2597-fc9d-46ef-ad9b-295fb6ff2faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:53.831293 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba2597-fc9d-46ef-ad9b-295fb6ff2faf admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:53.844969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1171/2349] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:53.849291 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805b2ee-0707-4d6c-b9b0-1288c489c76e admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:53.860910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805b2ee-0707-4d6c-b9b0-1288c489c76e admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:53.866107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ca322-9b4a-4013-81db-8b0ff77ded72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:53.867786 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ca322-9b4a-4013-81db-8b0ff77ded72 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:53.868194 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ca322-9b4a-4013-81db-8b0ff77ded72 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:53.868575 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ca322-9b4a-4013-81db-8b0ff77ded72 admin admin] PATH_INFO: `/v3/projects/35e6b89456db4c9abbb9684828b8306f/users/7abb5aae48ed4a4c838e675d7ead50fb/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:53.894092 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ca322-9b4a-4013-81db-8b0ff77ded72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e6b89456db4c9abbb9684828b8306f, user_id=7abb5aae48ed4a4c838e675d7ead50fb, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:53.901725 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ca322-9b4a-4013-81db-8b0ff77ded72 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:53.921489 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1179/2350] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:53 2022] PUT /identity/v3/projects/35e6b89456db4c9abbb9684828b8306f/users/7abb5aae48ed4a4c838e675d7ead50fb/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:54.010185 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5cf7d-c517-4b01-bb5b-dfa7a70c4005 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:54.010405 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5cf7d-c517-4b01-bb5b-dfa7a70c4005 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:54.011154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5cf7d-c517-4b01-bb5b-dfa7a70c4005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:54.048369 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-f1a5cf7d-c517-4b01-bb5b-dfa7a70c4005 None None] MFA Rules not processed for user `7abb5aae48ed4a4c838e675d7ead50fb`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:54.050891 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-f1a5cf7d-c517-4b01-bb5b-dfa7a70c4005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:54.145828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1172/2351] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:49:54.151689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ca322-9b4a-4013-81db-8b0ff77ded72 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:54.271512 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ca322-9b4a-4013-81db-8b0ff77ded72 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:54.279838 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890752b6-0daf-4d2d-941d-a40c4345cc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:54.280913 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890752b6-0daf-4d2d-941d-a40c4345cc17 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:54.281399 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890752b6-0daf-4d2d-941d-a40c4345cc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:54.281883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890752b6-0daf-4d2d-941d-a40c4345cc17 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:54.282943 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890752b6-0daf-4d2d-941d-a40c4345cc17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:54.285862 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890752b6-0daf-4d2d-941d-a40c4345cc17 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:54.340043 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1180/2352] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:49:54 2022] POST /identity/v3/projects => generated 383 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:54.345029 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5cf7d-c517-4b01-bb5b-dfa7a70c4005 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:54.360618 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5cf7d-c517-4b01-bb5b-dfa7a70c4005 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:54.444115 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a91344-5183-4219-b5dd-e60f9db4646e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:54.445617 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a91344-5183-4219-b5dd-e60f9db4646e admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:54.445963 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a91344-5183-4219-b5dd-e60f9db4646e admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:54.446306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a91344-5183-4219-b5dd-e60f9db4646e admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:54.447003 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a91344-5183-4219-b5dd-e60f9db4646e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:54.448938 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a91344-5183-4219-b5dd-e60f9db4646e admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:54.486699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1173/2353] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:49:54 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:49:54.490422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890752b6-0daf-4d2d-941d-a40c4345cc17 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:54.515692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890752b6-0daf-4d2d-941d-a40c4345cc17 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:54.526358 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1444e9-558e-44dd-b016-097aa640a1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:54.527635 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1444e9-558e-44dd-b016-097aa640a1dd admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:54.528183 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1444e9-558e-44dd-b016-097aa640a1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:54.528865 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1444e9-558e-44dd-b016-097aa640a1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:54.530129 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1444e9-558e-44dd-b016-097aa640a1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:54.531998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1444e9-558e-44dd-b016-097aa640a1dd admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:54.555407 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1181/2354] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:49:54.557256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a91344-5183-4219-b5dd-e60f9db4646e admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:54.572190 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a91344-5183-4219-b5dd-e60f9db4646e admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:54.579631 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e4b5c-06a0-4646-a79b-4e4ad1d1f044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:54.581076 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e4b5c-06a0-4646-a79b-4e4ad1d1f044 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:54.582026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e4b5c-06a0-4646-a79b-4e4ad1d1f044 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:54.582496 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e4b5c-06a0-4646-a79b-4e4ad1d1f044 admin admin] PATH_INFO: `/v3/projects/4435749d4c89428286e66da156d17795/users/813b3681c4824655ba7f4d17508489c3/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:54.603369 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e4b5c-06a0-4646-a79b-4e4ad1d1f044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4435749d4c89428286e66da156d17795, user_id=813b3681c4824655ba7f4d17508489c3, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:54.608041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e4b5c-06a0-4646-a79b-4e4ad1d1f044 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:54.626559 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1174/2355] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:54 2022] PUT /identity/v3/projects/4435749d4c89428286e66da156d17795/users/813b3681c4824655ba7f4d17508489c3/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:54.630523 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1444e9-558e-44dd-b016-097aa640a1dd admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:54.645172 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1444e9-558e-44dd-b016-097aa640a1dd admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:54.796118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2c8aa-b096-40e0-af66-b827c715325f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:54.797689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2c8aa-b096-40e0-af66-b827c715325f admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:54.798045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2c8aa-b096-40e0-af66-b827c715325f admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:54.798385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2c8aa-b096-40e0-af66-b827c715325f admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:54.799126 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2c8aa-b096-40e0-af66-b827c715325f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:54.801203 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2c8aa-b096-40e0-af66-b827c715325f admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:54.815315 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1182/2356] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:49:54.823176 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e4b5c-06a0-4646-a79b-4e4ad1d1f044 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:54.841337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e4b5c-06a0-4646-a79b-4e4ad1d1f044 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:54.847859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315cf3f-def3-4a89-9dac-4d503cca0262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:54.850417 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315cf3f-def3-4a89-9dac-4d503cca0262 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:54.851237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315cf3f-def3-4a89-9dac-4d503cca0262 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:54.851542 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315cf3f-def3-4a89-9dac-4d503cca0262 admin admin] PATH_INFO: `/v3/projects/4435749d4c89428286e66da156d17795/users/813b3681c4824655ba7f4d17508489c3/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:54.854040 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315cf3f-def3-4a89-9dac-4d503cca0262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4435749d4c89428286e66da156d17795, user_id=813b3681c4824655ba7f4d17508489c3, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:54.857355 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315cf3f-def3-4a89-9dac-4d503cca0262 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:54.879320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1175/2357] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:49:54 2022] PUT /identity/v3/projects/4435749d4c89428286e66da156d17795/users/813b3681c4824655ba7f4d17508489c3/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:49:54.889747 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299930e-c694-4863-9050-a51bff73284f None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:54.890611 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299930e-c694-4863-9050-a51bff73284f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:54.891156 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299930e-c694-4863-9050-a51bff73284f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:54.923565 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:54.928717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-6299930e-c694-4863-9050-a51bff73284f None None] MFA Rules not processed for user `813b3681c4824655ba7f4d17508489c3`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:54.930367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-6299930e-c694-4863-9050-a51bff73284f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:55.028065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1183/2358] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:49:55.037568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315cf3f-def3-4a89-9dac-4d503cca0262 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:55.040421 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-6315cf3f-def3-4a89-9dac-4d503cca0262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:55.071415 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:55.110598 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315cf3f-def3-4a89-9dac-4d503cca0262 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:55.118486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59eabc-ea97-4b4b-940e-51f953c950af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:55.119187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59eabc-ea97-4b4b-940e-51f953c950af service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:55.119502 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59eabc-ea97-4b4b-940e-51f953c950af service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:55.119783 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59eabc-ea97-4b4b-940e-51f953c950af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:55.135416 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59eabc-ea97-4b4b-940e-51f953c950af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:55.137109 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59eabc-ea97-4b4b-940e-51f953c950af service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:55.150112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1176/2359] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:55.227840 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299930e-c694-4863-9050-a51bff73284f None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:55.238939 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299930e-c694-4863-9050-a51bff73284f None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:55.244231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b2bda-b133-4812-a00e-9abf9fa5f29a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:55.244873 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b2bda-b133-4812-a00e-9abf9fa5f29a service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:55.245360 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b2bda-b133-4812-a00e-9abf9fa5f29a service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:55.245763 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b2bda-b133-4812-a00e-9abf9fa5f29a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:55.316035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b2bda-b133-4812-a00e-9abf9fa5f29a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:55.317679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b2bda-b133-4812-a00e-9abf9fa5f29a service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:55.330440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1184/2360] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:55.614715 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59eabc-ea97-4b4b-940e-51f953c950af service cinder] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:55.687053 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59eabc-ea97-4b4b-940e-51f953c950af service cinder] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:55.693509 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab8520-a53d-4eac-8563-1a0f6733eaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:55.695207 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab8520-a53d-4eac-8563-1a0f6733eaaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:55.695537 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab8520-a53d-4eac-8563-1a0f6733eaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:55.695823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab8520-a53d-4eac-8563-1a0f6733eaaf admin admin] PATH_INFO: `/v3/users/7abb5aae48ed4a4c838e675d7ead50fb` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:55.697229 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab8520-a53d-4eac-8563-1a0f6733eaaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7abb5aae48ed4a4c838e675d7ead50fb)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:55.702835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab8520-a53d-4eac-8563-1a0f6733eaaf admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:55.758657 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-49ab8520-a53d-4eac-8563-1a0f6733eaaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7abb5aae48ed4a4c838e675d7ead50fb'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:55.770571 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-49ab8520-a53d-4eac-8563-1a0f6733eaaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7abb5aae48ed4a4c838e675d7ead50fb'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:55.787494 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-49ab8520-a53d-4eac-8563-1a0f6733eaaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7abb5aae48ed4a4c838e675d7ead50fb'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:55.788593 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-49ab8520-a53d-4eac-8563-1a0f6733eaaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7abb5aae48ed4a4c838e675d7ead50fb'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:55.804940 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-49ab8520-a53d-4eac-8563-1a0f6733eaaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7abb5aae48ed4a4c838e675d7ead50fb'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:55.811074 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1177/2361] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:55 2022] DELETE /identity/v3/users/7abb5aae48ed4a4c838e675d7ead50fb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:55.815782 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e649395-355e-47a4-996c-8c095f914f00 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:55.816161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e649395-355e-47a4-996c-8c095f914f00 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:55.816579 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e649395-355e-47a4-996c-8c095f914f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:55.835950 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-5e649395-355e-47a4-996c-8c095f914f00 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:49:55.837714 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-5e649395-355e-47a4-996c-8c095f914f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:55.922508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1185/2362] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:49:55.933404 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab8520-a53d-4eac-8563-1a0f6733eaaf admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:55.934845 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-49ab8520-a53d-4eac-8563-1a0f6733eaaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:55.991937 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:56.008318 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab8520-a53d-4eac-8563-1a0f6733eaaf admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:56.012722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbbf02-0fb4-4559-964e-81d39dc97291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:56.013385 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbbf02-0fb4-4559-964e-81d39dc97291 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:56.013669 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbbf02-0fb4-4559-964e-81d39dc97291 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:56.013947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbbf02-0fb4-4559-964e-81d39dc97291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:56.023940 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbbf02-0fb4-4559-964e-81d39dc97291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:56.025374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbbf02-0fb4-4559-964e-81d39dc97291 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:56.036162 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1178/2363] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:49:56.336295 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e649395-355e-47a4-996c-8c095f914f00 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:56.338246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-5e649395-355e-47a4-996c-8c095f914f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:56.352181 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e649395-355e-47a4-996c-8c095f914f00 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:56.358961 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76bc07-17dc-4b92-b4d1-654019129d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:56.359900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76bc07-17dc-4b92-b4d1-654019129d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:56.360186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76bc07-17dc-4b92-b4d1-654019129d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:56.360470 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76bc07-17dc-4b92-b4d1-654019129d7b admin admin] PATH_INFO: `/v3/projects/35e6b89456db4c9abbb9684828b8306f` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:56.362084 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76bc07-17dc-4b92-b4d1-654019129d7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=35e6b89456db4c9abbb9684828b8306f)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:56.364071 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76bc07-17dc-4b92-b4d1-654019129d7b admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:56.412855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:49:56.430498 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-cc76bc07-17dc-4b92-b4d1-654019129d7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35e6b89456db4c9abbb9684828b8306f', 'request_id': 'req-cc76bc07-17dc-4b92-b4d1-654019129d7b'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:56.440347 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-cc76bc07-17dc-4b92-b4d1-654019129d7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35e6b89456db4c9abbb9684828b8306f', 'request_id': 'req-cc76bc07-17dc-4b92-b4d1-654019129d7b'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:56.449055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-cc76bc07-17dc-4b92-b4d1-654019129d7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35e6b89456db4c9abbb9684828b8306f', 'request_id': 'req-cc76bc07-17dc-4b92-b4d1-654019129d7b'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:56.462368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-cc76bc07-17dc-4b92-b4d1-654019129d7b admin admin] The token cache is being invalidate because project 35e6b89456db4c9abbb9684828b8306f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:56.462750 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-cc76bc07-17dc-4b92-b4d1-654019129d7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:56.463492 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-cc76bc07-17dc-4b92-b4d1-654019129d7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:56.468736 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1186/2364] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:56 2022] DELETE /identity/v3/projects/35e6b89456db4c9abbb9684828b8306f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:56.470094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbbf02-0fb4-4559-964e-81d39dc97291 service neutron] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:56.480893 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbbf02-0fb4-4559-964e-81d39dc97291 service neutron] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:56.548163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab55dd4-025b-41bc-b3e0-95ca07764d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:56.549167 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab55dd4-025b-41bc-b3e0-95ca07764d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:56.549608 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab55dd4-025b-41bc-b3e0-95ca07764d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:56.549894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab55dd4-025b-41bc-b3e0-95ca07764d1e admin admin] PATH_INFO: `/v3/users/813b3681c4824655ba7f4d17508489c3` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:56.551191 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab55dd4-025b-41bc-b3e0-95ca07764d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=813b3681c4824655ba7f4d17508489c3)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:56.553526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab55dd4-025b-41bc-b3e0-95ca07764d1e admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:56.607938 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-dab55dd4-025b-41bc-b3e0-95ca07764d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '813b3681c4824655ba7f4d17508489c3'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:56.616217 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-dab55dd4-025b-41bc-b3e0-95ca07764d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '813b3681c4824655ba7f4d17508489c3'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:56.629378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-dab55dd4-025b-41bc-b3e0-95ca07764d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '813b3681c4824655ba7f4d17508489c3'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:56.630126 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-dab55dd4-025b-41bc-b3e0-95ca07764d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '813b3681c4824655ba7f4d17508489c3'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:56.637784 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-dab55dd4-025b-41bc-b3e0-95ca07764d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '813b3681c4824655ba7f4d17508489c3'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:56.645117 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1179/2365] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:49:56 2022] DELETE /identity/v3/users/813b3681c4824655ba7f4d17508489c3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:49:56.946543 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76bc07-17dc-4b92-b4d1-654019129d7b admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:49:56.948353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-cc76bc07-17dc-4b92-b4d1-654019129d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:49:56.975417 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76bc07-17dc-4b92-b4d1-654019129d7b admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:49:57.087387 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84403105-45ac-46d4-9094-db6e7667475e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:49:57.089868 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84403105-45ac-46d4-9094-db6e7667475e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:49:57.090393 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84403105-45ac-46d4-9094-db6e7667475e admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:49:57.091047 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84403105-45ac-46d4-9094-db6e7667475e admin admin] PATH_INFO: `/v3/projects/4435749d4c89428286e66da156d17795` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:49:57.092771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84403105-45ac-46d4-9094-db6e7667475e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4435749d4c89428286e66da156d17795)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:49:57.095862 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84403105-45ac-46d4-9094-db6e7667475e admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:49:57.169916 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-84403105-45ac-46d4-9094-db6e7667475e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4435749d4c89428286e66da156d17795', 'request_id': 'req-84403105-45ac-46d4-9094-db6e7667475e'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:57.192875 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-84403105-45ac-46d4-9094-db6e7667475e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4435749d4c89428286e66da156d17795', 'request_id': 'req-84403105-45ac-46d4-9094-db6e7667475e'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:57.206786 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-84403105-45ac-46d4-9094-db6e7667475e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4435749d4c89428286e66da156d17795', 'request_id': 'req-84403105-45ac-46d4-9094-db6e7667475e'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:57.245603 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-84403105-45ac-46d4-9094-db6e7667475e admin admin] The token cache is being invalidate because project 4435749d4c89428286e66da156d17795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:49:57.245917 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-84403105-45ac-46d4-9094-db6e7667475e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:57.246637 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-84403105-45ac-46d4-9094-db6e7667475e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:49:57.262175 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1187/2366] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:49:56 2022] DELETE /identity/v3/projects/4435749d4c89428286e66da156d17795 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:50:05.470115 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c827f59-6e04-4ba6-8627-6eb989ed19e1 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:05.470705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c827f59-6e04-4ba6-8627-6eb989ed19e1 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:05.470705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c827f59-6e04-4ba6-8627-6eb989ed19e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:05.493233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-8c827f59-6e04-4ba6-8627-6eb989ed19e1 None None] MFA Rules not processed for user `aa370363c76b4e86b68015b490aa9a06`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:50:05.494373 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-8c827f59-6e04-4ba6-8627-6eb989ed19e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:05.556209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1180/2367] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:50:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:50:07.003083 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84403105-45ac-46d4-9094-db6e7667475e admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:07.004817 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-84403105-45ac-46d4-9094-db6e7667475e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:07.074080 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:07.099344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84403105-45ac-46d4-9094-db6e7667475e admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:07.106294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590ccd1-72a9-4e82-a04b-af4643eac9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:07.107429 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590ccd1-72a9-4e82-a04b-af4643eac9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:07.107880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590ccd1-72a9-4e82-a04b-af4643eac9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:07.108327 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590ccd1-72a9-4e82-a04b-af4643eac9a3 admin admin] PATH_INFO: `/v3/users/3b470dfe263943dbbb9e54fab846db7b` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:07.110041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590ccd1-72a9-4e82-a04b-af4643eac9a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b470dfe263943dbbb9e54fab846db7b)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:07.112187 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590ccd1-72a9-4e82-a04b-af4643eac9a3 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:07.172574 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-6590ccd1-72a9-4e82-a04b-af4643eac9a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b470dfe263943dbbb9e54fab846db7b'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:07.181420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-6590ccd1-72a9-4e82-a04b-af4643eac9a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b470dfe263943dbbb9e54fab846db7b'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:07.197878 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-6590ccd1-72a9-4e82-a04b-af4643eac9a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b470dfe263943dbbb9e54fab846db7b'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:07.206446 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-6590ccd1-72a9-4e82-a04b-af4643eac9a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b470dfe263943dbbb9e54fab846db7b'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:07.207301 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-6590ccd1-72a9-4e82-a04b-af4643eac9a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b470dfe263943dbbb9e54fab846db7b'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:07.215328 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1188/2368] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:50:07 2022] DELETE /identity/v3/users/3b470dfe263943dbbb9e54fab846db7b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:50:07.513761 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c827f59-6e04-4ba6-8627-6eb989ed19e1 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:07.525691 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c827f59-6e04-4ba6-8627-6eb989ed19e1 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:07.535115 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:07.603385 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78994e50-1657-4dd9-af17-ad7ccee5ef48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:07.604300 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78994e50-1657-4dd9-af17-ad7ccee5ef48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:07.604579 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78994e50-1657-4dd9-af17-ad7ccee5ef48 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:07.604854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78994e50-1657-4dd9-af17-ad7ccee5ef48 admin admin] PATH_INFO: `/v3/projects/4a391878a24248a19d336148549a7e45` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:07.606057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78994e50-1657-4dd9-af17-ad7ccee5ef48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a391878a24248a19d336148549a7e45)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:07.607979 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78994e50-1657-4dd9-af17-ad7ccee5ef48 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:07.656044 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-78994e50-1657-4dd9-af17-ad7ccee5ef48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a391878a24248a19d336148549a7e45', 'request_id': 'req-78994e50-1657-4dd9-af17-ad7ccee5ef48'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:07.665166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-78994e50-1657-4dd9-af17-ad7ccee5ef48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a391878a24248a19d336148549a7e45', 'request_id': 'req-78994e50-1657-4dd9-af17-ad7ccee5ef48'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:07.671985 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-78994e50-1657-4dd9-af17-ad7ccee5ef48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a391878a24248a19d336148549a7e45', 'request_id': 'req-78994e50-1657-4dd9-af17-ad7ccee5ef48'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:07.683252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-78994e50-1657-4dd9-af17-ad7ccee5ef48 admin admin] The token cache is being invalidate because project 4a391878a24248a19d336148549a7e45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:50:07.683647 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-78994e50-1657-4dd9-af17-ad7ccee5ef48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:07.684335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-78994e50-1657-4dd9-af17-ad7ccee5ef48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:07.686352 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1181/2369] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:50:07 2022] DELETE /identity/v3/projects/4a391878a24248a19d336148549a7e45 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:50:07.690068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590ccd1-72a9-4e82-a04b-af4643eac9a3 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:07.691597 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-6590ccd1-72a9-4e82-a04b-af4643eac9a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:07.705280 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590ccd1-72a9-4e82-a04b-af4643eac9a3 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:07.767241 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304e190-f05b-43c4-9c45-c8f995c2db77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:07.768141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304e190-f05b-43c4-9c45-c8f995c2db77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:07.768489 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304e190-f05b-43c4-9c45-c8f995c2db77 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:07.768770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304e190-f05b-43c4-9c45-c8f995c2db77 admin admin] PATH_INFO: `/v3/users/85d4c2cd5725477e933faf999d779d7d` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:07.770009 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304e190-f05b-43c4-9c45-c8f995c2db77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85d4c2cd5725477e933faf999d779d7d)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:07.773616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304e190-f05b-43c4-9c45-c8f995c2db77 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:07.801577 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78994e50-1657-4dd9-af17-ad7ccee5ef48 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:07.803499 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-78994e50-1657-4dd9-af17-ad7ccee5ef48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:07.819869 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78994e50-1657-4dd9-af17-ad7ccee5ef48 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:07.826585 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e4ed9-d76f-4240-9f22-80374b4342fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:07.827775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e4ed9-d76f-4240-9f22-80374b4342fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:07.828197 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e4ed9-d76f-4240-9f22-80374b4342fd admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:07.828612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e4ed9-d76f-4240-9f22-80374b4342fd admin admin] PATH_INFO: `/v3/users/6a755e07d2e7415685443009051638c6` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:07.830406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e4ed9-d76f-4240-9f22-80374b4342fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a755e07d2e7415685443009051638c6)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:07.831953 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-0304e190-f05b-43c4-9c45-c8f995c2db77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85d4c2cd5725477e933faf999d779d7d'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:07.833512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e4ed9-d76f-4240-9f22-80374b4342fd admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:07.839992 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-0304e190-f05b-43c4-9c45-c8f995c2db77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85d4c2cd5725477e933faf999d779d7d'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:07.851340 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:07.852560 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-0304e190-f05b-43c4-9c45-c8f995c2db77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85d4c2cd5725477e933faf999d779d7d'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:07.865040 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-0304e190-f05b-43c4-9c45-c8f995c2db77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85d4c2cd5725477e933faf999d779d7d'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:07.865886 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-0304e190-f05b-43c4-9c45-c8f995c2db77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85d4c2cd5725477e933faf999d779d7d'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:07.874806 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1189/2370] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:50:07 2022] DELETE /identity/v3/users/85d4c2cd5725477e933faf999d779d7d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:50:07.889940 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b84e4ed9-d76f-4240-9f22-80374b4342fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a755e07d2e7415685443009051638c6'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:07.901036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b84e4ed9-d76f-4240-9f22-80374b4342fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a755e07d2e7415685443009051638c6'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:07.917832 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b84e4ed9-d76f-4240-9f22-80374b4342fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a755e07d2e7415685443009051638c6'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:07.918653 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b84e4ed9-d76f-4240-9f22-80374b4342fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a755e07d2e7415685443009051638c6'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:07.925748 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b84e4ed9-d76f-4240-9f22-80374b4342fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a755e07d2e7415685443009051638c6'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:07.935534 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1182/2371] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:50:07 2022] DELETE /identity/v3/users/6a755e07d2e7415685443009051638c6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:50:07.940028 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50773e7-2c97-4a4a-ae60-a79fc305baaa None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:07.940686 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50773e7-2c97-4a4a-ae60-a79fc305baaa None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:07.940686 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50773e7-2c97-4a4a-ae60-a79fc305baaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:07.959458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-e50773e7-2c97-4a4a-ae60-a79fc305baaa None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:50:07.960910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e50773e7-2c97-4a4a-ae60-a79fc305baaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:08.048468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1190/2372] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:50:08.059930 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e4ed9-d76f-4240-9f22-80374b4342fd admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:08.061508 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b84e4ed9-d76f-4240-9f22-80374b4342fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:08.079631 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:08.117868 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50773e7-2c97-4a4a-ae60-a79fc305baaa None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:08.119933 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e50773e7-2c97-4a4a-ae60-a79fc305baaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:08.135046 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50773e7-2c97-4a4a-ae60-a79fc305baaa None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:08.141492 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ffde9-5a20-4ea6-a451-90031ad6f31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:08.142394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ffde9-5a20-4ea6-a451-90031ad6f31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:08.143312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ffde9-5a20-4ea6-a451-90031ad6f31a admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:08.143808 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ffde9-5a20-4ea6-a451-90031ad6f31a admin admin] PATH_INFO: `/v3/projects/4c689c0135fe426380d340c950720716` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:08.145365 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ffde9-5a20-4ea6-a451-90031ad6f31a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c689c0135fe426380d340c950720716)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:08.146515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e4ed9-d76f-4240-9f22-80374b4342fd admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:08.147607 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ffde9-5a20-4ea6-a451-90031ad6f31a admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:08.151831 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaee8dc-8377-43a4-a95f-d79a8412a9ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:08.152864 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee8dc-8377-43a4-a95f-d79a8412a9ec service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:08.153369 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee8dc-8377-43a4-a95f-d79a8412a9ec service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:08.153984 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee8dc-8377-43a4-a95f-d79a8412a9ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:08.170022 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaee8dc-8377-43a4-a95f-d79a8412a9ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:08.172303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaee8dc-8377-43a4-a95f-d79a8412a9ec service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:08.185348 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1183/2373] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:50:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:50:08.208572 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-f31ffde9-5a20-4ea6-a451-90031ad6f31a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c689c0135fe426380d340c950720716', 'request_id': 'req-f31ffde9-5a20-4ea6-a451-90031ad6f31a'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:08.214233 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-f31ffde9-5a20-4ea6-a451-90031ad6f31a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c689c0135fe426380d340c950720716', 'request_id': 'req-f31ffde9-5a20-4ea6-a451-90031ad6f31a'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:08.222049 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-f31ffde9-5a20-4ea6-a451-90031ad6f31a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c689c0135fe426380d340c950720716', 'request_id': 'req-f31ffde9-5a20-4ea6-a451-90031ad6f31a'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:08.236885 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-f31ffde9-5a20-4ea6-a451-90031ad6f31a admin admin] The token cache is being invalidate because project 4c689c0135fe426380d340c950720716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:50:08.237179 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-f31ffde9-5a20-4ea6-a451-90031ad6f31a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:08.237889 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-f31ffde9-5a20-4ea6-a451-90031ad6f31a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:08.239841 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1191/2374] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:50:08 2022] DELETE /identity/v3/projects/4c689c0135fe426380d340c950720716 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:50:08.245040 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3a228-dbbb-4637-85d5-63b5b87d42f3 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:08.245339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3a228-dbbb-4637-85d5-63b5b87d42f3 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:08.245623 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3a228-dbbb-4637-85d5-63b5b87d42f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:08.265599 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-6ce3a228-dbbb-4637-85d5-63b5b87d42f3 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:50:08.266902 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-6ce3a228-dbbb-4637-85d5-63b5b87d42f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:08.330883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1184/2375] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:50:08.338968 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bb8f5-e11b-4e59-a5d1-051315475161 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:08.339280 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bb8f5-e11b-4e59-a5d1-051315475161 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:08.339578 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bb8f5-e11b-4e59-a5d1-051315475161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:08.360804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-cf5bb8f5-e11b-4e59-a5d1-051315475161 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:50:08.362055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-cf5bb8f5-e11b-4e59-a5d1-051315475161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:08.371302 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1192/2376] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:50:08.375785 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3a228-dbbb-4637-85d5-63b5b87d42f3 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:08.386166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3a228-dbbb-4637-85d5-63b5b87d42f3 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:08.391039 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a610966-a738-4c5e-88fb-8e86fab5231e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:08.391774 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a610966-a738-4c5e-88fb-8e86fab5231e admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:08.392050 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a610966-a738-4c5e-88fb-8e86fab5231e admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:08.392505 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a610966-a738-4c5e-88fb-8e86fab5231e admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:08.393253 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a610966-a738-4c5e-88fb-8e86fab5231e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:50:08.393563 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a610966-a738-4c5e-88fb-8e86fab5231e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:08.395180 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a610966-a738-4c5e-88fb-8e86fab5231e admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:08.408262 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1185/2377] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:50:08.414379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bb8f5-e11b-4e59-a5d1-051315475161 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:08.424035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bb8f5-e11b-4e59-a5d1-051315475161 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:08.429334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba7458-c53b-4f1d-af96-065c08bb3764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:08.429994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba7458-c53b-4f1d-af96-065c08bb3764 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:08.430282 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba7458-c53b-4f1d-af96-065c08bb3764 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:08.430559 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba7458-c53b-4f1d-af96-065c08bb3764 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:08.431253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba7458-c53b-4f1d-af96-065c08bb3764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:08.433171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba7458-c53b-4f1d-af96-065c08bb3764 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:08.462029 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1193/2378] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:50:08 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:50:08.466506 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a610966-a738-4c5e-88fb-8e86fab5231e admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:08.478779 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a610966-a738-4c5e-88fb-8e86fab5231e admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:08.484127 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba7458-c53b-4f1d-af96-065c08bb3764 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:08.485469 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b9ba7458-c53b-4f1d-af96-065c08bb3764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:08.595995 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e2b8a-054a-4417-b0f6-be2672eed4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:08.598054 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e2b8a-054a-4417-b0f6-be2672eed4a2 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:08.598574 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e2b8a-054a-4417-b0f6-be2672eed4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:08.598961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e2b8a-054a-4417-b0f6-be2672eed4a2 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:08.600069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e2b8a-054a-4417-b0f6-be2672eed4a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:08.613512 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:08.616983 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e2b8a-054a-4417-b0f6-be2672eed4a2 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:08.651214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba7458-c53b-4f1d-af96-065c08bb3764 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:08.655412 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1186/2379] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:50:08 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:50:08.658563 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e2b8a-054a-4417-b0f6-be2672eed4a2 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:08.661994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a50eb-aa3a-4045-b1c1-21760048d773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:08.663888 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a50eb-aa3a-4045-b1c1-21760048d773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:08.664182 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a50eb-aa3a-4045-b1c1-21760048d773 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:08.664609 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a50eb-aa3a-4045-b1c1-21760048d773 admin admin] PATH_INFO: `/v3/projects/8d59eb54e5244996b5a4e5413ad0d36c` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:08.666402 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a50eb-aa3a-4045-b1c1-21760048d773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d59eb54e5244996b5a4e5413ad0d36c)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:08.669312 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a50eb-aa3a-4045-b1c1-21760048d773 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:08.682294 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e2b8a-054a-4417-b0f6-be2672eed4a2 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:08.693589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ae5af-17d2-4142-b325-28a3ed098f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:08.694592 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ae5af-17d2-4142-b325-28a3ed098f2d admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:08.695497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ae5af-17d2-4142-b325-28a3ed098f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:08.695949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ae5af-17d2-4142-b325-28a3ed098f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:08.697983 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ae5af-17d2-4142-b325-28a3ed098f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:08.700402 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ae5af-17d2-4142-b325-28a3ed098f2d admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:08.721481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1187/2380] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:50:08.722423 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ae5af-17d2-4142-b325-28a3ed098f2d admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:08.741228 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-702a50eb-aa3a-4045-b1c1-21760048d773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d59eb54e5244996b5a4e5413ad0d36c', 'request_id': 'req-702a50eb-aa3a-4045-b1c1-21760048d773'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:08.753273 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ae5af-17d2-4142-b325-28a3ed098f2d admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:08.769238 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-702a50eb-aa3a-4045-b1c1-21760048d773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d59eb54e5244996b5a4e5413ad0d36c', 'request_id': 'req-702a50eb-aa3a-4045-b1c1-21760048d773'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:08.780746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:08.784141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-702a50eb-aa3a-4045-b1c1-21760048d773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d59eb54e5244996b5a4e5413ad0d36c', 'request_id': 'req-702a50eb-aa3a-4045-b1c1-21760048d773'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:08.811641 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-702a50eb-aa3a-4045-b1c1-21760048d773 admin admin] The token cache is being invalidate because project 8d59eb54e5244996b5a4e5413ad0d36c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:50:08.812820 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-702a50eb-aa3a-4045-b1c1-21760048d773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:08.813959 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-702a50eb-aa3a-4045-b1c1-21760048d773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:08.816188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1194/2381] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:50:08 2022] DELETE /identity/v3/projects/8d59eb54e5244996b5a4e5413ad0d36c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:50:08.824231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc0dec-91cb-49b8-94fa-e6561ad89f51 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:08.824598 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc0dec-91cb-49b8-94fa-e6561ad89f51 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:08.825323 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc0dec-91cb-49b8-94fa-e6561ad89f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:08.849743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29131f37-ebf1-4845-bceb-60446af0992b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:08.851392 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29131f37-ebf1-4845-bceb-60446af0992b admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:08.851744 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29131f37-ebf1-4845-bceb-60446af0992b admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:08.852132 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29131f37-ebf1-4845-bceb-60446af0992b admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:08.853458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29131f37-ebf1-4845-bceb-60446af0992b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:08.855472 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-9bdc0dec-91cb-49b8-94fa-e6561ad89f51 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:50:08.856794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-9bdc0dec-91cb-49b8-94fa-e6561ad89f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:08.856959 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29131f37-ebf1-4845-bceb-60446af0992b admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:08.866178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1195/2382] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:50:08.874948 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b3e97-69a7-49ff-b562-2abbacc8be1a None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:08.875301 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b3e97-69a7-49ff-b562-2abbacc8be1a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:08.875656 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b3e97-69a7-49ff-b562-2abbacc8be1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:08.877424 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1188/2383] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:50:08.882386 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29131f37-ebf1-4845-bceb-60446af0992b admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:08.884765 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-29131f37-ebf1-4845-bceb-60446af0992b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:08.899003 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29131f37-ebf1-4845-bceb-60446af0992b admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:08.905595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1905d1a-75b3-48d0-9035-b441a21a800b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:08.906501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1905d1a-75b3-48d0-9035-b441a21a800b admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:08.906785 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1905d1a-75b3-48d0-9035-b441a21a800b admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:08.907062 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1905d1a-75b3-48d0-9035-b441a21a800b admin admin] PATH_INFO: `/v3/projects/0d19993825ac4fc2bff2f2a541f20ae2/users/8f610de3d05649c4b20b62556ec7f8b2/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:08.908760 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-e35b3e97-69a7-49ff-b562-2abbacc8be1a None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:50:08.911439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e35b3e97-69a7-49ff-b562-2abbacc8be1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:08.920768 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1196/2384] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:50:08.924874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b3e97-69a7-49ff-b562-2abbacc8be1a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:08.934584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b3e97-69a7-49ff-b562-2abbacc8be1a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:08.937059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1905d1a-75b3-48d0-9035-b441a21a800b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d19993825ac4fc2bff2f2a541f20ae2, user_id=8f610de3d05649c4b20b62556ec7f8b2, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:08.939313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc32631-c484-4c22-9898-604c8e233341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:08.939868 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1905d1a-75b3-48d0-9035-b441a21a800b admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:08.940003 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc32631-c484-4c22-9898-604c8e233341 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:08.940332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc32631-c484-4c22-9898-604c8e233341 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:08.940509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc32631-c484-4c22-9898-604c8e233341 admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:08.941237 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc32631-c484-4c22-9898-604c8e233341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:50:08.941539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc32631-c484-4c22-9898-604c8e233341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:08.943438 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc32631-c484-4c22-9898-604c8e233341 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:08.956532 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1189/2385] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:50:08 2022] PUT /identity/v3/projects/0d19993825ac4fc2bff2f2a541f20ae2/users/8f610de3d05649c4b20b62556ec7f8b2/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:50:08.966488 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1197/2386] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:50:08.966624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1905d1a-75b3-48d0-9035-b441a21a800b admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:08.967788 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd399d-2a89-48f6-a177-9620b8ff819f None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:08.968125 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd399d-2a89-48f6-a177-9620b8ff819f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:08.968399 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd399d-2a89-48f6-a177-9620b8ff819f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:08.998121 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-dfcd399d-2a89-48f6-a177-9620b8ff819f None None] MFA Rules not processed for user `8f610de3d05649c4b20b62556ec7f8b2`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:50:08.999627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-dfcd399d-2a89-48f6-a177-9620b8ff819f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:09.033031 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1905d1a-75b3-48d0-9035-b441a21a800b admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:09.038649 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce6a11-0668-421c-8e56-db21a2ddb7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:09.039850 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce6a11-0668-421c-8e56-db21a2ddb7ba admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:09.040594 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce6a11-0668-421c-8e56-db21a2ddb7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:09.040594 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce6a11-0668-421c-8e56-db21a2ddb7ba admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:09.041270 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce6a11-0668-421c-8e56-db21a2ddb7ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:09.043196 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce6a11-0668-421c-8e56-db21a2ddb7ba admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:09.073908 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1190/2387] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:50:08 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:50:09.078302 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce6a11-0668-421c-8e56-db21a2ddb7ba admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:09.091014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1198/2388] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:50:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:50:09.099230 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd399d-2a89-48f6-a177-9620b8ff819f None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:09.101727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-dfcd399d-2a89-48f6-a177-9620b8ff819f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:09.158836 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce6a11-0668-421c-8e56-db21a2ddb7ba admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:09.165939 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:09.166197 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805acfb5-ff7b-453f-9916-fe23023c1790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:09.166863 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805acfb5-ff7b-453f-9916-fe23023c1790 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:09.167284 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805acfb5-ff7b-453f-9916-fe23023c1790 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:09.167793 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805acfb5-ff7b-453f-9916-fe23023c1790 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:09.168433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805acfb5-ff7b-453f-9916-fe23023c1790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:09.171739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805acfb5-ff7b-453f-9916-fe23023c1790 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:09.197403 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd399d-2a89-48f6-a177-9620b8ff819f None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:09.214185 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1191/2389] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:50:09 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:50:09.218598 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805acfb5-ff7b-453f-9916-fe23023c1790 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:09.235880 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805acfb5-ff7b-453f-9916-fe23023c1790 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:09.243455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d2083-a397-49c5-8c74-2cc374e877a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:09.244274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d2083-a397-49c5-8c74-2cc374e877a9 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:09.244626 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d2083-a397-49c5-8c74-2cc374e877a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:09.245593 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d2083-a397-49c5-8c74-2cc374e877a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:09.246782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d2083-a397-49c5-8c74-2cc374e877a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:09.248913 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d2083-a397-49c5-8c74-2cc374e877a9 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:09.253435 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:09.268225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c720c-de1b-4dd6-ae76-63051a96b432 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:09.271711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c720c-de1b-4dd6-ae76-63051a96b432 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:09.271711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c720c-de1b-4dd6-ae76-63051a96b432 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:09.271711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c720c-de1b-4dd6-ae76-63051a96b432 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:09.273093 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1192/2390] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:50:09.274157 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d2083-a397-49c5-8c74-2cc374e877a9 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:09.296994 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d2083-a397-49c5-8c74-2cc374e877a9 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:09.315135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbabbaa-a69d-4ee2-825b-342ffcc7e2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:09.315773 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbabbaa-a69d-4ee2-825b-342ffcc7e2be admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:09.316062 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbabbaa-a69d-4ee2-825b-342ffcc7e2be admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:09.316343 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbabbaa-a69d-4ee2-825b-342ffcc7e2be admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:09.317160 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbabbaa-a69d-4ee2-825b-342ffcc7e2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:09.318937 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbabbaa-a69d-4ee2-825b-342ffcc7e2be admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:09.333108 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1193/2391] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:50:09.339766 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbabbaa-a69d-4ee2-825b-342ffcc7e2be admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:09.355494 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbabbaa-a69d-4ee2-825b-342ffcc7e2be admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:09.362067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781297a1-72a3-441a-9d8d-d01a9374e3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:09.363078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781297a1-72a3-441a-9d8d-d01a9374e3c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:09.363475 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781297a1-72a3-441a-9d8d-d01a9374e3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:09.363834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781297a1-72a3-441a-9d8d-d01a9374e3c3 admin admin] PATH_INFO: `/v3/projects/cb3bffc501684bb586a051f3bd48f49f/users/cbaa2dbe97bf4abe925a1e9c587353d5/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:09.380298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c720c-de1b-4dd6-ae76-63051a96b432 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:09.382511 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c720c-de1b-4dd6-ae76-63051a96b432 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:09.386996 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781297a1-72a3-441a-9d8d-d01a9374e3c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb3bffc501684bb586a051f3bd48f49f, user_id=cbaa2dbe97bf4abe925a1e9c587353d5, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:09.403024 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781297a1-72a3-441a-9d8d-d01a9374e3c3 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:09.420148 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1199/2392] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:50:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:50:09.430005 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1194/2393] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:50:09 2022] PUT /identity/v3/projects/cb3bffc501684bb586a051f3bd48f49f/users/cbaa2dbe97bf4abe925a1e9c587353d5/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:50:09.434922 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fa21d-2f52-4c4a-b05f-592ab1273850 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:09.435694 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fa21d-2f52-4c4a-b05f-592ab1273850 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:09.435694 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fa21d-2f52-4c4a-b05f-592ab1273850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:09.505098 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-1d7fa21d-2f52-4c4a-b05f-592ab1273850 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:50:09.507575 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-1d7fa21d-2f52-4c4a-b05f-592ab1273850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:09.675440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1200/2394] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:50:09.691033 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781297a1-72a3-441a-9d8d-d01a9374e3c3 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:09.693958 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-781297a1-72a3-441a-9d8d-d01a9374e3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:09.800813 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781297a1-72a3-441a-9d8d-d01a9374e3c3 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:09.805132 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356eecf-6614-440b-9018-576fc3fb43bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:09.805892 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356eecf-6614-440b-9018-576fc3fb43bb service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:09.806239 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356eecf-6614-440b-9018-576fc3fb43bb service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:09.806588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356eecf-6614-440b-9018-576fc3fb43bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:09.830478 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356eecf-6614-440b-9018-576fc3fb43bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:09.831014 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356eecf-6614-440b-9018-576fc3fb43bb service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:09.864485 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1195/2395] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:50:15.434401 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fa21d-2f52-4c4a-b05f-592ab1273850 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:15.446390 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fa21d-2f52-4c4a-b05f-592ab1273850 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:15.451254 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2e6f0-deee-4169-a6ec-9034db31491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:15.452204 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2e6f0-deee-4169-a6ec-9034db31491f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:15.452482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2e6f0-deee-4169-a6ec-9034db31491f admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:15.452758 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2e6f0-deee-4169-a6ec-9034db31491f admin admin] PATH_INFO: `/v3/users/8f610de3d05649c4b20b62556ec7f8b2` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:15.454211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2e6f0-deee-4169-a6ec-9034db31491f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f610de3d05649c4b20b62556ec7f8b2)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:15.456353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2e6f0-deee-4169-a6ec-9034db31491f admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:15.523939 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:15.529692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-3eb2e6f0-deee-4169-a6ec-9034db31491f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f610de3d05649c4b20b62556ec7f8b2'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:15.544040 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-3eb2e6f0-deee-4169-a6ec-9034db31491f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f610de3d05649c4b20b62556ec7f8b2'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:15.563891 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-3eb2e6f0-deee-4169-a6ec-9034db31491f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f610de3d05649c4b20b62556ec7f8b2'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:15.576981 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-3eb2e6f0-deee-4169-a6ec-9034db31491f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f610de3d05649c4b20b62556ec7f8b2'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:15.578366 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-3eb2e6f0-deee-4169-a6ec-9034db31491f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f610de3d05649c4b20b62556ec7f8b2'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:15.591118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1201/2396] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:50:15 2022] DELETE /identity/v3/users/8f610de3d05649c4b20b62556ec7f8b2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:50:15.592963 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6101c37-d9a2-4994-8307-cee5f27f08a0 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:15.593509 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6101c37-d9a2-4994-8307-cee5f27f08a0 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:15.594566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6101c37-d9a2-4994-8307-cee5f27f08a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:15.617670 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-c6101c37-d9a2-4994-8307-cee5f27f08a0 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:50:15.618913 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-c6101c37-d9a2-4994-8307-cee5f27f08a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:15.710151 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1196/2397] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:50:15.719350 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2e6f0-deee-4169-a6ec-9034db31491f admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:15.721096 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3eb2e6f0-deee-4169-a6ec-9034db31491f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:15.848842 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2e6f0-deee-4169-a6ec-9034db31491f admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:15.860720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8631181-aedf-490d-b8b9-669f61c346b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:15.862174 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8631181-aedf-490d-b8b9-669f61c346b2 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:15.862855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8631181-aedf-490d-b8b9-669f61c346b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:15.863321 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8631181-aedf-490d-b8b9-669f61c346b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:15.880501 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8631181-aedf-490d-b8b9-669f61c346b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:15.886660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8631181-aedf-490d-b8b9-669f61c346b2 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:15.911331 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1202/2398] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:50:16.374559 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6101c37-d9a2-4994-8307-cee5f27f08a0 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:16.380289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-c6101c37-d9a2-4994-8307-cee5f27f08a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:16.395591 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6101c37-d9a2-4994-8307-cee5f27f08a0 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:16.402332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a41e55-f423-4bec-975d-41bf26c33b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:16.403347 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a41e55-f423-4bec-975d-41bf26c33b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:16.403696 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a41e55-f423-4bec-975d-41bf26c33b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:16.403977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a41e55-f423-4bec-975d-41bf26c33b8a admin admin] PATH_INFO: `/v3/projects/0d19993825ac4fc2bff2f2a541f20ae2` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:16.406026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a41e55-f423-4bec-975d-41bf26c33b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d19993825ac4fc2bff2f2a541f20ae2)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:16.408153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a41e55-f423-4bec-975d-41bf26c33b8a admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:16.492689 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d7a41e55-f423-4bec-975d-41bf26c33b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d19993825ac4fc2bff2f2a541f20ae2', 'request_id': 'req-d7a41e55-f423-4bec-975d-41bf26c33b8a'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:16.501588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d7a41e55-f423-4bec-975d-41bf26c33b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d19993825ac4fc2bff2f2a541f20ae2', 'request_id': 'req-d7a41e55-f423-4bec-975d-41bf26c33b8a'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:16.509041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:16.510696 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d7a41e55-f423-4bec-975d-41bf26c33b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d19993825ac4fc2bff2f2a541f20ae2', 'request_id': 'req-d7a41e55-f423-4bec-975d-41bf26c33b8a'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:16.542270 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d7a41e55-f423-4bec-975d-41bf26c33b8a admin admin] The token cache is being invalidate because project 0d19993825ac4fc2bff2f2a541f20ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:50:16.542270 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d7a41e55-f423-4bec-975d-41bf26c33b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:16.542270 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-d7a41e55-f423-4bec-975d-41bf26c33b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:16.542270 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1197/2399] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:50:16 2022] DELETE /identity/v3/projects/0d19993825ac4fc2bff2f2a541f20ae2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:50:16.543525 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f649bd-84c0-412a-8058-a9870b270de3 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:16.543525 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f649bd-84c0-412a-8058-a9870b270de3 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:16.544064 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f649bd-84c0-412a-8058-a9870b270de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:16.569590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-22f649bd-84c0-412a-8058-a9870b270de3 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:50:16.572754 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-22f649bd-84c0-412a-8058-a9870b270de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:16.684922 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1203/2400] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:50:16.693190 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250daf30-26cf-4b25-9259-123cdb096bbc None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:16.693754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250daf30-26cf-4b25-9259-123cdb096bbc None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:16.694452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250daf30-26cf-4b25-9259-123cdb096bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:16.717404 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-250daf30-26cf-4b25-9259-123cdb096bbc None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:50:16.719068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-250daf30-26cf-4b25-9259-123cdb096bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:16.733597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1198/2401] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:50:16.735686 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f649bd-84c0-412a-8058-a9870b270de3 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:16.747476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f649bd-84c0-412a-8058-a9870b270de3 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:16.752880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1513b-e59b-4c3b-a02e-34c9076c9133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:16.753660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1513b-e59b-4c3b-a02e-34c9076c9133 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:16.754319 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1513b-e59b-4c3b-a02e-34c9076c9133 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:16.754319 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1513b-e59b-4c3b-a02e-34c9076c9133 admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:16.755013 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1513b-e59b-4c3b-a02e-34c9076c9133 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:50:16.755358 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1513b-e59b-4c3b-a02e-34c9076c9133 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:16.757717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1513b-e59b-4c3b-a02e-34c9076c9133 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:16.776364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250daf30-26cf-4b25-9259-123cdb096bbc None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:16.784945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1204/2402] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:50:16.787227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250daf30-26cf-4b25-9259-123cdb096bbc None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:16.796719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce426d-2489-47a4-bccd-455cf33e82de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:16.798006 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce426d-2489-47a4-bccd-455cf33e82de admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:16.798664 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce426d-2489-47a4-bccd-455cf33e82de admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:16.798956 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce426d-2489-47a4-bccd-455cf33e82de admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:16.800873 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce426d-2489-47a4-bccd-455cf33e82de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:16.804613 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce426d-2489-47a4-bccd-455cf33e82de admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:16.845124 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1199/2403] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:50:16 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:50:16.849254 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1513b-e59b-4c3b-a02e-34c9076c9133 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:16.860387 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1513b-e59b-4c3b-a02e-34c9076c9133 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:16.950942 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:16.965864 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3450f-edd4-41a1-b138-4de9ede25b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:16.966478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3450f-edd4-41a1-b138-4de9ede25b32 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:16.967301 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3450f-edd4-41a1-b138-4de9ede25b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:16.967301 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b3450f-edd4-41a1-b138-4de9ede25b32 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:16.968110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3450f-edd4-41a1-b138-4de9ede25b32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:16.970282 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b3450f-edd4-41a1-b138-4de9ede25b32 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:16.998584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1205/2404] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:50:16 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:50:16.999956 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce426d-2489-47a4-bccd-455cf33e82de admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:17.015142 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce426d-2489-47a4-bccd-455cf33e82de admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:17.020298 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c7717-de40-4e84-b717-7327620c0fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:17.021155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c7717-de40-4e84-b717-7327620c0fcc admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:17.021325 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c7717-de40-4e84-b717-7327620c0fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:17.021531 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c7717-de40-4e84-b717-7327620c0fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:17.022337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c7717-de40-4e84-b717-7327620c0fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:17.024082 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c7717-de40-4e84-b717-7327620c0fcc admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:17.039428 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1200/2405] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:50:17.044104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3450f-edd4-41a1-b138-4de9ede25b32 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:17.056048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b3450f-edd4-41a1-b138-4de9ede25b32 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:17.072013 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c1457-a8cc-4378-acda-2ee667fea2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:17.073051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c1457-a8cc-4378-acda-2ee667fea2ba admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:17.073408 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c1457-a8cc-4378-acda-2ee667fea2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:17.073873 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c1457-a8cc-4378-acda-2ee667fea2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:17.075322 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c1457-a8cc-4378-acda-2ee667fea2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:17.077052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c1457-a8cc-4378-acda-2ee667fea2ba admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:17.099456 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1206/2406] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:50:17.103676 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c7717-de40-4e84-b717-7327620c0fcc admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:17.115698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c7717-de40-4e84-b717-7327620c0fcc admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:17.128304 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e5ce8-c26f-4173-9d4f-ddf8baa5deaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:17.129245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e5ce8-c26f-4173-9d4f-ddf8baa5deaa admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:17.129530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e5ce8-c26f-4173-9d4f-ddf8baa5deaa admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:17.129812 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e5ce8-c26f-4173-9d4f-ddf8baa5deaa admin admin] PATH_INFO: `/v3/projects/1857cfed5e0c4e4f8f59ffa39044dbe3/users/59e4356cd83a45f9b3b2ab85812d2135/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:17.154273 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e5ce8-c26f-4173-9d4f-ddf8baa5deaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1857cfed5e0c4e4f8f59ffa39044dbe3, user_id=59e4356cd83a45f9b3b2ab85812d2135, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:17.156489 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e5ce8-c26f-4173-9d4f-ddf8baa5deaa admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:17.173900 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1201/2407] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:50:17 2022] PUT /identity/v3/projects/1857cfed5e0c4e4f8f59ffa39044dbe3/users/59e4356cd83a45f9b3b2ab85812d2135/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:50:17.185151 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a0dbc-c1b1-4993-98b5-860b5e4610b0 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:17.185496 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a0dbc-c1b1-4993-98b5-860b5e4610b0 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:17.185781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a0dbc-c1b1-4993-98b5-860b5e4610b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:17.216267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-610a0dbc-c1b1-4993-98b5-860b5e4610b0 None None] MFA Rules not processed for user `59e4356cd83a45f9b3b2ab85812d2135`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:50:17.220800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-610a0dbc-c1b1-4993-98b5-860b5e4610b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:17.306021 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1207/2408] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:50:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:50:17.317917 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e5ce8-c26f-4173-9d4f-ddf8baa5deaa admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:17.319931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-616e5ce8-c26f-4173-9d4f-ddf8baa5deaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:17.327880 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd203d5-e190-4e24-a642-c9774e5bba09 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:17.328171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd203d5-e190-4e24-a642-c9774e5bba09 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:17.328456 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd203d5-e190-4e24-a642-c9774e5bba09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:17.365295 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-0fd203d5-e190-4e24-a642-c9774e5bba09 None None] MFA Rules not processed for user `cbaa2dbe97bf4abe925a1e9c587353d5`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:50:17.367728 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-0fd203d5-e190-4e24-a642-c9774e5bba09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:17.397875 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e5ce8-c26f-4173-9d4f-ddf8baa5deaa admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:17.403169 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe120fa-f943-4727-acbf-403aea646299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:17.403992 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe120fa-f943-4727-acbf-403aea646299 service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:17.404683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe120fa-f943-4727-acbf-403aea646299 service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:17.404989 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe120fa-f943-4727-acbf-403aea646299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:17.420486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe120fa-f943-4727-acbf-403aea646299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:17.422023 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe120fa-f943-4727-acbf-403aea646299 service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:17.438239 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1202/2409] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:50:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:50:17.469229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1208/2410] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:50:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:50:17.474820 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe120fa-f943-4727-acbf-403aea646299 service cinder] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:17.477774 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9fe120fa-f943-4727-acbf-403aea646299 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:17.587521 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe120fa-f943-4727-acbf-403aea646299 service cinder] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:17.592440 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bff69-f517-4240-aa7d-ffe0e68c77a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:17.593133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bff69-f517-4240-aa7d-ffe0e68c77a0 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:17.593544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bff69-f517-4240-aa7d-ffe0e68c77a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:17.593829 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bff69-f517-4240-aa7d-ffe0e68c77a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:17.595391 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bff69-f517-4240-aa7d-ffe0e68c77a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:17.597423 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bff69-f517-4240-aa7d-ffe0e68c77a0 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:17.642859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1203/2411] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:50:17 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:50:17.644016 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd203d5-e190-4e24-a642-c9774e5bba09 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:17.657679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd203d5-e190-4e24-a642-c9774e5bba09 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:17.746571 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:17.765777 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf46d8-7710-4c16-bc13-66e66280953a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:17.767464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf46d8-7710-4c16-bc13-66e66280953a admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:17.769309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf46d8-7710-4c16-bc13-66e66280953a admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:17.769817 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf46d8-7710-4c16-bc13-66e66280953a admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:17.771382 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf46d8-7710-4c16-bc13-66e66280953a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:17.773284 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf46d8-7710-4c16-bc13-66e66280953a admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:17.809620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1209/2412] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:50:17 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:50:17.813290 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bff69-f517-4240-aa7d-ffe0e68c77a0 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:17.825304 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bff69-f517-4240-aa7d-ffe0e68c77a0 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:17.831554 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796dc58-92ee-4e5b-89a3-46cd819fd25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:17.832395 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796dc58-92ee-4e5b-89a3-46cd819fd25c admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:17.832685 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796dc58-92ee-4e5b-89a3-46cd819fd25c admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:17.832966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796dc58-92ee-4e5b-89a3-46cd819fd25c admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:17.833722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796dc58-92ee-4e5b-89a3-46cd819fd25c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:17.835593 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796dc58-92ee-4e5b-89a3-46cd819fd25c admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:17.849558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1204/2413] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:50:17.853932 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf46d8-7710-4c16-bc13-66e66280953a admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:17.869547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf46d8-7710-4c16-bc13-66e66280953a admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:17.880577 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749563a-f1d9-4baa-9fbe-cf2749268093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:17.880577 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749563a-f1d9-4baa-9fbe-cf2749268093 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:17.880577 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749563a-f1d9-4baa-9fbe-cf2749268093 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:17.880577 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749563a-f1d9-4baa-9fbe-cf2749268093 admin admin] PATH_INFO: `/v3/projects/bd36b77205374489b8514d31d5706292/users/3f803a69c5e746f4ae14906084a0056d/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:17.902468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749563a-f1d9-4baa-9fbe-cf2749268093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd36b77205374489b8514d31d5706292, user_id=3f803a69c5e746f4ae14906084a0056d, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:17.906610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749563a-f1d9-4baa-9fbe-cf2749268093 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:17.934081 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796dc58-92ee-4e5b-89a3-46cd819fd25c admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:17.934893 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1210/2414] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:50:17 2022] PUT /identity/v3/projects/bd36b77205374489b8514d31d5706292/users/3f803a69c5e746f4ae14906084a0056d/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:50:17.940192 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:17.951713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796dc58-92ee-4e5b-89a3-46cd819fd25c admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:18.022674 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9eabe-e53e-48c3-91d6-6eb80bd5f2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:18.023488 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9eabe-e53e-48c3-91d6-6eb80bd5f2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:18.023863 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9eabe-e53e-48c3-91d6-6eb80bd5f2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:18.024220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9eabe-e53e-48c3-91d6-6eb80bd5f2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:18.025039 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9eabe-e53e-48c3-91d6-6eb80bd5f2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:18.027014 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9eabe-e53e-48c3-91d6-6eb80bd5f2f9 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:18.038661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1205/2415] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:50:18.042827 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749563a-f1d9-4baa-9fbe-cf2749268093 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:18.062263 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749563a-f1d9-4baa-9fbe-cf2749268093 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:18.067815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af14d9-79c6-4124-9d81-279850aa58c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:18.068731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af14d9-79c6-4124-9d81-279850aa58c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:18.069151 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af14d9-79c6-4124-9d81-279850aa58c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:18.069444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af14d9-79c6-4124-9d81-279850aa58c1 admin admin] PATH_INFO: `/v3/projects/bd36b77205374489b8514d31d5706292/users/3f803a69c5e746f4ae14906084a0056d/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:18.074146 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af14d9-79c6-4124-9d81-279850aa58c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd36b77205374489b8514d31d5706292, user_id=3f803a69c5e746f4ae14906084a0056d, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:18.077691 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af14d9-79c6-4124-9d81-279850aa58c1 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:18.090702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1211/2416] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:50:18 2022] PUT /identity/v3/projects/bd36b77205374489b8514d31d5706292/users/3f803a69c5e746f4ae14906084a0056d/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:50:23.772955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a66f10-f036-4d8b-b705-a2f127a39787 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:23.773415 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a66f10-f036-4d8b-b705-a2f127a39787 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:23.773522 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a66f10-f036-4d8b-b705-a2f127a39787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:23.807455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-f4a66f10-f036-4d8b-b705-a2f127a39787 None None] MFA Rules not processed for user `3f803a69c5e746f4ae14906084a0056d`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:50:23.808823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-f4a66f10-f036-4d8b-b705-a2f127a39787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:23.900420 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1206/2417] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:50:23 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:50:23.924633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af14d9-79c6-4124-9d81-279850aa58c1 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:23.926638 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d5af14d9-79c6-4124-9d81-279850aa58c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:24.030020 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af14d9-79c6-4124-9d81-279850aa58c1 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:24.036326 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e05195-5311-4cc9-b1a9-c76ca19a2b73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:24.036980 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e05195-5311-4cc9-b1a9-c76ca19a2b73 service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:24.037374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e05195-5311-4cc9-b1a9-c76ca19a2b73 service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:24.037565 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e05195-5311-4cc9-b1a9-c76ca19a2b73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:24.111194 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e05195-5311-4cc9-b1a9-c76ca19a2b73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:24.113089 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e05195-5311-4cc9-b1a9-c76ca19a2b73 service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:24.124307 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1212/2418] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:50:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:50:25.488378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758808b-0d9d-4215-935f-f2f4aea55249 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:25.488853 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758808b-0d9d-4215-935f-f2f4aea55249 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:25.488950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758808b-0d9d-4215-935f-f2f4aea55249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:25.518960 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-2758808b-0d9d-4215-935f-f2f4aea55249 None None] MFA Rules not processed for user `cbaa2dbe97bf4abe925a1e9c587353d5`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:50:25.520566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-2758808b-0d9d-4215-935f-f2f4aea55249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:25.531240 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1207/2419] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:50:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:50:29.143146 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e05195-5311-4cc9-b1a9-c76ca19a2b73 service nova] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:29.213206 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:29.244342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e05195-5311-4cc9-b1a9-c76ca19a2b73 service nova] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:29.249406 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a340f-475f-46d6-9f86-4d3c87e10a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:29.250488 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a340f-475f-46d6-9f86-4d3c87e10a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:29.250938 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a340f-475f-46d6-9f86-4d3c87e10a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:29.251455 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a340f-475f-46d6-9f86-4d3c87e10a27 admin admin] PATH_INFO: `/v3/users/59e4356cd83a45f9b3b2ab85812d2135` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:29.252912 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a340f-475f-46d6-9f86-4d3c87e10a27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59e4356cd83a45f9b3b2ab85812d2135)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:29.255072 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a340f-475f-46d6-9f86-4d3c87e10a27 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:29.313209 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-db0a340f-475f-46d6-9f86-4d3c87e10a27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59e4356cd83a45f9b3b2ab85812d2135'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:29.322158 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-db0a340f-475f-46d6-9f86-4d3c87e10a27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59e4356cd83a45f9b3b2ab85812d2135'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:29.336380 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-db0a340f-475f-46d6-9f86-4d3c87e10a27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59e4356cd83a45f9b3b2ab85812d2135'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:29.346140 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-db0a340f-475f-46d6-9f86-4d3c87e10a27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59e4356cd83a45f9b3b2ab85812d2135'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:29.346678 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-db0a340f-475f-46d6-9f86-4d3c87e10a27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59e4356cd83a45f9b3b2ab85812d2135'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:29.354044 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1213/2420] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:50:29 2022] DELETE /identity/v3/users/59e4356cd83a45f9b3b2ab85812d2135 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:50:29.359486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abe8eb-66af-421e-a711-38433f67ee6c None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:29.359988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abe8eb-66af-421e-a711-38433f67ee6c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:29.360070 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abe8eb-66af-421e-a711-38433f67ee6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:29.380564 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-99abe8eb-66af-421e-a711-38433f67ee6c None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:50:29.382352 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-99abe8eb-66af-421e-a711-38433f67ee6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:29.460188 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1208/2421] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:50:29.471342 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a340f-475f-46d6-9f86-4d3c87e10a27 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:29.473759 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-db0a340f-475f-46d6-9f86-4d3c87e10a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:29.566493 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a340f-475f-46d6-9f86-4d3c87e10a27 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:29.576935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fab268-4f04-41a7-9f45-2a4fdc2bbbd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:29.577691 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fab268-4f04-41a7-9f45-2a4fdc2bbbd7 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:29.577993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fab268-4f04-41a7-9f45-2a4fdc2bbbd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:29.578721 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fab268-4f04-41a7-9f45-2a4fdc2bbbd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:29.592153 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fab268-4f04-41a7-9f45-2a4fdc2bbbd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:29.593924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fab268-4f04-41a7-9f45-2a4fdc2bbbd7 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:29.609592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1214/2422] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:50:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:50:29.969189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abe8eb-66af-421e-a711-38433f67ee6c None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:29.970829 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-99abe8eb-66af-421e-a711-38433f67ee6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:29.986152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99abe8eb-66af-421e-a711-38433f67ee6c None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:29.991692 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42636d-244b-4499-9689-38baacf0e2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:29.992588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42636d-244b-4499-9689-38baacf0e2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:29.992866 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42636d-244b-4499-9689-38baacf0e2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:29.993352 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42636d-244b-4499-9689-38baacf0e2a2 admin admin] PATH_INFO: `/v3/projects/1857cfed5e0c4e4f8f59ffa39044dbe3` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:29.994586 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42636d-244b-4499-9689-38baacf0e2a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1857cfed5e0c4e4f8f59ffa39044dbe3)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:29.996533 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42636d-244b-4499-9689-38baacf0e2a2 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:30.010219 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:30.051557 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ea42636d-244b-4499-9689-38baacf0e2a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1857cfed5e0c4e4f8f59ffa39044dbe3', 'request_id': 'req-ea42636d-244b-4499-9689-38baacf0e2a2'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:30.061617 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ea42636d-244b-4499-9689-38baacf0e2a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1857cfed5e0c4e4f8f59ffa39044dbe3', 'request_id': 'req-ea42636d-244b-4499-9689-38baacf0e2a2'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:30.068254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ea42636d-244b-4499-9689-38baacf0e2a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1857cfed5e0c4e4f8f59ffa39044dbe3', 'request_id': 'req-ea42636d-244b-4499-9689-38baacf0e2a2'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:30.081217 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ea42636d-244b-4499-9689-38baacf0e2a2 admin admin] The token cache is being invalidate because project 1857cfed5e0c4e4f8f59ffa39044dbe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:50:30.081518 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ea42636d-244b-4499-9689-38baacf0e2a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:30.082239 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ea42636d-244b-4499-9689-38baacf0e2a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:50:30.083840 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1209/2423] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:50:29 2022] DELETE /identity/v3/projects/1857cfed5e0c4e4f8f59ffa39044dbe3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:50:30.088819 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ea203-0820-419a-af72-b53defbb6c44 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:30.089110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ea203-0820-419a-af72-b53defbb6c44 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:30.089427 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ea203-0820-419a-af72-b53defbb6c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:30.109715 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-499ea203-0820-419a-af72-b53defbb6c44 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:50:30.110949 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-499ea203-0820-419a-af72-b53defbb6c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:30.180297 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:30.197351 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1215/2424] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:50:30.202552 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b042e-721e-485c-a650-f8905bf603e9 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:30.203024 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b042e-721e-485c-a650-f8905bf603e9 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:30.203366 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b042e-721e-485c-a650-f8905bf603e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:30.220556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58805787-d3a5-443f-9894-2dc4d5f05d88 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:30.221223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58805787-d3a5-443f-9894-2dc4d5f05d88 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:30.221753 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58805787-d3a5-443f-9894-2dc4d5f05d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:30.235419 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-fe4b042e-721e-485c-a650-f8905bf603e9 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:50:30.236825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-fe4b042e-721e-485c-a650-f8905bf603e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:30.246954 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1210/2425] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:50:30.253596 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b042e-721e-485c-a650-f8905bf603e9 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:30.255775 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-58805787-d3a5-443f-9894-2dc4d5f05d88 None None] MFA Rules not processed for user `c8f314167aa94d81955ac761a5a28504`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:50:30.257534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-58805787-d3a5-443f-9894-2dc4d5f05d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:30.271456 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b042e-721e-485c-a650-f8905bf603e9 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:30.278335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0315c68-55e3-43d4-98d5-b7a56a448bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:30.279072 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0315c68-55e3-43d4-98d5-b7a56a448bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:30.279413 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0315c68-55e3-43d4-98d5-b7a56a448bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:30.279694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0315c68-55e3-43d4-98d5-b7a56a448bf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:30.281257 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0315c68-55e3-43d4-98d5-b7a56a448bf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:50:30.281579 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0315c68-55e3-43d4-98d5-b7a56a448bf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:30.283745 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0315c68-55e3-43d4-98d5-b7a56a448bf2 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:30.298954 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1211/2426] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:50:30.304466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0315c68-55e3-43d4-98d5-b7a56a448bf2 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:30.321034 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0315c68-55e3-43d4-98d5-b7a56a448bf2 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:30.327753 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01537724-2816-451a-b776-6ebfcb6e8b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:30.328462 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01537724-2816-451a-b776-6ebfcb6e8b85 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:30.328749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01537724-2816-451a-b776-6ebfcb6e8b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:30.329028 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01537724-2816-451a-b776-6ebfcb6e8b85 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:30.329744 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01537724-2816-451a-b776-6ebfcb6e8b85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:30.331694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01537724-2816-451a-b776-6ebfcb6e8b85 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:30.340394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1216/2427] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jul 19 20:50:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:50:30.384904 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1212/2428] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:50:30 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:50:30.386606 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58805787-d3a5-443f-9894-2dc4d5f05d88 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:30.397450 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01537724-2816-451a-b776-6ebfcb6e8b85 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:30.400010 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-01537724-2816-451a-b776-6ebfcb6e8b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:30.405148 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58805787-d3a5-443f-9894-2dc4d5f05d88 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:30.476541 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4f3ab-56a0-4a22-aedb-7c0b62bef6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:30.477279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4f3ab-56a0-4a22-aedb-7c0b62bef6ad admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:30.477714 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4f3ab-56a0-4a22-aedb-7c0b62bef6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:30.477840 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4f3ab-56a0-4a22-aedb-7c0b62bef6ad admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:30.478758 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4f3ab-56a0-4a22-aedb-7c0b62bef6ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:30.481319 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4f3ab-56a0-4a22-aedb-7c0b62bef6ad admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:30.508903 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01537724-2816-451a-b776-6ebfcb6e8b85 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:30.509908 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1217/2429] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:50:30 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:50:30.514167 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4f3ab-56a0-4a22-aedb-7c0b62bef6ad admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:30.517463 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be239b53-86af-48f0-aeed-1112ab63aaf4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7987846276ad4ccd90899128ceb1354e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:30.518131 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be239b53-86af-48f0-aeed-1112ab63aaf4 service swift] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:30.518414 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be239b53-86af-48f0-aeed-1112ab63aaf4 service swift] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:30.518728 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be239b53-86af-48f0-aeed-1112ab63aaf4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:30.526520 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4f3ab-56a0-4a22-aedb-7c0b62bef6ad admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:30.537197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58b6c7-0e94-46e8-b8a3-563062f804df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:30.537918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58b6c7-0e94-46e8-b8a3-563062f804df admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:30.538203 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58b6c7-0e94-46e8-b8a3-563062f804df admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:30.538480 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58b6c7-0e94-46e8-b8a3-563062f804df admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:30.539221 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58b6c7-0e94-46e8-b8a3-563062f804df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:30.540850 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58b6c7-0e94-46e8-b8a3-563062f804df admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:30.556130 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1218/2430] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:50:30.557596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58b6c7-0e94-46e8-b8a3-563062f804df admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:30.567585 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58b6c7-0e94-46e8-b8a3-563062f804df admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:30.573135 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bc589-fac9-4652-bd67-dbf4ca276caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:30.574036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bc589-fac9-4652-bd67-dbf4ca276caf admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:30.574322 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bc589-fac9-4652-bd67-dbf4ca276caf admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:30.574598 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bc589-fac9-4652-bd67-dbf4ca276caf admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:30.575374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bc589-fac9-4652-bd67-dbf4ca276caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:30.576977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bc589-fac9-4652-bd67-dbf4ca276caf admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:30.584882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be239b53-86af-48f0-aeed-1112ab63aaf4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:30.586726 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be239b53-86af-48f0-aeed-1112ab63aaf4 service swift] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:30.591847 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1219/2431] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:50:30.592033 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:30.596175 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bc589-fac9-4652-bd67-dbf4ca276caf admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:30.600488 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1213/2432] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jul 19 20:50:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 20:50:30.611504 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bc589-fac9-4652-bd67-dbf4ca276caf admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:30.617495 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c865cc2-dbcf-4512-b520-cf0d9aad3882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:30.618565 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c865cc2-dbcf-4512-b520-cf0d9aad3882 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:30.618848 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c865cc2-dbcf-4512-b520-cf0d9aad3882 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:30.619123 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c865cc2-dbcf-4512-b520-cf0d9aad3882 admin admin] PATH_INFO: `/v3/projects/e484ff78df6742a781c0c0e861bd3a39/users/4669b025e0b840a68f9ec0dae7ee077d/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:30.644947 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c865cc2-dbcf-4512-b520-cf0d9aad3882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e484ff78df6742a781c0c0e861bd3a39, user_id=4669b025e0b840a68f9ec0dae7ee077d, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:30.648135 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c865cc2-dbcf-4512-b520-cf0d9aad3882 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:30.677726 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1220/2433] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:50:30 2022] PUT /identity/v3/projects/e484ff78df6742a781c0c0e861bd3a39/users/4669b025e0b840a68f9ec0dae7ee077d/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:50:30.688901 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5efe6c-1c31-4079-b5f3-d1a13a3028c5 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:30.689163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5efe6c-1c31-4079-b5f3-d1a13a3028c5 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:30.689438 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5efe6c-1c31-4079-b5f3-d1a13a3028c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:30.718853 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-bd5efe6c-1c31-4079-b5f3-d1a13a3028c5 None None] MFA Rules not processed for user `4669b025e0b840a68f9ec0dae7ee077d`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:50:30.720269 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-bd5efe6c-1c31-4079-b5f3-d1a13a3028c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:30.798449 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1214/2434] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:50:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:50:30.810435 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c865cc2-dbcf-4512-b520-cf0d9aad3882 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:50:30.812348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-2c865cc2-dbcf-4512-b520-cf0d9aad3882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:30.878395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:30.888450 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c865cc2-dbcf-4512-b520-cf0d9aad3882 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:50:30.894394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3900ca-63d3-4161-8b8d-b6b622062d1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:50:30.895055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3900ca-63d3-4161-8b8d-b6b622062d1c service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:30.895371 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3900ca-63d3-4161-8b8d-b6b622062d1c service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:30.895654 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3900ca-63d3-4161-8b8d-b6b622062d1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:30.908438 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3900ca-63d3-4161-8b8d-b6b622062d1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:50:30.911730 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3900ca-63d3-4161-8b8d-b6b622062d1c service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:50:30.922568 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1221/2435] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:50:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:50:32.482666 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083894e0-3bc5-4602-b92c-44d4e4d150f2 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:50:32.483827 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083894e0-3bc5-4602-b92c-44d4e4d150f2 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:50:32.484307 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083894e0-3bc5-4602-b92c-44d4e4d150f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:50:32.505617 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-083894e0-3bc5-4602-b92c-44d4e4d150f2 None None] MFA Rules not processed for user `4669b025e0b840a68f9ec0dae7ee077d`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:50:32.507755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-083894e0-3bc5-4602-b92c-44d4e4d150f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:50:32.515514 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1215/2436] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:50:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:50:40.917251 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=4 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:50:42.499121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=35 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:00.769844 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25b667-9b5c-4927-aca3-ec949f724764 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:00.770371 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25b667-9b5c-4927-aca3-ec949f724764 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:00.770469 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25b667-9b5c-4927-aca3-ec949f724764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:00.788768 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-8c25b667-9b5c-4927-aca3-ec949f724764 None None] MFA Rules not processed for user `c8f314167aa94d81955ac761a5a28504`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:51:00.789991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-8c25b667-9b5c-4927-aca3-ec949f724764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:00.844270 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1222/2437] 10.222.0.77 () {58 vars in 967 bytes} [Tue Jul 19 20:51:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:51:00.861675 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083894e0-3bc5-4602-b92c-44d4e4d150f2 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:51:00.929262 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083894e0-3bc5-4602-b92c-44d4e4d150f2 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:51:00.934274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f032d7e-e130-4c9e-8f07-6cd81ecc6c71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7987846276ad4ccd90899128ceb1354e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:51:00.934926 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f032d7e-e130-4c9e-8f07-6cd81ecc6c71 service swift] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:00.935212 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f032d7e-e130-4c9e-8f07-6cd81ecc6c71 service swift] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:00.935520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f032d7e-e130-4c9e-8f07-6cd81ecc6c71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:00.944248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f032d7e-e130-4c9e-8f07-6cd81ecc6c71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:51:00.945863 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f032d7e-e130-4c9e-8f07-6cd81ecc6c71 service swift] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:51:00.953982 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1216/2438] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jul 19 20:51:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 20:51:02.980968 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25b667-9b5c-4927-aca3-ec949f724764 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:51:02.983096 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-8c25b667-9b5c-4927-aca3-ec949f724764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:03.055216 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25b667-9b5c-4927-aca3-ec949f724764 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:51:03.060562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383af69f-d7bf-4e0b-a452-2bed93303441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:51:03.061627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383af69f-d7bf-4e0b-a452-2bed93303441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:03.061912 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383af69f-d7bf-4e0b-a452-2bed93303441 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:03.062189 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383af69f-d7bf-4e0b-a452-2bed93303441 admin admin] PATH_INFO: `/v3/users/aa370363c76b4e86b68015b490aa9a06` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:03.064070 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383af69f-d7bf-4e0b-a452-2bed93303441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa370363c76b4e86b68015b490aa9a06)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:51:03.066079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383af69f-d7bf-4e0b-a452-2bed93303441 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:51:03.119392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-383af69f-d7bf-4e0b-a452-2bed93303441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa370363c76b4e86b68015b490aa9a06'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:51:03.126711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-383af69f-d7bf-4e0b-a452-2bed93303441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa370363c76b4e86b68015b490aa9a06'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:51:03.139829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-383af69f-d7bf-4e0b-a452-2bed93303441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa370363c76b4e86b68015b490aa9a06'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:51:03.149950 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-383af69f-d7bf-4e0b-a452-2bed93303441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa370363c76b4e86b68015b490aa9a06'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:51:03.150665 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-383af69f-d7bf-4e0b-a452-2bed93303441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa370363c76b4e86b68015b490aa9a06'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:51:03.158211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1223/2439] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:51:02 2022] DELETE /identity/v3/users/aa370363c76b4e86b68015b490aa9a06 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:51:03.359050 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f032d7e-e130-4c9e-8f07-6cd81ecc6c71 service swift] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:51:03.373154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f032d7e-e130-4c9e-8f07-6cd81ecc6c71 service swift] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:51:03.445385 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23aa2e3-e721-416a-afae-6a1969fc8502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:51:03.446508 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23aa2e3-e721-416a-afae-6a1969fc8502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:03.446725 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23aa2e3-e721-416a-afae-6a1969fc8502 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:03.447010 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23aa2e3-e721-416a-afae-6a1969fc8502 admin admin] PATH_INFO: `/v3/projects/78a567d5817246699467a6eead86044a` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:03.448246 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23aa2e3-e721-416a-afae-6a1969fc8502 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78a567d5817246699467a6eead86044a)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:51:03.450299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23aa2e3-e721-416a-afae-6a1969fc8502 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:51:03.502700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b23aa2e3-e721-416a-afae-6a1969fc8502 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78a567d5817246699467a6eead86044a', 'request_id': 'req-b23aa2e3-e721-416a-afae-6a1969fc8502'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:51:03.509742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b23aa2e3-e721-416a-afae-6a1969fc8502 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78a567d5817246699467a6eead86044a', 'request_id': 'req-b23aa2e3-e721-416a-afae-6a1969fc8502'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:51:03.515728 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b23aa2e3-e721-416a-afae-6a1969fc8502 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78a567d5817246699467a6eead86044a', 'request_id': 'req-b23aa2e3-e721-416a-afae-6a1969fc8502'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:51:03.529143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b23aa2e3-e721-416a-afae-6a1969fc8502 admin admin] The token cache is being invalidate because project 78a567d5817246699467a6eead86044a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:51:03.529433 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b23aa2e3-e721-416a-afae-6a1969fc8502 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:51:03.530105 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b23aa2e3-e721-416a-afae-6a1969fc8502 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:51:03.531713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1217/2440] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:51:03 2022] DELETE /identity/v3/projects/78a567d5817246699467a6eead86044a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:51:06.669330 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15bc0b-8af1-4b01-bf4e-43574d3918b6 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:06.669873 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15bc0b-8af1-4b01-bf4e-43574d3918b6 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:06.669873 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15bc0b-8af1-4b01-bf4e-43574d3918b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:06.688051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-7a15bc0b-8af1-4b01-bf4e-43574d3918b6 None None] MFA Rules not processed for user `c1a2b827eaad4e2784613fa4a54c2c44`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:51:06.689253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7a15bc0b-8af1-4b01-bf4e-43574d3918b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:06.708210 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:06.745974 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1224/2441] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:51:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:51:13.525035 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:16.570053 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23aa2e3-e721-416a-afae-6a1969fc8502 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:51:16.571582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b23aa2e3-e721-416a-afae-6a1969fc8502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:16.644235 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23aa2e3-e721-416a-afae-6a1969fc8502 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:51:16.654080 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827924d-476c-4445-9482-3bf85cf0340a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04843ec31eb84585944c7a2b9cd1c0cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:51:16.654752 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827924d-476c-4445-9482-3bf85cf0340a service placement] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:16.655036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827924d-476c-4445-9482-3bf85cf0340a service placement] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:16.655336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827924d-476c-4445-9482-3bf85cf0340a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:16.658726 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-6827924d-476c-4445-9482-3bf85cf0340a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:16.672688 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827924d-476c-4445-9482-3bf85cf0340a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:51:16.674371 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827924d-476c-4445-9482-3bf85cf0340a service placement] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:51:16.685638 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1218/2442] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:51:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:51:16.738644 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=14 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:19.131804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15bc0b-8af1-4b01-bf4e-43574d3918b6 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:51:19.133577 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7a15bc0b-8af1-4b01-bf4e-43574d3918b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:19.210037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15bc0b-8af1-4b01-bf4e-43574d3918b6 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:51:19.214580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8a690-3e0e-4543-aded-750de627cbdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:51:19.215286 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8a690-3e0e-4543-aded-750de627cbdf service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:19.215577 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8a690-3e0e-4543-aded-750de627cbdf service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:19.215910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8a690-3e0e-4543-aded-750de627cbdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:19.217966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ebe8a690-3e0e-4543-aded-750de627cbdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:19.297926 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8a690-3e0e-4543-aded-750de627cbdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:51:19.298747 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8a690-3e0e-4543-aded-750de627cbdf service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:51:19.311291 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1225/2443] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:51:19 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:51:20.494886 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fc089-1a5d-4022-8548-3bb8dcc1194d None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:20.495387 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fc089-1a5d-4022-8548-3bb8dcc1194d None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:20.495495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fc089-1a5d-4022-8548-3bb8dcc1194d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:20.515187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-9e1fc089-1a5d-4022-8548-3bb8dcc1194d None None] MFA Rules not processed for user `c8f314167aa94d81955ac761a5a28504`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:51:20.516444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9e1fc089-1a5d-4022-8548-3bb8dcc1194d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:20.574470 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1219/2444] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jul 19 20:51:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:51:20.587785 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8a690-3e0e-4543-aded-750de627cbdf service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:51:20.589212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ebe8a690-3e0e-4543-aded-750de627cbdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:20.659800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8a690-3e0e-4543-aded-750de627cbdf service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:51:20.665512 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9dce12-cad8-4f11-b37a-5234af5a46b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7987846276ad4ccd90899128ceb1354e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:51:20.666160 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dce12-cad8-4f11-b37a-5234af5a46b3 service swift] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:20.666444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dce12-cad8-4f11-b37a-5234af5a46b3 service swift] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:20.666713 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dce12-cad8-4f11-b37a-5234af5a46b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:20.675691 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9dce12-cad8-4f11-b37a-5234af5a46b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:51:20.677364 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9dce12-cad8-4f11-b37a-5234af5a46b3 service swift] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:51:20.685937 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1226/2445] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jul 19 20:51:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 20:51:21.241752 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b092731-6510-44ff-9a73-462cbe45995c None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:21.242048 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b092731-6510-44ff-9a73-462cbe45995c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:21.242328 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b092731-6510-44ff-9a73-462cbe45995c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:21.261015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-1b092731-6510-44ff-9a73-462cbe45995c None None] MFA Rules not processed for user `c8f314167aa94d81955ac761a5a28504`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:51:21.262339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-1b092731-6510-44ff-9a73-462cbe45995c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:21.269789 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1220/2446] 10.222.0.77 () {58 vars in 967 bytes} [Tue Jul 19 20:51:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:51:21.283065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9dce12-cad8-4f11-b37a-5234af5a46b3 service swift] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:51:21.294878 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9dce12-cad8-4f11-b37a-5234af5a46b3 service swift] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:51:21.300131 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26953d82-3ab6-4788-973e-c3ed1b0986bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7987846276ad4ccd90899128ceb1354e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:51:21.300777 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26953d82-3ab6-4788-973e-c3ed1b0986bb service swift] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:21.301066 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26953d82-3ab6-4788-973e-c3ed1b0986bb service swift] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:21.301346 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26953d82-3ab6-4788-973e-c3ed1b0986bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:21.310757 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26953d82-3ab6-4788-973e-c3ed1b0986bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:51:21.312374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26953d82-3ab6-4788-973e-c3ed1b0986bb service swift] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:51:21.320821 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1227/2447] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jul 19 20:51:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 20:51:21.545954 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280d85b-1184-4377-b9df-ce276b600093 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:21.546448 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280d85b-1184-4377-b9df-ce276b600093 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:21.546583 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280d85b-1184-4377-b9df-ce276b600093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:21.565636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-6280d85b-1184-4377-b9df-ce276b600093 None None] MFA Rules not processed for user `c8f314167aa94d81955ac761a5a28504`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:51:21.566871 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-6280d85b-1184-4377-b9df-ce276b600093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:21.574560 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1221/2448] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jul 19 20:51:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:51:21.588097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26953d82-3ab6-4788-973e-c3ed1b0986bb service swift] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:51:21.602656 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26953d82-3ab6-4788-973e-c3ed1b0986bb service swift] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:51:21.614031 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23efdfe-a46e-424c-bccb-c267bf6b58dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7987846276ad4ccd90899128ceb1354e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:51:21.614031 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23efdfe-a46e-424c-bccb-c267bf6b58dd service swift] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:21.614031 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23efdfe-a46e-424c-bccb-c267bf6b58dd service swift] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:21.614031 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23efdfe-a46e-424c-bccb-c267bf6b58dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:21.623567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23efdfe-a46e-424c-bccb-c267bf6b58dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:51:21.625173 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23efdfe-a46e-424c-bccb-c267bf6b58dd service swift] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:51:21.634846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1228/2449] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jul 19 20:51:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 20:51:22.073193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325664d1-595c-44c7-a278-71b5e6ca065c None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:22.073589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325664d1-595c-44c7-a278-71b5e6ca065c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:22.074049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325664d1-595c-44c7-a278-71b5e6ca065c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:22.097589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-325664d1-595c-44c7-a278-71b5e6ca065c None None] MFA Rules not processed for user `c8f314167aa94d81955ac761a5a28504`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:51:22.099854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-325664d1-595c-44c7-a278-71b5e6ca065c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:22.110325 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1222/2450] 10.222.0.77 () {58 vars in 967 bytes} [Tue Jul 19 20:51:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:51:22.127085 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23efdfe-a46e-424c-bccb-c267bf6b58dd service swift] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:51:22.139901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23efdfe-a46e-424c-bccb-c267bf6b58dd service swift] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:51:22.147185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da60d97-a807-4055-a85f-28190b7ae2ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7987846276ad4ccd90899128ceb1354e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:51:22.148628 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da60d97-a807-4055-a85f-28190b7ae2ba service swift] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:22.149288 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da60d97-a807-4055-a85f-28190b7ae2ba service swift] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:22.149955 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da60d97-a807-4055-a85f-28190b7ae2ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:22.163974 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da60d97-a807-4055-a85f-28190b7ae2ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:51:22.165696 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da60d97-a807-4055-a85f-28190b7ae2ba service swift] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:51:22.170910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:22.176973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1229/2451] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jul 19 20:51:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 20:51:24.393017 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325664d1-595c-44c7-a278-71b5e6ca065c None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:51:24.394465 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-325664d1-595c-44c7-a278-71b5e6ca065c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:24.459987 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325664d1-595c-44c7-a278-71b5e6ca065c None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:51:24.464644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f6632-b190-4fcb-b30f-80942ff96dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:51:24.465529 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f6632-b190-4fcb-b30f-80942ff96dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:24.465817 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f6632-b190-4fcb-b30f-80942ff96dba admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:24.466097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f6632-b190-4fcb-b30f-80942ff96dba admin admin] PATH_INFO: `/v3/users/4669b025e0b840a68f9ec0dae7ee077d` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:24.467356 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f6632-b190-4fcb-b30f-80942ff96dba admin admin] RBAC: Authorizing `identity:delete_user(user_id=4669b025e0b840a68f9ec0dae7ee077d)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:51:24.469294 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f6632-b190-4fcb-b30f-80942ff96dba admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:51:24.485905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:24.519636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-406f6632-b190-4fcb-b30f-80942ff96dba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4669b025e0b840a68f9ec0dae7ee077d'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:51:24.527348 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-406f6632-b190-4fcb-b30f-80942ff96dba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4669b025e0b840a68f9ec0dae7ee077d'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:51:24.541993 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-406f6632-b190-4fcb-b30f-80942ff96dba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4669b025e0b840a68f9ec0dae7ee077d'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:51:24.542672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-406f6632-b190-4fcb-b30f-80942ff96dba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4669b025e0b840a68f9ec0dae7ee077d'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:51:24.549355 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-406f6632-b190-4fcb-b30f-80942ff96dba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4669b025e0b840a68f9ec0dae7ee077d'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:51:24.555339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1223/2452] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:51:24 2022] DELETE /identity/v3/users/4669b025e0b840a68f9ec0dae7ee077d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:51:24.560221 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33a24e-8e76-4ebb-9565-333770f6d222 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:24.560703 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33a24e-8e76-4ebb-9565-333770f6d222 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:24.560885 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33a24e-8e76-4ebb-9565-333770f6d222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:24.579210 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-0f33a24e-8e76-4ebb-9565-333770f6d222 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:51:24.580537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-0f33a24e-8e76-4ebb-9565-333770f6d222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:24.650609 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1230/2453] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:51:24.663177 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f6632-b190-4fcb-b30f-80942ff96dba admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:51:24.664710 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-406f6632-b190-4fcb-b30f-80942ff96dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:24.737693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f6632-b190-4fcb-b30f-80942ff96dba admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:51:24.741316 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f5e56-2a64-423e-be18-3db75b8e391e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:51:24.741966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f5e56-2a64-423e-be18-3db75b8e391e service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:24.742247 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f5e56-2a64-423e-be18-3db75b8e391e service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:24.742520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f5e56-2a64-423e-be18-3db75b8e391e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:24.751858 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f5e56-2a64-423e-be18-3db75b8e391e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:51:24.753274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f5e56-2a64-423e-be18-3db75b8e391e service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:51:24.763198 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1224/2454] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:51:25.154115 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33a24e-8e76-4ebb-9565-333770f6d222 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:51:25.155725 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-0f33a24e-8e76-4ebb-9565-333770f6d222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:25.170073 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33a24e-8e76-4ebb-9565-333770f6d222 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:51:25.182806 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63efab64-5e8a-407b-a364-64995b06d848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:51:25.183754 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efab64-5e8a-407b-a364-64995b06d848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:25.184033 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efab64-5e8a-407b-a364-64995b06d848 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:25.184306 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63efab64-5e8a-407b-a364-64995b06d848 admin admin] PATH_INFO: `/v3/projects/e484ff78df6742a781c0c0e861bd3a39` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:25.185635 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efab64-5e8a-407b-a364-64995b06d848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e484ff78df6742a781c0c0e861bd3a39)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:51:25.187653 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63efab64-5e8a-407b-a364-64995b06d848 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:51:25.239897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-63efab64-5e8a-407b-a364-64995b06d848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e484ff78df6742a781c0c0e861bd3a39', 'request_id': 'req-63efab64-5e8a-407b-a364-64995b06d848'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:51:25.247254 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-63efab64-5e8a-407b-a364-64995b06d848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e484ff78df6742a781c0c0e861bd3a39', 'request_id': 'req-63efab64-5e8a-407b-a364-64995b06d848'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:51:25.260870 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-63efab64-5e8a-407b-a364-64995b06d848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e484ff78df6742a781c0c0e861bd3a39', 'request_id': 'req-63efab64-5e8a-407b-a364-64995b06d848'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:51:25.274629 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-63efab64-5e8a-407b-a364-64995b06d848 admin admin] The token cache is being invalidate because project e484ff78df6742a781c0c0e861bd3a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:51:25.274921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-63efab64-5e8a-407b-a364-64995b06d848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:51:25.275613 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-63efab64-5e8a-407b-a364-64995b06d848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:51:25.280489 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1231/2455] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:51:25 2022] DELETE /identity/v3/projects/e484ff78df6742a781c0c0e861bd3a39 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:51:25.283149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdc219-dbe6-4485-9d77-02be31c06bce None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:25.283674 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdc219-dbe6-4485-9d77-02be31c06bce None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:25.284317 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdc219-dbe6-4485-9d77-02be31c06bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:25.303881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-01cdc219-dbe6-4485-9d77-02be31c06bce None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:51:25.305346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-01cdc219-dbe6-4485-9d77-02be31c06bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:25.375727 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1225/2456] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:51:25.384282 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0dea4-255f-4897-96de-9c190658f93f None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:25.384570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0dea4-255f-4897-96de-9c190658f93f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:25.384885 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0dea4-255f-4897-96de-9c190658f93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:25.406419 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-12e0dea4-255f-4897-96de-9c190658f93f None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:51:25.407731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-12e0dea4-255f-4897-96de-9c190658f93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:25.417874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1232/2457] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:51:25.422265 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdc219-dbe6-4485-9d77-02be31c06bce None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:51:25.433177 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdc219-dbe6-4485-9d77-02be31c06bce None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:51:25.438755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42643f68-52e3-4a02-ad91-e913332dae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:51:25.439469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42643f68-52e3-4a02-ad91-e913332dae1e admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:25.439760 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42643f68-52e3-4a02-ad91-e913332dae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:25.440043 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42643f68-52e3-4a02-ad91-e913332dae1e admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:25.440782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42643f68-52e3-4a02-ad91-e913332dae1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:51:25.441286 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42643f68-52e3-4a02-ad91-e913332dae1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:51:25.443446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42643f68-52e3-4a02-ad91-e913332dae1e admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:51:25.461194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1226/2458] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:51:25.462375 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0dea4-255f-4897-96de-9c190658f93f None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:51:25.471996 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0dea4-255f-4897-96de-9c190658f93f None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:51:25.478834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb40f54-15e4-42ec-967d-e9ea859ac93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:51:25.479711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb40f54-15e4-42ec-967d-e9ea859ac93f admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:25.480094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb40f54-15e4-42ec-967d-e9ea859ac93f admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:25.480472 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb40f54-15e4-42ec-967d-e9ea859ac93f admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:25.481405 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb40f54-15e4-42ec-967d-e9ea859ac93f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:51:25.483967 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb40f54-15e4-42ec-967d-e9ea859ac93f admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:51:25.513394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1233/2459] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:51:25 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:51:25.517320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42643f68-52e3-4a02-ad91-e913332dae1e admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:51:25.528374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42643f68-52e3-4a02-ad91-e913332dae1e admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:51:25.554009 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:25.595203 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfdc86-6069-45b0-a11a-564294e098e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:51:25.595913 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfdc86-6069-45b0-a11a-564294e098e1 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:25.596204 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfdc86-6069-45b0-a11a-564294e098e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:25.596483 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfdc86-6069-45b0-a11a-564294e098e1 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:25.597201 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfdc86-6069-45b0-a11a-564294e098e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:51:25.599286 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfdc86-6069-45b0-a11a-564294e098e1 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:51:25.620915 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1227/2460] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:51:25 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:51:25.625252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb40f54-15e4-42ec-967d-e9ea859ac93f admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:51:25.637023 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb40f54-15e4-42ec-967d-e9ea859ac93f admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:51:25.642420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd00c2b-7b1a-4a7b-aace-993a1f6974d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:51:25.643166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd00c2b-7b1a-4a7b-aace-993a1f6974d4 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:25.643551 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd00c2b-7b1a-4a7b-aace-993a1f6974d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:25.643898 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd00c2b-7b1a-4a7b-aace-993a1f6974d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:25.644706 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd00c2b-7b1a-4a7b-aace-993a1f6974d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:51:25.646981 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd00c2b-7b1a-4a7b-aace-993a1f6974d4 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:51:25.658216 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1234/2461] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:51:25.662508 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfdc86-6069-45b0-a11a-564294e098e1 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:51:25.672677 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfdc86-6069-45b0-a11a-564294e098e1 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:51:25.678173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9aa31b-c227-45d0-9327-29f1d59b4598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:51:25.679015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9aa31b-c227-45d0-9327-29f1d59b4598 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:25.679387 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9aa31b-c227-45d0-9327-29f1d59b4598 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:25.679743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9aa31b-c227-45d0-9327-29f1d59b4598 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:25.680674 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9aa31b-c227-45d0-9327-29f1d59b4598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:51:25.682464 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9aa31b-c227-45d0-9327-29f1d59b4598 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:51:25.693733 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1228/2462] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:51:25.699461 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd00c2b-7b1a-4a7b-aace-993a1f6974d4 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:51:25.712154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd00c2b-7b1a-4a7b-aace-993a1f6974d4 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:51:25.717181 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfaa84-ce86-46f8-9b87-750082bb797c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:51:25.718082 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfaa84-ce86-46f8-9b87-750082bb797c admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:25.718368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfaa84-ce86-46f8-9b87-750082bb797c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:25.718644 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfaa84-ce86-46f8-9b87-750082bb797c admin admin] PATH_INFO: `/v3/projects/eeea735b0cee4ce88090d6f734226a18/users/08f157a7adc348768aca9f7f48c6faf2/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:25.734615 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfaa84-ce86-46f8-9b87-750082bb797c admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeea735b0cee4ce88090d6f734226a18, user_id=08f157a7adc348768aca9f7f48c6faf2, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:51:25.738190 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfaa84-ce86-46f8-9b87-750082bb797c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:51:25.756179 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1235/2463] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:51:25 2022] PUT /identity/v3/projects/eeea735b0cee4ce88090d6f734226a18/users/08f157a7adc348768aca9f7f48c6faf2/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:51:25.766620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68f2b7-d33b-4a30-a079-a464af567e55 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:25.766989 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68f2b7-d33b-4a30-a079-a464af567e55 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:25.767308 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68f2b7-d33b-4a30-a079-a464af567e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:25.787495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-5a68f2b7-d33b-4a30-a079-a464af567e55 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:51:25.788741 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-5a68f2b7-d33b-4a30-a079-a464af567e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:25.855796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1229/2464] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:51:25.865863 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfaa84-ce86-46f8-9b87-750082bb797c admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:51:25.867571 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e5cfaa84-ce86-46f8-9b87-750082bb797c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:25.892237 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:25.931042 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfaa84-ce86-46f8-9b87-750082bb797c admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:51:25.934794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa302fc9-85f2-44de-88f8-5be028ee3226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:51:25.935659 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa302fc9-85f2-44de-88f8-5be028ee3226 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:25.935939 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa302fc9-85f2-44de-88f8-5be028ee3226 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:25.936230 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa302fc9-85f2-44de-88f8-5be028ee3226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:25.946110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa302fc9-85f2-44de-88f8-5be028ee3226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:51:25.947545 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa302fc9-85f2-44de-88f8-5be028ee3226 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:51:25.957284 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1236/2465] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:51:26.617999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4799a-e912-405e-9e4e-7d01c3fc4388 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:26.618500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4799a-e912-405e-9e4e-7d01c3fc4388 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:26.618907 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4799a-e912-405e-9e4e-7d01c3fc4388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:26.646730 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-8bb4799a-e912-405e-9e4e-7d01c3fc4388 None None] MFA Rules not processed for user `08f157a7adc348768aca9f7f48c6faf2`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:51:26.647906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-8bb4799a-e912-405e-9e4e-7d01c3fc4388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:26.731311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1230/2466] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:51:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:51:26.742971 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa302fc9-85f2-44de-88f8-5be028ee3226 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:51:26.744485 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-aa302fc9-85f2-44de-88f8-5be028ee3226 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:26.831493 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa302fc9-85f2-44de-88f8-5be028ee3226 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:51:26.836735 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a8b27-364d-4b4b-b407-5556f1592f02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:51:26.837446 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a8b27-364d-4b4b-b407-5556f1592f02 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:26.837882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a8b27-364d-4b4b-b407-5556f1592f02 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:26.838165 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a8b27-364d-4b4b-b407-5556f1592f02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:26.848168 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a8b27-364d-4b4b-b407-5556f1592f02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:51:26.850610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a8b27-364d-4b4b-b407-5556f1592f02 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:51:26.871401 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1237/2467] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:51:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:51:28.230286 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d4e16-ade1-4eb2-89a0-b39012e39431 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:28.230848 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d4e16-ade1-4eb2-89a0-b39012e39431 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:28.230848 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d4e16-ade1-4eb2-89a0-b39012e39431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:28.249491 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-e74d4e16-ade1-4eb2-89a0-b39012e39431 None None] MFA Rules not processed for user `08f157a7adc348768aca9f7f48c6faf2`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:51:28.250711 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e74d4e16-ade1-4eb2-89a0-b39012e39431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:28.258553 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1231/2468] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:51:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:51:36.859869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=43 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:38.245459 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=85,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:48.331153 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90325724-380a-4b68-b416-9807374a5eb7 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:48.331729 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90325724-380a-4b68-b416-9807374a5eb7 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:48.332116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90325724-380a-4b68-b416-9807374a5eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:48.350408 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-90325724-380a-4b68-b416-9807374a5eb7 None None] MFA Rules not processed for user `c8f314167aa94d81955ac761a5a28504`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:51:48.351678 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-90325724-380a-4b68-b416-9807374a5eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:48.406566 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1238/2469] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jul 19 20:51:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:51:48.430155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d4e16-ade1-4eb2-89a0-b39012e39431 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:51:48.432281 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e74d4e16-ade1-4eb2-89a0-b39012e39431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:51:48.502948 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d4e16-ade1-4eb2-89a0-b39012e39431 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:51:48.508456 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca16a7-ae81-4e74-b7ac-9b4b9f39ca9f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7987846276ad4ccd90899128ceb1354e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:51:48.509119 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca16a7-ae81-4e74-b7ac-9b4b9f39ca9f service swift] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:51:48.509486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca16a7-ae81-4e74-b7ac-9b4b9f39ca9f service swift] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:51:48.509670 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca16a7-ae81-4e74-b7ac-9b4b9f39ca9f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:51:48.518777 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca16a7-ae81-4e74-b7ac-9b4b9f39ca9f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:51:48.520510 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca16a7-ae81-4e74-b7ac-9b4b9f39ca9f service swift] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:51:48.529764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1232/2470] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jul 19 20:51:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 20:51:58.400566 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=25 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:51:58.526579 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=32 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:03.537162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd7183-7184-47f1-ba63-950da0388430 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:03.537705 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd7183-7184-47f1-ba63-950da0388430 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:03.537792 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd7183-7184-47f1-ba63-950da0388430 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:03.539488 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1239/2471] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jul 19 20:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:52:03.548658 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c8371-00de-49b2-b1f4-885b1f4a2bd6 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:03.549542 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c8371-00de-49b2-b1f4-885b1f4a2bd6 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:03.550014 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c8371-00de-49b2-b1f4-885b1f4a2bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:03.571320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-3f8c8371-00de-49b2-b1f4-885b1f4a2bd6 None None] MFA Rules not processed for user `6dbbb8f7b3f2449fb9c64ca3815b6c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:52:03.572603 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-3f8c8371-00de-49b2-b1f4-885b1f4a2bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:52:03.648011 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1233/2472] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jul 19 20:52:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:52:03.660177 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd7183-7184-47f1-ba63-950da0388430 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:52:03.662403 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-efcd7183-7184-47f1-ba63-950da0388430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:52:03.724346 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd7183-7184-47f1-ba63-950da0388430 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:52:03.727870 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5e935-c5c7-4808-88a1-e90612683db8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d9a41e10cb64ee9972debaf856503d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:52:03.728512 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5e935-c5c7-4808-88a1-e90612683db8 service glance] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:03.728792 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5e935-c5c7-4808-88a1-e90612683db8 service glance] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:03.729098 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5e935-c5c7-4808-88a1-e90612683db8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:03.739737 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5e935-c5c7-4808-88a1-e90612683db8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:52:03.741154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5e935-c5c7-4808-88a1-e90612683db8 service glance] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:52:03.751861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1240/2473] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:52:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:52:03.820216 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f863f-8bef-4af2-9d63-9fc686f3e030 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:03.820513 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f863f-8bef-4af2-9d63-9fc686f3e030 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:03.820801 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f863f-8bef-4af2-9d63-9fc686f3e030 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:03.822207 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1234/2474] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jul 19 20:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:52:03.827247 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2a9f9-0702-442a-9f5e-9d579cd8f414 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:03.827558 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2a9f9-0702-442a-9f5e-9d579cd8f414 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:03.827860 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2a9f9-0702-442a-9f5e-9d579cd8f414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:03.845348 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-84a2a9f9-0702-442a-9f5e-9d579cd8f414 None None] MFA Rules not processed for user `5b2c0f24d666462aa14ea4eee0592062`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:52:03.846543 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-84a2a9f9-0702-442a-9f5e-9d579cd8f414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:52:03.853542 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1241/2475] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jul 19 20:52:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:52:03.866552 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f863f-8bef-4af2-9d63-9fc686f3e030 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:52:03.877550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f863f-8bef-4af2-9d63-9fc686f3e030 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:52:03.881155 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa8171b-a04b-49bd-a02f-093c1a87b925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:52:03.881801 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8171b-a04b-49bd-a02f-093c1a87b925 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:03.882085 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8171b-a04b-49bd-a02f-093c1a87b925 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:03.882366 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa8171b-a04b-49bd-a02f-093c1a87b925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:03.889918 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8171b-a04b-49bd-a02f-093c1a87b925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:52:03.891377 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa8171b-a04b-49bd-a02f-093c1a87b925 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:52:03.899511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1235/2476] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:52:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:52:03.985445 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ff5d9-99c8-4bf3-81c8-a597b4638aa0 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:03.985730 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ff5d9-99c8-4bf3-81c8-a597b4638aa0 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:03.986006 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ff5d9-99c8-4bf3-81c8-a597b4638aa0 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:03.987421 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1242/2477] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jul 19 20:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:52:03.994160 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6855b-29c4-49f3-9004-7f4a42aaa64b None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:03.994487 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6855b-29c4-49f3-9004-7f4a42aaa64b None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:03.994771 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6855b-29c4-49f3-9004-7f4a42aaa64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:04.013122 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-64d6855b-29c4-49f3-9004-7f4a42aaa64b None None] MFA Rules not processed for user `6dbbb8f7b3f2449fb9c64ca3815b6c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:52:04.014320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-64d6855b-29c4-49f3-9004-7f4a42aaa64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:52:04.024632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1236/2478] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jul 19 20:52:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:52:04.036156 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ff5d9-99c8-4bf3-81c8-a597b4638aa0 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:52:04.047048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ff5d9-99c8-4bf3-81c8-a597b4638aa0 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:52:04.050589 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693fed9-6cc0-4a18-b039-37979cdbc5c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:52:04.051221 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693fed9-6cc0-4a18-b039-37979cdbc5c5 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:04.051523 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693fed9-6cc0-4a18-b039-37979cdbc5c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:04.051797 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693fed9-6cc0-4a18-b039-37979cdbc5c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:04.062086 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693fed9-6cc0-4a18-b039-37979cdbc5c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:52:04.063523 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693fed9-6cc0-4a18-b039-37979cdbc5c5 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:52:04.074124 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1243/2479] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:52:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:52:09.435427 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f365fed-fe58-4bd5-bc51-4d80914b0f9a None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:09.436392 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f365fed-fe58-4bd5-bc51-4d80914b0f9a None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:09.436801 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f365fed-fe58-4bd5-bc51-4d80914b0f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:09.461039 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-5f365fed-fe58-4bd5-bc51-4d80914b0f9a None None] MFA Rules not processed for user `c8f314167aa94d81955ac761a5a28504`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:52:09.462672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-5f365fed-fe58-4bd5-bc51-4d80914b0f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:52:09.471335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1237/2480] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jul 19 20:52:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:52:09.486406 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693fed9-6cc0-4a18-b039-37979cdbc5c5 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:52:09.505568 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693fed9-6cc0-4a18-b039-37979cdbc5c5 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:52:09.512344 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549aac28-a2da-46ae-8e1a-cec64723ac98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7987846276ad4ccd90899128ceb1354e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:52:09.513397 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549aac28-a2da-46ae-8e1a-cec64723ac98 service swift] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:09.513989 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549aac28-a2da-46ae-8e1a-cec64723ac98 service swift] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:09.514459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549aac28-a2da-46ae-8e1a-cec64723ac98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:09.525346 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549aac28-a2da-46ae-8e1a-cec64723ac98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:52:09.527453 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549aac28-a2da-46ae-8e1a-cec64723ac98 service swift] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:52:09.536829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1244/2481] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jul 19 20:52:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 20:52:09.964306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71631ce-6b2e-404f-935d-6ad8fb649996 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:09.964792 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71631ce-6b2e-404f-935d-6ad8fb649996 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:09.965205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71631ce-6b2e-404f-935d-6ad8fb649996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:09.985673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-c71631ce-6b2e-404f-935d-6ad8fb649996 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:52:09.987459 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-c71631ce-6b2e-404f-935d-6ad8fb649996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:52:09.998062 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1238/2482] 10.222.0.81 () {58 vars in 1016 bytes} [Tue Jul 19 20:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:52:10.035744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549aac28-a2da-46ae-8e1a-cec64723ac98 service swift] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:52:10.037260 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-549aac28-a2da-46ae-8e1a-cec64723ac98 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:52:10.061514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549aac28-a2da-46ae-8e1a-cec64723ac98 service swift] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:52:10.069094 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3564c3-48f7-4b72-85f5-755754450761 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:52:10.070161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3564c3-48f7-4b72-85f5-755754450761 service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:10.070520 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3564c3-48f7-4b72-85f5-755754450761 service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:10.070848 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3564c3-48f7-4b72-85f5-755754450761 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:10.082331 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3564c3-48f7-4b72-85f5-755754450761 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:52:10.085111 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3564c3-48f7-4b72-85f5-755754450761 service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:52:10.101017 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1245/2483] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:52:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:52:19.980063 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=46 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:20.094294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=47 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:26.397266 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfc04c-88bf-4832-8029-0881065d0426 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:26.398479 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfc04c-88bf-4832-8029-0881065d0426 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:26.399009 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfc04c-88bf-4832-8029-0881065d0426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:26.420552 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-7dbfc04c-88bf-4832-8029-0881065d0426 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:52:26.422151 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-7dbfc04c-88bf-4832-8029-0881065d0426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:52:26.430909 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1239/2484] 10.222.0.81 () {58 vars in 1016 bytes} [Tue Jul 19 20:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:52:26.463420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3564c3-48f7-4b72-85f5-755754450761 service nova] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:52:26.476037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3564c3-48f7-4b72-85f5-755754450761 service nova] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:52:26.483484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f638d-09b3-49c8-9ff6-12628f7875c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:52:26.484155 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f638d-09b3-49c8-9ff6-12628f7875c8 service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:26.484443 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f638d-09b3-49c8-9ff6-12628f7875c8 service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:26.484885 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f638d-09b3-49c8-9ff6-12628f7875c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:26.494672 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f638d-09b3-49c8-9ff6-12628f7875c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:52:26.496293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f638d-09b3-49c8-9ff6-12628f7875c8 service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:52:26.507067 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1246/2485] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:52:36.414050 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:36.501995 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=6 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:37.869932 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca63228-89b1-43a6-9b71-c0aec4a1f445 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:37.870526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca63228-89b1-43a6-9b71-c0aec4a1f445 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:37.870654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca63228-89b1-43a6-9b71-c0aec4a1f445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:37.889172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-aca63228-89b1-43a6-9b71-c0aec4a1f445 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:52:37.890397 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-aca63228-89b1-43a6-9b71-c0aec4a1f445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:52:37.901013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1240/2486] 10.222.0.81 () {58 vars in 1016 bytes} [Tue Jul 19 20:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:52:37.943464 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f638d-09b3-49c8-9ff6-12628f7875c8 service nova] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:52:37.954443 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f638d-09b3-49c8-9ff6-12628f7875c8 service nova] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:52:37.960445 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea1a95-7846-4226-946e-0097dd46f123 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:52:37.961087 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea1a95-7846-4226-946e-0097dd46f123 service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:37.961366 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea1a95-7846-4226-946e-0097dd46f123 service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:37.961643 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea1a95-7846-4226-946e-0097dd46f123 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:37.970081 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea1a95-7846-4226-946e-0097dd46f123 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:52:37.971782 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea1a95-7846-4226-946e-0097dd46f123 service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:52:37.982240 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1247/2487] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:52:38.657628 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3da73-d869-4edd-a6c7-87287ae3cc7d None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:38.657922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3da73-d869-4edd-a6c7-87287ae3cc7d None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:38.658205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3da73-d869-4edd-a6c7-87287ae3cc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:38.677698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-fde3da73-d869-4edd-a6c7-87287ae3cc7d None None] MFA Rules not processed for user `c8f314167aa94d81955ac761a5a28504`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:52:38.678922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-fde3da73-d869-4edd-a6c7-87287ae3cc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:52:38.687332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1241/2488] 10.222.0.77 () {58 vars in 967 bytes} [Tue Jul 19 20:52:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:52:38.702428 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea1a95-7846-4226-946e-0097dd46f123 service nova] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:52:38.723207 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea1a95-7846-4226-946e-0097dd46f123 service nova] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:52:38.731327 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b32859-4fee-46f6-9687-ca63e1de2c36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7987846276ad4ccd90899128ceb1354e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:52:38.732397 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b32859-4fee-46f6-9687-ca63e1de2c36 service swift] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:38.732897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b32859-4fee-46f6-9687-ca63e1de2c36 service swift] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:38.733386 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b32859-4fee-46f6-9687-ca63e1de2c36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:38.748173 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b32859-4fee-46f6-9687-ca63e1de2c36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:52:38.750862 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b32859-4fee-46f6-9687-ca63e1de2c36 service swift] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:52:38.765624 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1248/2489] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jul 19 20:52:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 20:52:41.967751 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0ac85-f8bc-40e9-ba00-24033277bac4 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:41.968237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0ac85-f8bc-40e9-ba00-24033277bac4 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:41.968333 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0ac85-f8bc-40e9-ba00-24033277bac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:41.986717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-ccb0ac85-f8bc-40e9-ba00-24033277bac4 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:52:41.988586 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-ccb0ac85-f8bc-40e9-ba00-24033277bac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:52:41.996468 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1242/2490] 10.222.0.81 () {58 vars in 1016 bytes} [Tue Jul 19 20:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:52:42.035671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b32859-4fee-46f6-9687-ca63e1de2c36 service swift] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:52:42.037138 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-74b32859-4fee-46f6-9687-ca63e1de2c36 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:52:42.053116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b32859-4fee-46f6-9687-ca63e1de2c36 service swift] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:52:42.058587 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc1d35-d30a-4a3f-8b17-a033b2feb4f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:52:42.059205 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc1d35-d30a-4a3f-8b17-a033b2feb4f8 service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:42.059523 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc1d35-d30a-4a3f-8b17-a033b2feb4f8 service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:42.059805 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc1d35-d30a-4a3f-8b17-a033b2feb4f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:42.068104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc1d35-d30a-4a3f-8b17-a033b2feb4f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:52:42.069712 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc1d35-d30a-4a3f-8b17-a033b2feb4f8 service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:52:42.079319 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1249/2491] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:52:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:52:46.137167 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1eb22-a484-47a7-8dd4-bc6de7c3c358 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:46.137753 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1eb22-a484-47a7-8dd4-bc6de7c3c358 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:46.137872 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1eb22-a484-47a7-8dd4-bc6de7c3c358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:46.155418 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-2fc1eb22-a484-47a7-8dd4-bc6de7c3c358 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:52:46.156668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-2fc1eb22-a484-47a7-8dd4-bc6de7c3c358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:52:46.164786 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1243/2492] 10.222.0.81 () {58 vars in 1016 bytes} [Tue Jul 19 20:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:52:46.193197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc1d35-d30a-4a3f-8b17-a033b2feb4f8 service nova] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:52:46.204245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc1d35-d30a-4a3f-8b17-a033b2feb4f8 service nova] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:52:46.209650 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5dc0d-a8b1-478d-822d-f5dc3e5736ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:52:46.210278 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5dc0d-a8b1-478d-822d-f5dc3e5736ca service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:46.210558 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5dc0d-a8b1-478d-822d-f5dc3e5736ca service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:46.210834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5dc0d-a8b1-478d-822d-f5dc3e5736ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:46.218862 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5dc0d-a8b1-478d-822d-f5dc3e5736ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:52:46.220465 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5dc0d-a8b1-478d-822d-f5dc3e5736ca service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:52:46.230444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1250/2493] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:52:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:52:49.295959 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46115fed-07a6-4ad5-b304-d1b0c9f8982c None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:49.296487 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46115fed-07a6-4ad5-b304-d1b0c9f8982c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:49.296594 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46115fed-07a6-4ad5-b304-d1b0c9f8982c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:49.314208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-46115fed-07a6-4ad5-b304-d1b0c9f8982c None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:52:49.315461 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-46115fed-07a6-4ad5-b304-d1b0c9f8982c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:52:49.323312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1244/2494] 10.222.0.81 () {58 vars in 1016 bytes} [Tue Jul 19 20:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:52:49.353622 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5dc0d-a8b1-478d-822d-f5dc3e5736ca service nova] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:52:49.365640 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5dc0d-a8b1-478d-822d-f5dc3e5736ca service nova] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:52:49.371197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fb76c-9c26-4fe5-923a-b68a5256bec5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:52:49.371869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fb76c-9c26-4fe5-923a-b68a5256bec5 service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:52:49.372398 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fb76c-9c26-4fe5-923a-b68a5256bec5 service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:52:49.372398 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fb76c-9c26-4fe5-923a-b68a5256bec5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:52:49.386023 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fb76c-9c26-4fe5-923a-b68a5256bec5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:52:49.387665 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616fb76c-9c26-4fe5-923a-b68a5256bec5 service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:52:49.398443 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1251/2495] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:52:59.309105 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=15 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:52:59.393277 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=30 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:53:04.766361 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0c940-3a1c-4166-bb96-02eb082a8b57 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:04.766892 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0c940-3a1c-4166-bb96-02eb082a8b57 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:04.766892 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0c940-3a1c-4166-bb96-02eb082a8b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:04.784499 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-03a0c940-3a1c-4166-bb96-02eb082a8b57 None None] MFA Rules not processed for user `c1a2b827eaad4e2784613fa4a54c2c44`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:53:04.785711 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-03a0c940-3a1c-4166-bb96-02eb082a8b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:53:04.840782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1245/2496] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:53:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:53:07.834186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc463e-6a4c-4697-ba77-c0bedf41826a None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:07.834634 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc463e-6a4c-4697-ba77-c0bedf41826a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:07.834719 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc463e-6a4c-4697-ba77-c0bedf41826a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:07.853218 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-34bc463e-6a4c-4697-ba77-c0bedf41826a None None] MFA Rules not processed for user `08f157a7adc348768aca9f7f48c6faf2`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:53:07.854419 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-34bc463e-6a4c-4697-ba77-c0bedf41826a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:53:07.861288 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1252/2497] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:53:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:53:14.833972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=25 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:53:16.755142 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0c940-3a1c-4166-bb96-02eb082a8b57 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:53:16.756502 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-03a0c940-3a1c-4166-bb96-02eb082a8b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:53:16.769272 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0c940-3a1c-4166-bb96-02eb082a8b57 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:53:16.773233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555b3e4-7233-4085-8874-c808cef022fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:53:16.773876 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555b3e4-7233-4085-8874-c808cef022fa service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:16.774157 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555b3e4-7233-4085-8874-c808cef022fa service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:16.774451 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555b3e4-7233-4085-8874-c808cef022fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:16.776214 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-5555b3e4-7233-4085-8874-c808cef022fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:53:16.790974 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555b3e4-7233-4085-8874-c808cef022fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:53:16.792436 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555b3e4-7233-4085-8874-c808cef022fa service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:53:16.804685 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1246/2498] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:53:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:53:17.848470 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:53:18.019981 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc463e-6a4c-4697-ba77-c0bedf41826a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:53:18.033726 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc463e-6a4c-4697-ba77-c0bedf41826a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:53:18.039138 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22834b2a-738b-4ef6-a42f-ee7786392108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:53:18.040654 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22834b2a-738b-4ef6-a42f-ee7786392108 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:18.041365 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22834b2a-738b-4ef6-a42f-ee7786392108 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:18.042034 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22834b2a-738b-4ef6-a42f-ee7786392108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:18.045557 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-22834b2a-738b-4ef6-a42f-ee7786392108 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:53:18.067576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22834b2a-738b-4ef6-a42f-ee7786392108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:53:18.069412 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22834b2a-738b-4ef6-a42f-ee7786392108 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:53:18.087812 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1253/2499] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:53:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:53:26.628840 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d48ff-f8d3-41b0-9591-64c0ccfefa5c None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:26.629647 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d48ff-f8d3-41b0-9591-64c0ccfefa5c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:26.629647 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d48ff-f8d3-41b0-9591-64c0ccfefa5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:26.651254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-fc3d48ff-f8d3-41b0-9591-64c0ccfefa5c None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:53:26.652577 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-fc3d48ff-f8d3-41b0-9591-64c0ccfefa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:53:26.662874 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1247/2500] 10.222.0.81 () {58 vars in 1016 bytes} [Tue Jul 19 20:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:53:26.687445 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22834b2a-738b-4ef6-a42f-ee7786392108 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:53:26.700208 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22834b2a-738b-4ef6-a42f-ee7786392108 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:53:26.706617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffe1ce-7a4f-421e-8029-ad88abaec244 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:53:26.707724 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffe1ce-7a4f-421e-8029-ad88abaec244 service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:26.707995 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffe1ce-7a4f-421e-8029-ad88abaec244 service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:26.708472 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffe1ce-7a4f-421e-8029-ad88abaec244 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:26.718554 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffe1ce-7a4f-421e-8029-ad88abaec244 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:53:26.720188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ffe1ce-7a4f-421e-8029-ad88abaec244 service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:53:26.735353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1254/2501] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:53:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:53:26.803758 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652f7e2-5245-4f34-9baa-ee00f0ca31be None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:26.804052 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652f7e2-5245-4f34-9baa-ee00f0ca31be None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:26.804378 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652f7e2-5245-4f34-9baa-ee00f0ca31be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:26.823379 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-7652f7e2-5245-4f34-9baa-ee00f0ca31be None None] MFA Rules not processed for user `4e8c2119269a4b79a880b4adf78c1dec`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:53:26.824612 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-7652f7e2-5245-4f34-9baa-ee00f0ca31be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:53:26.912640 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1248/2502] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:53:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:53:29.926241 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fa75d-d295-4cf4-a2d2-223b3f81bf98 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:29.926790 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fa75d-d295-4cf4-a2d2-223b3f81bf98 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:29.926921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fa75d-d295-4cf4-a2d2-223b3f81bf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:29.949334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-4f6fa75d-d295-4cf4-a2d2-223b3f81bf98 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:53:29.950682 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-4f6fa75d-d295-4cf4-a2d2-223b3f81bf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:53:29.961185 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1255/2503] 10.222.0.81 () {58 vars in 1016 bytes} [Tue Jul 19 20:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:53:29.982712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652f7e2-5245-4f34-9baa-ee00f0ca31be None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:53:29.996164 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652f7e2-5245-4f34-9baa-ee00f0ca31be None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:53:30.001706 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815c607-72f5-40f5-952f-7a666bccb83a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:53:30.002392 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815c607-72f5-40f5-952f-7a666bccb83a service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:30.002672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815c607-72f5-40f5-952f-7a666bccb83a service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:30.003497 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815c607-72f5-40f5-952f-7a666bccb83a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:30.012879 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815c607-72f5-40f5-952f-7a666bccb83a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:53:30.014481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815c607-72f5-40f5-952f-7a666bccb83a service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:53:30.026413 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1249/2504] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:53:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:53:34.038867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9c81c-bc5f-4e06-8d33-1b52f5a9ca1b None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:34.039482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9c81c-bc5f-4e06-8d33-1b52f5a9ca1b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:34.039924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9c81c-bc5f-4e06-8d33-1b52f5a9ca1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:34.058197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-86e9c81c-bc5f-4e06-8d33-1b52f5a9ca1b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:53:34.059471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-86e9c81c-bc5f-4e06-8d33-1b52f5a9ca1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:53:34.068154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1256/2505] 10.222.0.81 () {58 vars in 1016 bytes} [Tue Jul 19 20:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:53:34.093530 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815c607-72f5-40f5-952f-7a666bccb83a service nova] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:53:34.105572 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815c607-72f5-40f5-952f-7a666bccb83a service nova] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:53:34.111235 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16634f9c-d956-4cf4-bd24-2377135d6a34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:53:34.111903 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16634f9c-d956-4cf4-bd24-2377135d6a34 service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:34.112235 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16634f9c-d956-4cf4-bd24-2377135d6a34 service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:34.112508 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16634f9c-d956-4cf4-bd24-2377135d6a34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:34.121149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16634f9c-d956-4cf4-bd24-2377135d6a34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:53:34.122700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16634f9c-d956-4cf4-bd24-2377135d6a34 service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:53:34.132206 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1250/2506] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:53:35.587772 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9c81c-bc5f-4e06-8d33-1b52f5a9ca1b None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:53:35.600978 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9c81c-bc5f-4e06-8d33-1b52f5a9ca1b None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:53:35.606396 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753cecf-f97b-4547-8650-92a85e50b3cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:53:35.607045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753cecf-f97b-4547-8650-92a85e50b3cc service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:35.607357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753cecf-f97b-4547-8650-92a85e50b3cc service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:35.607634 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753cecf-f97b-4547-8650-92a85e50b3cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:35.609501 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e753cecf-f97b-4547-8650-92a85e50b3cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:53:35.620475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753cecf-f97b-4547-8650-92a85e50b3cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:53:35.622085 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e753cecf-f97b-4547-8650-92a85e50b3cc service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:53:35.631700 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1257/2507] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:53:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:53:39.269079 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0c62c-78ce-4673-92a1-aa78c8de99af None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:39.269654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0c62c-78ce-4673-92a1-aa78c8de99af None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:39.269758 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0c62c-78ce-4673-92a1-aa78c8de99af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:39.290417 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-28e0c62c-78ce-4673-92a1-aa78c8de99af None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:53:39.291678 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-28e0c62c-78ce-4673-92a1-aa78c8de99af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:53:39.301452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1251/2508] 10.222.0.81 () {58 vars in 1016 bytes} [Tue Jul 19 20:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:53:39.348388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753cecf-f97b-4547-8650-92a85e50b3cc service nova] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:53:39.362501 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753cecf-f97b-4547-8650-92a85e50b3cc service nova] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:53:39.368655 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928d10c-8883-4ec5-9b3d-95e3d11f7ff9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:53:39.369413 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928d10c-8883-4ec5-9b3d-95e3d11f7ff9 service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:39.369771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928d10c-8883-4ec5-9b3d-95e3d11f7ff9 service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:39.370123 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928d10c-8883-4ec5-9b3d-95e3d11f7ff9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:39.380010 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928d10c-8883-4ec5-9b3d-95e3d11f7ff9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:53:39.382114 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4928d10c-8883-4ec5-9b3d-95e3d11f7ff9 service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:53:39.425608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1258/2509] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:53:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:53:44.517359 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de930295-df89-4b89-913e-c31860e89167 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:44.517820 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de930295-df89-4b89-913e-c31860e89167 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:44.517928 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de930295-df89-4b89-913e-c31860e89167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:44.538424 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-de930295-df89-4b89-913e-c31860e89167 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:53:44.539621 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-de930295-df89-4b89-913e-c31860e89167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:53:44.547996 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1252/2510] 10.222.0.81 () {58 vars in 1016 bytes} [Tue Jul 19 20:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:53:44.581649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928d10c-8883-4ec5-9b3d-95e3d11f7ff9 service nova] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:53:44.593944 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928d10c-8883-4ec5-9b3d-95e3d11f7ff9 service nova] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:53:44.601895 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d1468-a375-4b62-9ff2-91b0fd7ed51d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:53:44.602725 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d1468-a375-4b62-9ff2-91b0fd7ed51d service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:44.603164 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d1468-a375-4b62-9ff2-91b0fd7ed51d service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:44.603712 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d1468-a375-4b62-9ff2-91b0fd7ed51d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:44.614044 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d1468-a375-4b62-9ff2-91b0fd7ed51d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:53:44.615672 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d1468-a375-4b62-9ff2-91b0fd7ed51d service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:53:44.625808 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1259/2511] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:53:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:53:46.280071 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba6680-3cd0-4929-869b-154c603fe267 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:46.280624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba6680-3cd0-4929-869b-154c603fe267 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:46.280624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ba6680-3cd0-4929-869b-154c603fe267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:46.286957 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=53 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:53:46.300615 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-99ba6680-3cd0-4929-869b-154c603fe267 None None] MFA Rules not processed for user `51a4587770ba48f480de96dfd5162bf3`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:53:46.301888 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-99ba6680-3cd0-4929-869b-154c603fe267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:53:46.363524 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1253/2512] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:53:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:53:46.699838 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d1468-a375-4b62-9ff2-91b0fd7ed51d service nova] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:53:46.709884 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d1468-a375-4b62-9ff2-91b0fd7ed51d service nova] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:53:46.714338 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ecb12-994e-4e1e-963a-dcf79f165ebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:53:46.715013 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ecb12-994e-4e1e-963a-dcf79f165ebe service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:46.715333 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ecb12-994e-4e1e-963a-dcf79f165ebe service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:46.715753 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ecb12-994e-4e1e-963a-dcf79f165ebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:46.717656 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b25ecb12-994e-4e1e-963a-dcf79f165ebe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:53:46.728639 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ecb12-994e-4e1e-963a-dcf79f165ebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:53:46.730279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25ecb12-994e-4e1e-963a-dcf79f165ebe service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:53:46.740092 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1260/2513] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:53:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:53:47.099205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba6680-3cd0-4929-869b-154c603fe267 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:53:47.100713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-99ba6680-3cd0-4929-869b-154c603fe267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:53:47.176651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ba6680-3cd0-4929-869b-154c603fe267 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:53:47.181675 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a0f66-ed19-4309-a984-55cc77e0fd2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04843ec31eb84585944c7a2b9cd1c0cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:53:47.182328 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a0f66-ed19-4309-a984-55cc77e0fd2e service placement] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:47.182613 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a0f66-ed19-4309-a984-55cc77e0fd2e service placement] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:47.182892 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a0f66-ed19-4309-a984-55cc77e0fd2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:47.184697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-ee5a0f66-ed19-4309-a984-55cc77e0fd2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:53:47.197291 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a0f66-ed19-4309-a984-55cc77e0fd2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:53:47.198798 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a0f66-ed19-4309-a984-55cc77e0fd2e service placement] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:53:47.211661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1254/2514] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:53:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:53:55.902690 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ecb12-994e-4e1e-963a-dcf79f165ebe service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:53:55.907060 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=43 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:53:55.912934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ecb12-994e-4e1e-963a-dcf79f165ebe service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:53:55.918243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b681d2-cc5b-48af-a0e3-fd42d5ccfd62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:53:55.918894 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b681d2-cc5b-48af-a0e3-fd42d5ccfd62 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:55.919178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b681d2-cc5b-48af-a0e3-fd42d5ccfd62 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:55.919495 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b681d2-cc5b-48af-a0e3-fd42d5ccfd62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:55.921322 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b7b681d2-cc5b-48af-a0e3-fd42d5ccfd62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:53:55.931192 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b681d2-cc5b-48af-a0e3-fd42d5ccfd62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:53:55.934279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b681d2-cc5b-48af-a0e3-fd42d5ccfd62 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:53:55.942931 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1261/2515] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:53:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:53:56.843075 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a0f66-ed19-4309-a984-55cc77e0fd2e service placement] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:53:56.879101 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a0f66-ed19-4309-a984-55cc77e0fd2e service placement] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:53:56.893925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f5e8d-76ac-47aa-86fe-bf9c8b409dba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:53:56.894689 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f5e8d-76ac-47aa-86fe-bf9c8b409dba service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:56.895064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f5e8d-76ac-47aa-86fe-bf9c8b409dba service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:56.895388 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f5e8d-76ac-47aa-86fe-bf9c8b409dba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:56.897895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-355f5e8d-76ac-47aa-86fe-bf9c8b409dba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:53:56.914308 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f5e8d-76ac-47aa-86fe-bf9c8b409dba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:53:56.916083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355f5e8d-76ac-47aa-86fe-bf9c8b409dba service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:53:56.928490 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1255/2516] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:53:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:53:57.051154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b681d2-cc5b-48af-a0e3-fd42d5ccfd62 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:53:57.066953 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b681d2-cc5b-48af-a0e3-fd42d5ccfd62 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:53:57.072895 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b85777-366f-419d-adcf-ed11c7012f4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:53:57.073566 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b85777-366f-419d-adcf-ed11c7012f4b service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:57.073856 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b85777-366f-419d-adcf-ed11c7012f4b service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:57.074138 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b85777-366f-419d-adcf-ed11c7012f4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:57.076168 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-f7b85777-366f-419d-adcf-ed11c7012f4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:53:57.091891 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b85777-366f-419d-adcf-ed11c7012f4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:53:57.093466 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b85777-366f-419d-adcf-ed11c7012f4b service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:53:57.105820 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1262/2517] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:53:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:53:57.911734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f5e8d-76ac-47aa-86fe-bf9c8b409dba service nova] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:53:57.913313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-355f5e8d-76ac-47aa-86fe-bf9c8b409dba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:53:57.925887 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f5e8d-76ac-47aa-86fe-bf9c8b409dba service nova] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:53:57.929697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ffc5f-7ccb-49e2-b3a4-29dff706c63b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:53:57.930407 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ffc5f-7ccb-49e2-b3a4-29dff706c63b service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:53:57.930849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ffc5f-7ccb-49e2-b3a4-29dff706c63b service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:53:57.931229 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ffc5f-7ccb-49e2-b3a4-29dff706c63b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:53:57.933143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-1a5ffc5f-7ccb-49e2-b3a4-29dff706c63b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:53:57.948141 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ffc5f-7ccb-49e2-b3a4-29dff706c63b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:53:57.950744 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ffc5f-7ccb-49e2-b3a4-29dff706c63b service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:53:57.963283 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1256/2518] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:53:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:54:07.100876 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=11 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:07.957573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=68 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:16.333143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b85777-366f-419d-adcf-ed11c7012f4b service nova] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:16.350423 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b85777-366f-419d-adcf-ed11c7012f4b service nova] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:16.360991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468745c-63e5-4e93-9919-505a8bba554e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:16.362366 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468745c-63e5-4e93-9919-505a8bba554e service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:16.362896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468745c-63e5-4e93-9919-505a8bba554e service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:16.364277 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468745c-63e5-4e93-9919-505a8bba554e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:16.373112 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b468745c-63e5-4e93-9919-505a8bba554e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:16.397379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468745c-63e5-4e93-9919-505a8bba554e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:16.400008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468745c-63e5-4e93-9919-505a8bba554e service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:16.427113 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1263/2519] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:54:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:54:16.821288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ffc5f-7ccb-49e2-b3a4-29dff706c63b service cinder] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:16.840803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ffc5f-7ccb-49e2-b3a4-29dff706c63b service cinder] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:16.846950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb7ac1-5b51-4ebe-9af8-6cf30f56dc9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04843ec31eb84585944c7a2b9cd1c0cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:16.847656 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb7ac1-5b51-4ebe-9af8-6cf30f56dc9a service placement] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:16.847944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb7ac1-5b51-4ebe-9af8-6cf30f56dc9a service placement] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:16.848220 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb7ac1-5b51-4ebe-9af8-6cf30f56dc9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:16.850231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b1bb7ac1-5b51-4ebe-9af8-6cf30f56dc9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:16.874608 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb7ac1-5b51-4ebe-9af8-6cf30f56dc9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:16.877401 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468745c-63e5-4e93-9919-505a8bba554e service nova] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:16.877551 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb7ac1-5b51-4ebe-9af8-6cf30f56dc9a service placement] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:16.901661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468745c-63e5-4e93-9919-505a8bba554e service nova] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:16.902997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1257/2520] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:54:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:54:16.907656 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69f836-6845-48a6-9b22-09e3b8ef1290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:16.908992 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69f836-6845-48a6-9b22-09e3b8ef1290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:16.909462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69f836-6845-48a6-9b22-09e3b8ef1290 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:16.909785 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69f836-6845-48a6-9b22-09e3b8ef1290 admin admin] PATH_INFO: `/v3/users/08f157a7adc348768aca9f7f48c6faf2` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:16.911087 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69f836-6845-48a6-9b22-09e3b8ef1290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08f157a7adc348768aca9f7f48c6faf2)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:16.913854 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69f836-6845-48a6-9b22-09e3b8ef1290 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:16.988901 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-da69f836-6845-48a6-9b22-09e3b8ef1290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08f157a7adc348768aca9f7f48c6faf2'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:17.011847 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-da69f836-6845-48a6-9b22-09e3b8ef1290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08f157a7adc348768aca9f7f48c6faf2'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:17.041939 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-da69f836-6845-48a6-9b22-09e3b8ef1290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08f157a7adc348768aca9f7f48c6faf2'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:17.059199 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-da69f836-6845-48a6-9b22-09e3b8ef1290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08f157a7adc348768aca9f7f48c6faf2'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:17.060083 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-da69f836-6845-48a6-9b22-09e3b8ef1290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08f157a7adc348768aca9f7f48c6faf2'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:17.085157 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1264/2521] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:54:16 2022] DELETE /identity/v3/users/08f157a7adc348768aca9f7f48c6faf2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:54:17.329183 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb7ac1-5b51-4ebe-9af8-6cf30f56dc9a service placement] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:17.345377 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb7ac1-5b51-4ebe-9af8-6cf30f56dc9a service placement] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:17.422006 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68092718-8294-4d49-9c54-34dffd56ccd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:17.423431 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68092718-8294-4d49-9c54-34dffd56ccd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:17.424557 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68092718-8294-4d49-9c54-34dffd56ccd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:17.424857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68092718-8294-4d49-9c54-34dffd56ccd9 admin admin] PATH_INFO: `/v3/projects/eeea735b0cee4ce88090d6f734226a18` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:17.426222 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68092718-8294-4d49-9c54-34dffd56ccd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeea735b0cee4ce88090d6f734226a18)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:17.428243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68092718-8294-4d49-9c54-34dffd56ccd9 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:17.494595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-68092718-8294-4d49-9c54-34dffd56ccd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeea735b0cee4ce88090d6f734226a18', 'request_id': 'req-68092718-8294-4d49-9c54-34dffd56ccd9'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:17.503420 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-68092718-8294-4d49-9c54-34dffd56ccd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeea735b0cee4ce88090d6f734226a18', 'request_id': 'req-68092718-8294-4d49-9c54-34dffd56ccd9'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:17.509602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-68092718-8294-4d49-9c54-34dffd56ccd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeea735b0cee4ce88090d6f734226a18', 'request_id': 'req-68092718-8294-4d49-9c54-34dffd56ccd9'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:17.522217 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-68092718-8294-4d49-9c54-34dffd56ccd9 admin admin] The token cache is being invalidate because project eeea735b0cee4ce88090d6f734226a18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:54:17.522509 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-68092718-8294-4d49-9c54-34dffd56ccd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:17.523174 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-68092718-8294-4d49-9c54-34dffd56ccd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:17.525110 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1258/2522] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:54:17 2022] DELETE /identity/v3/projects/eeea735b0cee4ce88090d6f734226a18 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:25.567774 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69f836-6845-48a6-9b22-09e3b8ef1290 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:25.569190 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-da69f836-6845-48a6-9b22-09e3b8ef1290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:25.626434 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69f836-6845-48a6-9b22-09e3b8ef1290 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:25.673104 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc030f0b-540b-4e99-9f4d-408800da62f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:25.674318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc030f0b-540b-4e99-9f4d-408800da62f8 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:25.674599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc030f0b-540b-4e99-9f4d-408800da62f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:25.674870 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc030f0b-540b-4e99-9f4d-408800da62f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:25.676697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-cc030f0b-540b-4e99-9f4d-408800da62f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:25.706433 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:25.743548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc030f0b-540b-4e99-9f4d-408800da62f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:25.745008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc030f0b-540b-4e99-9f4d-408800da62f8 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:25.755504 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1265/2523] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:54:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:54:27.517978 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:29.190333 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68092718-8294-4d49-9c54-34dffd56ccd9 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:29.192016 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-68092718-8294-4d49-9c54-34dffd56ccd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:29.210105 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68092718-8294-4d49-9c54-34dffd56ccd9 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:29.215910 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da5003-3676-4a1a-851c-26ec5d92c959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:29.216809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da5003-3676-4a1a-851c-26ec5d92c959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:29.217101 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da5003-3676-4a1a-851c-26ec5d92c959 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:29.217459 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da5003-3676-4a1a-851c-26ec5d92c959 admin admin] PATH_INFO: `/v3/users/c1a2b827eaad4e2784613fa4a54c2c44` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:29.218922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da5003-3676-4a1a-851c-26ec5d92c959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a2b827eaad4e2784613fa4a54c2c44)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:29.221486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da5003-3676-4a1a-851c-26ec5d92c959 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:29.272663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-13da5003-3676-4a1a-851c-26ec5d92c959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a2b827eaad4e2784613fa4a54c2c44'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:29.280940 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-13da5003-3676-4a1a-851c-26ec5d92c959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a2b827eaad4e2784613fa4a54c2c44'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:29.294449 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-13da5003-3676-4a1a-851c-26ec5d92c959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a2b827eaad4e2784613fa4a54c2c44'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:29.295237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-13da5003-3676-4a1a-851c-26ec5d92c959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a2b827eaad4e2784613fa4a54c2c44'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:29.304425 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-13da5003-3676-4a1a-851c-26ec5d92c959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a2b827eaad4e2784613fa4a54c2c44'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:29.310383 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1259/2524] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:54:29 2022] DELETE /identity/v3/users/c1a2b827eaad4e2784613fa4a54c2c44 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:29.498647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc030f0b-540b-4e99-9f4d-408800da62f8 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:29.509610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc030f0b-540b-4e99-9f4d-408800da62f8 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:29.568219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9fa0c-38d8-4405-8267-c380054fa11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:29.569169 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9fa0c-38d8-4405-8267-c380054fa11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:29.569411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9fa0c-38d8-4405-8267-c380054fa11c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:29.569671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9fa0c-38d8-4405-8267-c380054fa11c admin admin] PATH_INFO: `/v3/projects/5c7878d5f9ac4b5980671793626f4d0d` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:29.570984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9fa0c-38d8-4405-8267-c380054fa11c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7878d5f9ac4b5980671793626f4d0d)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:29.572933 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9fa0c-38d8-4405-8267-c380054fa11c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:29.617442 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-86b9fa0c-38d8-4405-8267-c380054fa11c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7878d5f9ac4b5980671793626f4d0d', 'request_id': 'req-86b9fa0c-38d8-4405-8267-c380054fa11c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:29.622657 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-86b9fa0c-38d8-4405-8267-c380054fa11c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7878d5f9ac4b5980671793626f4d0d', 'request_id': 'req-86b9fa0c-38d8-4405-8267-c380054fa11c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:29.630652 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-86b9fa0c-38d8-4405-8267-c380054fa11c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7878d5f9ac4b5980671793626f4d0d', 'request_id': 'req-86b9fa0c-38d8-4405-8267-c380054fa11c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:29.641668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-86b9fa0c-38d8-4405-8267-c380054fa11c admin admin] The token cache is being invalidate because project 5c7878d5f9ac4b5980671793626f4d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:54:29.641952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-86b9fa0c-38d8-4405-8267-c380054fa11c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:29.642592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-86b9fa0c-38d8-4405-8267-c380054fa11c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:29.644217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1266/2525] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:54:29 2022] DELETE /identity/v3/projects/5c7878d5f9ac4b5980671793626f4d0d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:54:29.655862 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef3adc-8bf1-45a9-811f-ee60293f6f5d None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:29.656154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef3adc-8bf1-45a9-811f-ee60293f6f5d None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:29.656431 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef3adc-8bf1-45a9-811f-ee60293f6f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:29.675246 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-45ef3adc-8bf1-45a9-811f-ee60293f6f5d None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:29.676495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-45ef3adc-8bf1-45a9-811f-ee60293f6f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:29.741294 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1260/2526] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:54:29.750097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c40c73-d8f8-4533-ad16-b241b80939a5 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:29.750384 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c40c73-d8f8-4533-ad16-b241b80939a5 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:29.750664 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c40c73-d8f8-4533-ad16-b241b80939a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:29.769692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-03c40c73-d8f8-4533-ad16-b241b80939a5 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:29.770845 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-03c40c73-d8f8-4533-ad16-b241b80939a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:29.779731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1267/2527] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:54:29.784243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef3adc-8bf1-45a9-811f-ee60293f6f5d None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:29.794946 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef3adc-8bf1-45a9-811f-ee60293f6f5d None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:29.800234 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb62fb6-e1c4-4c11-badb-19aa5aa26b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:29.800895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb62fb6-e1c4-4c11-badb-19aa5aa26b41 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:29.801181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb62fb6-e1c4-4c11-badb-19aa5aa26b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:29.801457 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb62fb6-e1c4-4c11-badb-19aa5aa26b41 admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:29.802190 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb62fb6-e1c4-4c11-badb-19aa5aa26b41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:54:29.802498 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb62fb6-e1c4-4c11-badb-19aa5aa26b41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:29.804117 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb62fb6-e1c4-4c11-badb-19aa5aa26b41 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:29.816388 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1261/2528] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:54:29.820858 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c40c73-d8f8-4533-ad16-b241b80939a5 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:29.830897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c40c73-d8f8-4533-ad16-b241b80939a5 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:29.835593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637d7f2-c05d-44ab-a011-d4ea533af76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:29.836240 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637d7f2-c05d-44ab-a011-d4ea533af76d admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:29.836520 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637d7f2-c05d-44ab-a011-d4ea533af76d admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:29.836792 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637d7f2-c05d-44ab-a011-d4ea533af76d admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:29.837487 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637d7f2-c05d-44ab-a011-d4ea533af76d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:29.839529 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637d7f2-c05d-44ab-a011-d4ea533af76d admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:29.866062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1268/2529] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:54:29 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:54:29.870108 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb62fb6-e1c4-4c11-badb-19aa5aa26b41 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:29.880461 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb62fb6-e1c4-4c11-badb-19aa5aa26b41 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:29.941149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733509c1-a19b-459b-b1a1-ca47265f7ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:29.941846 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733509c1-a19b-459b-b1a1-ca47265f7ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:29.942137 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733509c1-a19b-459b-b1a1-ca47265f7ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:29.942415 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733509c1-a19b-459b-b1a1-ca47265f7ad9 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:29.943117 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733509c1-a19b-459b-b1a1-ca47265f7ad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:29.945102 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733509c1-a19b-459b-b1a1-ca47265f7ad9 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:29.952043 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:29.970588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1262/2530] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:54:29 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:54:29.971770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637d7f2-c05d-44ab-a011-d4ea533af76d admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:29.982402 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637d7f2-c05d-44ab-a011-d4ea533af76d admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:29.987166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86320b-91ae-4be4-ab8c-475bd2eb6d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:29.987865 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86320b-91ae-4be4-ab8c-475bd2eb6d15 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:29.988149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86320b-91ae-4be4-ab8c-475bd2eb6d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:29.988424 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86320b-91ae-4be4-ab8c-475bd2eb6d15 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:29.989147 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86320b-91ae-4be4-ab8c-475bd2eb6d15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:29.990742 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86320b-91ae-4be4-ab8c-475bd2eb6d15 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:30.002509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1269/2531] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:54:30.006559 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733509c1-a19b-459b-b1a1-ca47265f7ad9 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:30.016892 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733509c1-a19b-459b-b1a1-ca47265f7ad9 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:30.023108 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b7fc2a-6977-4c5d-81c4-f027ede57ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:30.023804 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7fc2a-6977-4c5d-81c4-f027ede57ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:30.024089 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7fc2a-6977-4c5d-81c4-f027ede57ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:30.024364 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b7fc2a-6977-4c5d-81c4-f027ede57ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:30.025182 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7fc2a-6977-4c5d-81c4-f027ede57ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:30.026665 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b7fc2a-6977-4c5d-81c4-f027ede57ee7 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:30.037851 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1263/2532] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:54:30.042205 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86320b-91ae-4be4-ab8c-475bd2eb6d15 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:30.052264 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86320b-91ae-4be4-ab8c-475bd2eb6d15 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:30.057277 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3f4dd-f229-432a-bcde-88841d412979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:30.058206 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3f4dd-f229-432a-bcde-88841d412979 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:30.058513 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3f4dd-f229-432a-bcde-88841d412979 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:30.058791 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3f4dd-f229-432a-bcde-88841d412979 admin admin] PATH_INFO: `/v3/projects/61fb23bd79a440c5940736bf954a77b3/users/4dd7f3897ad54329ace3aecf0c9b4226/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:30.073024 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:30.076843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3f4dd-f229-432a-bcde-88841d412979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61fb23bd79a440c5940736bf954a77b3, user_id=4dd7f3897ad54329ace3aecf0c9b4226, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:30.079717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3f4dd-f229-432a-bcde-88841d412979 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:30.094948 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1270/2533] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:54:30 2022] PUT /identity/v3/projects/61fb23bd79a440c5940736bf954a77b3/users/4dd7f3897ad54329ace3aecf0c9b4226/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:30.105490 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dd816-59c1-40c7-9c23-32b3db893f9f None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:30.105843 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dd816-59c1-40c7-9c23-32b3db893f9f None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:30.106125 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dd816-59c1-40c7-9c23-32b3db893f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:30.134263 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-678dd816-59c1-40c7-9c23-32b3db893f9f None None] MFA Rules not processed for user `4dd7f3897ad54329ace3aecf0c9b4226`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:30.135501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-678dd816-59c1-40c7-9c23-32b3db893f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:30.212211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1264/2534] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:54:30.216774 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3f4dd-f229-432a-bcde-88841d412979 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:30.279041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3f4dd-f229-432a-bcde-88841d412979 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:30.284586 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17614495-4fe3-46a8-8763-5499ce10272b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:30.285244 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17614495-4fe3-46a8-8763-5499ce10272b admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:30.285523 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17614495-4fe3-46a8-8763-5499ce10272b admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:30.285798 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17614495-4fe3-46a8-8763-5499ce10272b admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:30.286480 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17614495-4fe3-46a8-8763-5499ce10272b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:30.288383 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17614495-4fe3-46a8-8763-5499ce10272b admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:30.314490 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1271/2535] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:54:30 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:54:30.318498 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dd816-59c1-40c7-9c23-32b3db893f9f None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:30.329513 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dd816-59c1-40c7-9c23-32b3db893f9f None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:30.387910 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121531c8-081d-453b-badb-896442e0ce7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:30.388506 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121531c8-081d-453b-badb-896442e0ce7c admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:30.388793 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121531c8-081d-453b-badb-896442e0ce7c admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:30.389076 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121531c8-081d-453b-badb-896442e0ce7c admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:30.389801 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121531c8-081d-453b-badb-896442e0ce7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:30.391764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121531c8-081d-453b-badb-896442e0ce7c admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:30.412786 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1265/2536] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:54:30 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:54:30.416915 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17614495-4fe3-46a8-8763-5499ce10272b admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:30.427515 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17614495-4fe3-46a8-8763-5499ce10272b admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:30.432649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87372b-e9ee-4654-a9dd-c1efcdade07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:30.433326 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87372b-e9ee-4654-a9dd-c1efcdade07b admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:30.433614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87372b-e9ee-4654-a9dd-c1efcdade07b admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:30.433904 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87372b-e9ee-4654-a9dd-c1efcdade07b admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:30.434636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87372b-e9ee-4654-a9dd-c1efcdade07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:30.436275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87372b-e9ee-4654-a9dd-c1efcdade07b admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:30.448698 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1272/2537] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:54:30.452903 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121531c8-081d-453b-badb-896442e0ce7c admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:30.464305 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121531c8-081d-453b-badb-896442e0ce7c admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:30.469019 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1d76f-eeb6-450e-ae47-b245cccc561f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:30.469724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1d76f-eeb6-450e-ae47-b245cccc561f admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:30.469993 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1d76f-eeb6-450e-ae47-b245cccc561f admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:30.470269 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1d76f-eeb6-450e-ae47-b245cccc561f admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:30.471643 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1d76f-eeb6-450e-ae47-b245cccc561f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:30.474072 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a1d76f-eeb6-450e-ae47-b245cccc561f admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:30.489277 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1266/2538] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:54:30.493564 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87372b-e9ee-4654-a9dd-c1efcdade07b admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:30.503908 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87372b-e9ee-4654-a9dd-c1efcdade07b admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:30.508577 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f801a7-793b-4bfd-a0a3-73e85e9e0a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:30.509459 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f801a7-793b-4bfd-a0a3-73e85e9e0a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:30.509734 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f801a7-793b-4bfd-a0a3-73e85e9e0a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:30.510003 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f801a7-793b-4bfd-a0a3-73e85e9e0a23 admin admin] PATH_INFO: `/v3/projects/72e13e90fc334ddbb51e7968e0f75957/users/16d77cf230114f15b89dd28ffa04723e/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:30.525524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f801a7-793b-4bfd-a0a3-73e85e9e0a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e13e90fc334ddbb51e7968e0f75957, user_id=16d77cf230114f15b89dd28ffa04723e, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:30.528332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f801a7-793b-4bfd-a0a3-73e85e9e0a23 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:30.542442 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1273/2539] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:54:30 2022] PUT /identity/v3/projects/72e13e90fc334ddbb51e7968e0f75957/users/16d77cf230114f15b89dd28ffa04723e/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:30.552706 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090c982-7840-4b64-8a7f-f2b23718e56b None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:30.553011 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090c982-7840-4b64-8a7f-f2b23718e56b None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:30.553266 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090c982-7840-4b64-8a7f-f2b23718e56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:30.585304 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-9090c982-7840-4b64-8a7f-f2b23718e56b None None] MFA Rules not processed for user `16d77cf230114f15b89dd28ffa04723e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:30.586557 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9090c982-7840-4b64-8a7f-f2b23718e56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:30.623092 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:30.660481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1267/2540] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:54:30.665050 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f801a7-793b-4bfd-a0a3-73e85e9e0a23 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:30.728296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f801a7-793b-4bfd-a0a3-73e85e9e0a23 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:30.732930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2194e-4992-4f49-9f55-63a0d18d152b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:30.733590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2194e-4992-4f49-9f55-63a0d18d152b admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:30.733870 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2194e-4992-4f49-9f55-63a0d18d152b admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:30.734141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2194e-4992-4f49-9f55-63a0d18d152b admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:30.734842 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2194e-4992-4f49-9f55-63a0d18d152b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:30.736804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2194e-4992-4f49-9f55-63a0d18d152b admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:30.762974 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1274/2541] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:54:30 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:54:30.767767 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090c982-7840-4b64-8a7f-f2b23718e56b None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:30.779464 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090c982-7840-4b64-8a7f-f2b23718e56b None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:30.846249 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7523b2-1af8-48d9-9252-3f843344f92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:30.846937 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7523b2-1af8-48d9-9252-3f843344f92b admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:30.847216 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7523b2-1af8-48d9-9252-3f843344f92b admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:30.847523 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7523b2-1af8-48d9-9252-3f843344f92b admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:30.848216 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7523b2-1af8-48d9-9252-3f843344f92b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:30.850134 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7523b2-1af8-48d9-9252-3f843344f92b admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:30.870261 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1268/2542] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:54:30 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:54:30.874303 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2194e-4992-4f49-9f55-63a0d18d152b admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:30.885581 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2194e-4992-4f49-9f55-63a0d18d152b admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:30.890624 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c119d27-feaa-4a71-9c8f-8035738f09df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:30.891320 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c119d27-feaa-4a71-9c8f-8035738f09df admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:30.891602 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c119d27-feaa-4a71-9c8f-8035738f09df admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:30.891878 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c119d27-feaa-4a71-9c8f-8035738f09df admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:30.893261 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c119d27-feaa-4a71-9c8f-8035738f09df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:30.894881 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c119d27-feaa-4a71-9c8f-8035738f09df admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:30.906008 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1275/2543] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:54:30.910600 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7523b2-1af8-48d9-9252-3f843344f92b admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:30.920709 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7523b2-1af8-48d9-9252-3f843344f92b admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:30.925471 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85494aeb-b1ea-4e77-95dc-2046909e84ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:30.926368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85494aeb-b1ea-4e77-95dc-2046909e84ff admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:30.926651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85494aeb-b1ea-4e77-95dc-2046909e84ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:30.926922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85494aeb-b1ea-4e77-95dc-2046909e84ff admin admin] PATH_INFO: `/v3/projects/b28a6a58a41a4d6e87d3702fc0e6d5b8/users/af92e39f877640e787cd9f5cece14009/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:30.943108 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85494aeb-b1ea-4e77-95dc-2046909e84ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28a6a58a41a4d6e87d3702fc0e6d5b8, user_id=af92e39f877640e787cd9f5cece14009, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:30.945792 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85494aeb-b1ea-4e77-95dc-2046909e84ff admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:30.958961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1269/2544] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:54:30 2022] PUT /identity/v3/projects/b28a6a58a41a4d6e87d3702fc0e6d5b8/users/af92e39f877640e787cd9f5cece14009/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:54:30.962953 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c119d27-feaa-4a71-9c8f-8035738f09df admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:30.973227 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c119d27-feaa-4a71-9c8f-8035738f09df admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:30.984982 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:31.031057 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652d510-3db9-4c64-b2f1-123052a87e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:31.031781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652d510-3db9-4c64-b2f1-123052a87e33 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:31.032066 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652d510-3db9-4c64-b2f1-123052a87e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:31.032345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652d510-3db9-4c64-b2f1-123052a87e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:31.033364 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652d510-3db9-4c64-b2f1-123052a87e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:31.035028 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652d510-3db9-4c64-b2f1-123052a87e33 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:31.045586 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1276/2545] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:54:31.050648 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85494aeb-b1ea-4e77-95dc-2046909e84ff admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:31.061130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85494aeb-b1ea-4e77-95dc-2046909e84ff admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:31.066511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f676e06-d9e0-4f9c-a4f0-2ef1b230ea46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:31.067443 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f676e06-d9e0-4f9c-a4f0-2ef1b230ea46 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:31.067727 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f676e06-d9e0-4f9c-a4f0-2ef1b230ea46 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:31.068004 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f676e06-d9e0-4f9c-a4f0-2ef1b230ea46 admin admin] PATH_INFO: `/v3/projects/b28a6a58a41a4d6e87d3702fc0e6d5b8/users/af92e39f877640e787cd9f5cece14009/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:31.069994 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f676e06-d9e0-4f9c-a4f0-2ef1b230ea46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28a6a58a41a4d6e87d3702fc0e6d5b8, user_id=af92e39f877640e787cd9f5cece14009, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:31.072695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f676e06-d9e0-4f9c-a4f0-2ef1b230ea46 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:31.083677 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1270/2546] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:54:31 2022] PUT /identity/v3/projects/b28a6a58a41a4d6e87d3702fc0e6d5b8/users/af92e39f877640e787cd9f5cece14009/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:31.095056 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15daf10-d69c-4f71-8470-c04eb591b259 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:31.095429 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15daf10-d69c-4f71-8470-c04eb591b259 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:31.095712 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15daf10-d69c-4f71-8470-c04eb591b259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:31.122814 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-b15daf10-d69c-4f71-8470-c04eb591b259 None None] MFA Rules not processed for user `af92e39f877640e787cd9f5cece14009`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:31.124088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b15daf10-d69c-4f71-8470-c04eb591b259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:31.193797 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1277/2547] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:54:31.205038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f676e06-d9e0-4f9c-a4f0-2ef1b230ea46 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:31.206726 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-5f676e06-d9e0-4f9c-a4f0-2ef1b230ea46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:31.266397 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f676e06-d9e0-4f9c-a4f0-2ef1b230ea46 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:31.270159 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01158ae7-f4b8-4b67-9ebd-cf24dff7b550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:31.270809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01158ae7-f4b8-4b67-9ebd-cf24dff7b550 service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:31.271093 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01158ae7-f4b8-4b67-9ebd-cf24dff7b550 service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:31.271400 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01158ae7-f4b8-4b67-9ebd-cf24dff7b550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:31.313672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:31.330333 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01158ae7-f4b8-4b67-9ebd-cf24dff7b550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:31.331793 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01158ae7-f4b8-4b67-9ebd-cf24dff7b550 service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:31.340728 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1271/2548] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:54:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:54:32.847243 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15daf10-d69c-4f71-8470-c04eb591b259 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:32.848786 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b15daf10-d69c-4f71-8470-c04eb591b259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:32.862220 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15daf10-d69c-4f71-8470-c04eb591b259 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:32.866361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcf1b7-7543-4d56-a442-474d402f7530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:32.867160 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcf1b7-7543-4d56-a442-474d402f7530 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:32.867478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcf1b7-7543-4d56-a442-474d402f7530 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:32.867869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcf1b7-7543-4d56-a442-474d402f7530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:32.933551 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bcf1b7-7543-4d56-a442-474d402f7530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:32.934894 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bcf1b7-7543-4d56-a442-474d402f7530 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:32.944547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1278/2549] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:54:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:54:33.574190 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01158ae7-f4b8-4b67-9ebd-cf24dff7b550 service cinder] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:33.583877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01158ae7-f4b8-4b67-9ebd-cf24dff7b550 service cinder] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:33.594609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfe36e-d6da-43e3-978d-f88df711dcb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:33.595902 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfe36e-d6da-43e3-978d-f88df711dcb2 service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:33.596187 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfe36e-d6da-43e3-978d-f88df711dcb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:33.596460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfe36e-d6da-43e3-978d-f88df711dcb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:33.606515 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfe36e-d6da-43e3-978d-f88df711dcb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:33.607968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfe36e-d6da-43e3-978d-f88df711dcb2 service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:33.617946 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1272/2550] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:54:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:54:37.677856 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcf1b7-7543-4d56-a442-474d402f7530 service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:37.731549 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:37.757925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcf1b7-7543-4d56-a442-474d402f7530 service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:37.766882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db187c-ac75-40aa-97d1-c6671a87b306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:37.769658 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db187c-ac75-40aa-97d1-c6671a87b306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:37.770033 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db187c-ac75-40aa-97d1-c6671a87b306 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:37.770611 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db187c-ac75-40aa-97d1-c6671a87b306 admin admin] PATH_INFO: `/v3/users/4dd7f3897ad54329ace3aecf0c9b4226` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:37.773031 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db187c-ac75-40aa-97d1-c6671a87b306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd7f3897ad54329ace3aecf0c9b4226)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:37.777221 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12db187c-ac75-40aa-97d1-c6671a87b306 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:37.848684 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-12db187c-ac75-40aa-97d1-c6671a87b306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd7f3897ad54329ace3aecf0c9b4226'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:37.862265 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-12db187c-ac75-40aa-97d1-c6671a87b306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd7f3897ad54329ace3aecf0c9b4226'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:37.884568 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-12db187c-ac75-40aa-97d1-c6671a87b306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd7f3897ad54329ace3aecf0c9b4226'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:37.899940 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-12db187c-ac75-40aa-97d1-c6671a87b306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd7f3897ad54329ace3aecf0c9b4226'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:37.901111 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-12db187c-ac75-40aa-97d1-c6671a87b306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd7f3897ad54329ace3aecf0c9b4226'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:37.909693 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1279/2551] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:54:37 2022] DELETE /identity/v3/users/4dd7f3897ad54329ace3aecf0c9b4226 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:54:37.914782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef0474-968e-4486-a88c-adfcc9afbb56 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:37.915630 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef0474-968e-4486-a88c-adfcc9afbb56 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:37.915630 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef0474-968e-4486-a88c-adfcc9afbb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:37.936062 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-c5ef0474-968e-4486-a88c-adfcc9afbb56 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:37.937345 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-c5ef0474-968e-4486-a88c-adfcc9afbb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:38.031864 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1273/2552] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:54:38.043750 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db187c-ac75-40aa-97d1-c6671a87b306 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:38.045427 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-12db187c-ac75-40aa-97d1-c6671a87b306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:38.112581 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12db187c-ac75-40aa-97d1-c6671a87b306 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:38.116573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52383854-5cb4-4479-ae92-90fa885db841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:38.117242 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52383854-5cb4-4479-ae92-90fa885db841 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:38.117529 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52383854-5cb4-4479-ae92-90fa885db841 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:38.117807 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52383854-5cb4-4479-ae92-90fa885db841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:38.128902 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52383854-5cb4-4479-ae92-90fa885db841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:38.130414 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52383854-5cb4-4479-ae92-90fa885db841 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:38.141326 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1280/2553] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:54:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:54:38.564553 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef0474-968e-4486-a88c-adfcc9afbb56 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:38.566911 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-c5ef0474-968e-4486-a88c-adfcc9afbb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:38.584859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef0474-968e-4486-a88c-adfcc9afbb56 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:38.602992 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298c990-ba73-4bb7-b415-a00872b1f124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:38.603858 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298c990-ba73-4bb7-b415-a00872b1f124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:38.604140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298c990-ba73-4bb7-b415-a00872b1f124 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:38.604614 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298c990-ba73-4bb7-b415-a00872b1f124 admin admin] PATH_INFO: `/v3/projects/61fb23bd79a440c5940736bf954a77b3` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:38.605859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298c990-ba73-4bb7-b415-a00872b1f124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61fb23bd79a440c5940736bf954a77b3)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:38.607823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9298c990-ba73-4bb7-b415-a00872b1f124 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:38.674424 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9298c990-ba73-4bb7-b415-a00872b1f124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61fb23bd79a440c5940736bf954a77b3', 'request_id': 'req-9298c990-ba73-4bb7-b415-a00872b1f124'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:38.684063 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9298c990-ba73-4bb7-b415-a00872b1f124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61fb23bd79a440c5940736bf954a77b3', 'request_id': 'req-9298c990-ba73-4bb7-b415-a00872b1f124'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:38.692632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9298c990-ba73-4bb7-b415-a00872b1f124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61fb23bd79a440c5940736bf954a77b3', 'request_id': 'req-9298c990-ba73-4bb7-b415-a00872b1f124'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:38.708225 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9298c990-ba73-4bb7-b415-a00872b1f124 admin admin] The token cache is being invalidate because project 61fb23bd79a440c5940736bf954a77b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:54:38.708625 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9298c990-ba73-4bb7-b415-a00872b1f124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:38.709324 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9298c990-ba73-4bb7-b415-a00872b1f124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:38.710934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1274/2554] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:54:38 2022] DELETE /identity/v3/projects/61fb23bd79a440c5940736bf954a77b3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:38.715065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52383854-5cb4-4479-ae92-90fa885db841 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:38.725717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52383854-5cb4-4479-ae92-90fa885db841 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:38.785830 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:38.793031 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a59164-4787-4653-918e-6175a151df56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:38.794225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a59164-4787-4653-918e-6175a151df56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:38.794791 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a59164-4787-4653-918e-6175a151df56 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:38.795128 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a59164-4787-4653-918e-6175a151df56 admin admin] PATH_INFO: `/v3/users/16d77cf230114f15b89dd28ffa04723e` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:38.796656 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a59164-4787-4653-918e-6175a151df56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16d77cf230114f15b89dd28ffa04723e)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:38.799882 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a59164-4787-4653-918e-6175a151df56 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:38.853516 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-d2a59164-4787-4653-918e-6175a151df56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16d77cf230114f15b89dd28ffa04723e'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:38.861255 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-d2a59164-4787-4653-918e-6175a151df56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16d77cf230114f15b89dd28ffa04723e'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:38.875343 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-d2a59164-4787-4653-918e-6175a151df56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16d77cf230114f15b89dd28ffa04723e'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:38.884199 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-d2a59164-4787-4653-918e-6175a151df56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16d77cf230114f15b89dd28ffa04723e'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:38.884933 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-d2a59164-4787-4653-918e-6175a151df56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16d77cf230114f15b89dd28ffa04723e'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:38.891910 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1281/2555] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:54:38 2022] DELETE /identity/v3/users/16d77cf230114f15b89dd28ffa04723e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:39.186144 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298c990-ba73-4bb7-b415-a00872b1f124 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:39.187806 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9298c990-ba73-4bb7-b415-a00872b1f124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:39.203063 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298c990-ba73-4bb7-b415-a00872b1f124 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:39.259847 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:39.271238 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42914382-75ab-4d00-a967-f70f886b8908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:39.272298 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42914382-75ab-4d00-a967-f70f886b8908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:39.272581 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42914382-75ab-4d00-a967-f70f886b8908 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:39.272855 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42914382-75ab-4d00-a967-f70f886b8908 admin admin] PATH_INFO: `/v3/projects/72e13e90fc334ddbb51e7968e0f75957` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:39.274047 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42914382-75ab-4d00-a967-f70f886b8908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72e13e90fc334ddbb51e7968e0f75957)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:39.276017 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42914382-75ab-4d00-a967-f70f886b8908 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:39.324606 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-42914382-75ab-4d00-a967-f70f886b8908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e13e90fc334ddbb51e7968e0f75957', 'request_id': 'req-42914382-75ab-4d00-a967-f70f886b8908'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:39.332789 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-42914382-75ab-4d00-a967-f70f886b8908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e13e90fc334ddbb51e7968e0f75957', 'request_id': 'req-42914382-75ab-4d00-a967-f70f886b8908'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:39.338800 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-42914382-75ab-4d00-a967-f70f886b8908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e13e90fc334ddbb51e7968e0f75957', 'request_id': 'req-42914382-75ab-4d00-a967-f70f886b8908'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:39.350666 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-42914382-75ab-4d00-a967-f70f886b8908 admin admin] The token cache is being invalidate because project 72e13e90fc334ddbb51e7968e0f75957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:54:39.350956 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-42914382-75ab-4d00-a967-f70f886b8908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:39.351651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-42914382-75ab-4d00-a967-f70f886b8908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:39.353226 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1275/2556] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:54:39 2022] DELETE /identity/v3/projects/72e13e90fc334ddbb51e7968e0f75957 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:39.357555 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a59164-4787-4653-918e-6175a151df56 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:39.358955 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d2a59164-4787-4653-918e-6175a151df56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:39.371932 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a59164-4787-4653-918e-6175a151df56 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:39.436164 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27087112-a55c-43b8-b11d-f4c074bc5c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:39.436949 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27087112-a55c-43b8-b11d-f4c074bc5c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:39.437234 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27087112-a55c-43b8-b11d-f4c074bc5c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:39.437516 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27087112-a55c-43b8-b11d-f4c074bc5c30 admin admin] PATH_INFO: `/v3/users/af92e39f877640e787cd9f5cece14009` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:39.438748 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27087112-a55c-43b8-b11d-f4c074bc5c30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af92e39f877640e787cd9f5cece14009)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:39.440702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27087112-a55c-43b8-b11d-f4c074bc5c30 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:39.489166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-27087112-a55c-43b8-b11d-f4c074bc5c30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af92e39f877640e787cd9f5cece14009'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:39.496203 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-27087112-a55c-43b8-b11d-f4c074bc5c30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af92e39f877640e787cd9f5cece14009'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:39.508744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-27087112-a55c-43b8-b11d-f4c074bc5c30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af92e39f877640e787cd9f5cece14009'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:39.512422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:39.517097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-27087112-a55c-43b8-b11d-f4c074bc5c30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af92e39f877640e787cd9f5cece14009'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:39.517969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-27087112-a55c-43b8-b11d-f4c074bc5c30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af92e39f877640e787cd9f5cece14009'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:39.525482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1282/2557] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:54:39 2022] DELETE /identity/v3/users/af92e39f877640e787cd9f5cece14009 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:39.813251 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42914382-75ab-4d00-a967-f70f886b8908 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:39.815369 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-42914382-75ab-4d00-a967-f70f886b8908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:39.828450 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42914382-75ab-4d00-a967-f70f886b8908 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:39.898367 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf71696-205a-47d4-89aa-dd0481876f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:39.898367 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf71696-205a-47d4-89aa-dd0481876f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:39.898367 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf71696-205a-47d4-89aa-dd0481876f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:39.898367 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf71696-205a-47d4-89aa-dd0481876f91 admin admin] PATH_INFO: `/v3/projects/b28a6a58a41a4d6e87d3702fc0e6d5b8` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:39.898852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf71696-205a-47d4-89aa-dd0481876f91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28a6a58a41a4d6e87d3702fc0e6d5b8)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:39.900411 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf71696-205a-47d4-89aa-dd0481876f91 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:39.960165 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-3bf71696-205a-47d4-89aa-dd0481876f91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28a6a58a41a4d6e87d3702fc0e6d5b8', 'request_id': 'req-3bf71696-205a-47d4-89aa-dd0481876f91'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:39.968203 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-3bf71696-205a-47d4-89aa-dd0481876f91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28a6a58a41a4d6e87d3702fc0e6d5b8', 'request_id': 'req-3bf71696-205a-47d4-89aa-dd0481876f91'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:39.974566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-3bf71696-205a-47d4-89aa-dd0481876f91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28a6a58a41a4d6e87d3702fc0e6d5b8', 'request_id': 'req-3bf71696-205a-47d4-89aa-dd0481876f91'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:39.986707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-3bf71696-205a-47d4-89aa-dd0481876f91 admin admin] The token cache is being invalidate because project b28a6a58a41a4d6e87d3702fc0e6d5b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:54:39.986996 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-3bf71696-205a-47d4-89aa-dd0481876f91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:39.987830 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-3bf71696-205a-47d4-89aa-dd0481876f91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:39.989680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1276/2558] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:54:39 2022] DELETE /identity/v3/projects/b28a6a58a41a4d6e87d3702fc0e6d5b8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:39.995397 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ede70-03ef-49fe-bf6a-b09817785716 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:39.995879 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ede70-03ef-49fe-bf6a-b09817785716 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:39.996007 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ede70-03ef-49fe-bf6a-b09817785716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:40.015082 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-652ede70-03ef-49fe-bf6a-b09817785716 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:40.016309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-652ede70-03ef-49fe-bf6a-b09817785716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:40.092453 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1283/2559] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:54:40.100930 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499366b8-cafa-4bdf-869e-a762b97b5d5c None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:40.101457 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499366b8-cafa-4bdf-869e-a762b97b5d5c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:40.101998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499366b8-cafa-4bdf-869e-a762b97b5d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:40.124123 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-499366b8-cafa-4bdf-869e-a762b97b5d5c None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:40.125366 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-499366b8-cafa-4bdf-869e-a762b97b5d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:40.137559 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1277/2560] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:54:40.141647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ede70-03ef-49fe-bf6a-b09817785716 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:40.156038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ede70-03ef-49fe-bf6a-b09817785716 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:40.161158 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc5b00-120b-4405-af37-204de4b1f8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:40.161831 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc5b00-120b-4405-af37-204de4b1f8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:40.162116 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc5b00-120b-4405-af37-204de4b1f8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:40.162394 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc5b00-120b-4405-af37-204de4b1f8f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:40.163127 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc5b00-120b-4405-af37-204de4b1f8f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:54:40.163471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc5b00-120b-4405-af37-204de4b1f8f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:40.165320 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc5b00-120b-4405-af37-204de4b1f8f4 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:40.178263 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1284/2561] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:54:40.182693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499366b8-cafa-4bdf-869e-a762b97b5d5c None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:40.192720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499366b8-cafa-4bdf-869e-a762b97b5d5c None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:40.197693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a06800-acfd-4992-8fe1-febb99b0212b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:40.198360 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a06800-acfd-4992-8fe1-febb99b0212b admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:40.198646 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a06800-acfd-4992-8fe1-febb99b0212b admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:40.198924 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a06800-acfd-4992-8fe1-febb99b0212b admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:40.199671 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a06800-acfd-4992-8fe1-febb99b0212b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:40.201600 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a06800-acfd-4992-8fe1-febb99b0212b admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:40.205336 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:40.231326 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1278/2562] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:54:40 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:54:40.236830 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc5b00-120b-4405-af37-204de4b1f8f4 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:40.247521 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc5b00-120b-4405-af37-204de4b1f8f4 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:40.308527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936cf63-2d4c-4fec-9d6f-e7e00b491f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:40.309286 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936cf63-2d4c-4fec-9d6f-e7e00b491f69 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:40.309554 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936cf63-2d4c-4fec-9d6f-e7e00b491f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:40.309867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936cf63-2d4c-4fec-9d6f-e7e00b491f69 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:40.310563 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936cf63-2d4c-4fec-9d6f-e7e00b491f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:40.312517 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936cf63-2d4c-4fec-9d6f-e7e00b491f69 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:40.334345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1285/2563] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:54:40 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:54:40.339170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a06800-acfd-4992-8fe1-febb99b0212b admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:40.351228 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a06800-acfd-4992-8fe1-febb99b0212b admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:40.356103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023c7c7-747a-42c0-89a8-1594841dfa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:40.356778 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023c7c7-747a-42c0-89a8-1594841dfa38 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:40.357059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023c7c7-747a-42c0-89a8-1594841dfa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:40.357331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023c7c7-747a-42c0-89a8-1594841dfa38 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:40.358094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023c7c7-747a-42c0-89a8-1594841dfa38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:40.359722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023c7c7-747a-42c0-89a8-1594841dfa38 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:40.371137 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1279/2564] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:54:40.376452 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936cf63-2d4c-4fec-9d6f-e7e00b491f69 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:40.386495 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936cf63-2d4c-4fec-9d6f-e7e00b491f69 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:40.391328 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3de26-842d-49a1-8c18-2f1cb0dcb561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:40.392040 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3de26-842d-49a1-8c18-2f1cb0dcb561 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:40.392322 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3de26-842d-49a1-8c18-2f1cb0dcb561 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:40.392595 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3de26-842d-49a1-8c18-2f1cb0dcb561 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:40.393322 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3de26-842d-49a1-8c18-2f1cb0dcb561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:40.395153 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3de26-842d-49a1-8c18-2f1cb0dcb561 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:40.407009 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1286/2565] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:54:40.412337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023c7c7-747a-42c0-89a8-1594841dfa38 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:40.424104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023c7c7-747a-42c0-89a8-1594841dfa38 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:40.428811 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386c28a-f6bd-450a-8e0e-32d59d6394e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:40.429710 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386c28a-f6bd-450a-8e0e-32d59d6394e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:40.429992 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386c28a-f6bd-450a-8e0e-32d59d6394e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:40.430265 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386c28a-f6bd-450a-8e0e-32d59d6394e0 admin admin] PATH_INFO: `/v3/projects/79e4769619094defb903175e1ec208c0/users/ab0064300d08447c9afec525d5102ab7/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:40.447531 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386c28a-f6bd-450a-8e0e-32d59d6394e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e4769619094defb903175e1ec208c0, user_id=ab0064300d08447c9afec525d5102ab7, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:40.450306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386c28a-f6bd-450a-8e0e-32d59d6394e0 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:40.464270 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1280/2566] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:54:40 2022] PUT /identity/v3/projects/79e4769619094defb903175e1ec208c0/users/ab0064300d08447c9afec525d5102ab7/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:40.474993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5c294-6d5b-4def-a32f-6ed00ac12a32 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:40.475323 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5c294-6d5b-4def-a32f-6ed00ac12a32 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:40.475632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5c294-6d5b-4def-a32f-6ed00ac12a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:40.503514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-11f5c294-6d5b-4def-a32f-6ed00ac12a32 None None] MFA Rules not processed for user `ab0064300d08447c9afec525d5102ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:40.504750 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-11f5c294-6d5b-4def-a32f-6ed00ac12a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:40.557251 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:40.576489 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1287/2567] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:54:40.581035 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386c28a-f6bd-450a-8e0e-32d59d6394e0 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:40.643181 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386c28a-f6bd-450a-8e0e-32d59d6394e0 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:40.647846 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf766d-f1a4-4386-8a17-418b17da9f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:40.648510 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf766d-f1a4-4386-8a17-418b17da9f92 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:40.648791 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf766d-f1a4-4386-8a17-418b17da9f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:40.649065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf766d-f1a4-4386-8a17-418b17da9f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:40.649925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf766d-f1a4-4386-8a17-418b17da9f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:40.651853 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf766d-f1a4-4386-8a17-418b17da9f92 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:40.679038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1281/2568] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:54:40 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:54:40.684071 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5c294-6d5b-4def-a32f-6ed00ac12a32 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:40.696193 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5c294-6d5b-4def-a32f-6ed00ac12a32 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:40.754813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d24df9-92e2-4bc5-bfb6-5aee5a3593a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:40.755514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d24df9-92e2-4bc5-bfb6-5aee5a3593a3 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:40.755794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d24df9-92e2-4bc5-bfb6-5aee5a3593a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:40.756064 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d24df9-92e2-4bc5-bfb6-5aee5a3593a3 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:40.756766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d24df9-92e2-4bc5-bfb6-5aee5a3593a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:40.758741 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d24df9-92e2-4bc5-bfb6-5aee5a3593a3 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:40.782415 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1288/2569] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:54:40 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:54:40.787368 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf766d-f1a4-4386-8a17-418b17da9f92 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:40.798320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf766d-f1a4-4386-8a17-418b17da9f92 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:40.803176 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69122a-96ba-4e58-affb-c4c62e4427cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:40.803889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69122a-96ba-4e58-affb-c4c62e4427cf admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:40.804183 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69122a-96ba-4e58-affb-c4c62e4427cf admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:40.804465 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69122a-96ba-4e58-affb-c4c62e4427cf admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:40.805202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69122a-96ba-4e58-affb-c4c62e4427cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:40.806851 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69122a-96ba-4e58-affb-c4c62e4427cf admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:40.821727 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1282/2570] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:54:40.825730 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d24df9-92e2-4bc5-bfb6-5aee5a3593a3 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:40.837022 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d24df9-92e2-4bc5-bfb6-5aee5a3593a3 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:40.842045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecda512-c241-4b8b-8ab2-8d132b7b5c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:40.842733 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecda512-c241-4b8b-8ab2-8d132b7b5c72 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:40.843023 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecda512-c241-4b8b-8ab2-8d132b7b5c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:40.843333 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecda512-c241-4b8b-8ab2-8d132b7b5c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:40.844166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecda512-c241-4b8b-8ab2-8d132b7b5c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:40.846537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecda512-c241-4b8b-8ab2-8d132b7b5c72 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:40.858519 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1289/2571] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:54:40.862893 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69122a-96ba-4e58-affb-c4c62e4427cf admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:40.874067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69122a-96ba-4e58-affb-c4c62e4427cf admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:40.880056 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e246f-f2b7-4866-ad4b-e2fb758d34d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:40.881613 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e246f-f2b7-4866-ad4b-e2fb758d34d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:40.882129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e246f-f2b7-4866-ad4b-e2fb758d34d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:40.882632 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e246f-f2b7-4866-ad4b-e2fb758d34d7 admin admin] PATH_INFO: `/v3/projects/58f6e6ff87a24b1c89395ffc0924fdbe/users/0a6f72ba37e24aa0a928ce1270f389cd/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:40.908629 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e246f-f2b7-4866-ad4b-e2fb758d34d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f6e6ff87a24b1c89395ffc0924fdbe, user_id=0a6f72ba37e24aa0a928ce1270f389cd, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:40.911242 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e246f-f2b7-4866-ad4b-e2fb758d34d7 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:40.926216 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1283/2572] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:54:40 2022] PUT /identity/v3/projects/58f6e6ff87a24b1c89395ffc0924fdbe/users/0a6f72ba37e24aa0a928ce1270f389cd/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:40.937611 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72544aae-cf46-4b3c-ae94-fb5f5373734b None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:40.937899 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72544aae-cf46-4b3c-ae94-fb5f5373734b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:40.938212 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72544aae-cf46-4b3c-ae94-fb5f5373734b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:40.967909 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-72544aae-cf46-4b3c-ae94-fb5f5373734b None None] MFA Rules not processed for user `0a6f72ba37e24aa0a928ce1270f389cd`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:40.969181 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-72544aae-cf46-4b3c-ae94-fb5f5373734b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:41.036537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1290/2573] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:54:41.040990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e246f-f2b7-4866-ad4b-e2fb758d34d7 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:41.116624 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e246f-f2b7-4866-ad4b-e2fb758d34d7 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:41.121772 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f72a7-ab33-4e78-8276-783dced52fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:41.122997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f72a7-ab33-4e78-8276-783dced52fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:41.123302 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f72a7-ab33-4e78-8276-783dced52fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:41.123588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f72a7-ab33-4e78-8276-783dced52fc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:41.124327 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f72a7-ab33-4e78-8276-783dced52fc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:41.126823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f72a7-ab33-4e78-8276-783dced52fc1 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:41.130545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:41.163729 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1284/2574] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:54:41 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:54:41.164877 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72544aae-cf46-4b3c-ae94-fb5f5373734b None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:41.177085 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72544aae-cf46-4b3c-ae94-fb5f5373734b None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:41.245425 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1116676-a291-4bbf-bb90-50a235406698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:41.245425 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1116676-a291-4bbf-bb90-50a235406698 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:41.247048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1116676-a291-4bbf-bb90-50a235406698 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:41.247048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1116676-a291-4bbf-bb90-50a235406698 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:41.247048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1116676-a291-4bbf-bb90-50a235406698 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:41.248772 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1116676-a291-4bbf-bb90-50a235406698 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:41.256689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:41.277395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1291/2575] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:54:41 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:54:41.283628 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f72a7-ab33-4e78-8276-783dced52fc1 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:41.297555 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f72a7-ab33-4e78-8276-783dced52fc1 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:41.303427 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f7ab5-2760-4a30-9bde-49b57e834bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:41.304111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f7ab5-2760-4a30-9bde-49b57e834bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:41.304399 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f7ab5-2760-4a30-9bde-49b57e834bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:41.304683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f7ab5-2760-4a30-9bde-49b57e834bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:41.305426 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f7ab5-2760-4a30-9bde-49b57e834bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:41.307033 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f7ab5-2760-4a30-9bde-49b57e834bd9 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:41.319146 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1285/2576] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:54:41.323543 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1116676-a291-4bbf-bb90-50a235406698 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:41.334130 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1116676-a291-4bbf-bb90-50a235406698 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:41.339347 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8672221-34b1-425d-b17b-27f275896cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:41.340254 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8672221-34b1-425d-b17b-27f275896cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:41.340608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8672221-34b1-425d-b17b-27f275896cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:41.340909 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8672221-34b1-425d-b17b-27f275896cb5 admin admin] PATH_INFO: `/v3/projects/c3a5d7434f2c41c2bde0a0d2c539beea/users/eb7d88ae833e4cb794ee4b10beef233a/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:41.362163 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8672221-34b1-425d-b17b-27f275896cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3a5d7434f2c41c2bde0a0d2c539beea, user_id=eb7d88ae833e4cb794ee4b10beef233a, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:41.364852 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8672221-34b1-425d-b17b-27f275896cb5 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:41.385727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1292/2577] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:54:41 2022] PUT /identity/v3/projects/c3a5d7434f2c41c2bde0a0d2c539beea/users/eb7d88ae833e4cb794ee4b10beef233a/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:41.389803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f7ab5-2760-4a30-9bde-49b57e834bd9 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:41.400610 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f7ab5-2760-4a30-9bde-49b57e834bd9 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:41.464739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e86925-a9d7-425c-a362-c3f2c8a25998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:41.465429 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e86925-a9d7-425c-a362-c3f2c8a25998 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:41.465719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e86925-a9d7-425c-a362-c3f2c8a25998 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:41.465999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e86925-a9d7-425c-a362-c3f2c8a25998 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:41.466737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e86925-a9d7-425c-a362-c3f2c8a25998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:41.468401 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e86925-a9d7-425c-a362-c3f2c8a25998 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:41.479898 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1286/2578] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:54:41.484086 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8672221-34b1-425d-b17b-27f275896cb5 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:41.495181 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8672221-34b1-425d-b17b-27f275896cb5 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:41.500036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3178b-4e3b-4493-aed1-b157287d0cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:41.500954 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3178b-4e3b-4493-aed1-b157287d0cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:41.501275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3178b-4e3b-4493-aed1-b157287d0cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:41.501551 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3178b-4e3b-4493-aed1-b157287d0cc4 admin admin] PATH_INFO: `/v3/projects/c3a5d7434f2c41c2bde0a0d2c539beea/users/eb7d88ae833e4cb794ee4b10beef233a/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:41.503679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3178b-4e3b-4493-aed1-b157287d0cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3a5d7434f2c41c2bde0a0d2c539beea, user_id=eb7d88ae833e4cb794ee4b10beef233a, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:41.506346 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3178b-4e3b-4493-aed1-b157287d0cc4 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:41.518082 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1293/2579] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:54:41 2022] PUT /identity/v3/projects/c3a5d7434f2c41c2bde0a0d2c539beea/users/eb7d88ae833e4cb794ee4b10beef233a/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:41.528664 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f9b69-454f-445b-b325-58b4ce6df55c None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:41.528956 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f9b69-454f-445b-b325-58b4ce6df55c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:41.529240 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f9b69-454f-445b-b325-58b4ce6df55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:41.558323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-e49f9b69-454f-445b-b325-58b4ce6df55c None None] MFA Rules not processed for user `eb7d88ae833e4cb794ee4b10beef233a`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:41.559535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e49f9b69-454f-445b-b325-58b4ce6df55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:41.627655 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1287/2580] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:54:41.638861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3178b-4e3b-4493-aed1-b157287d0cc4 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:41.640635 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-89d3178b-4e3b-4493-aed1-b157287d0cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:41.697431 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3178b-4e3b-4493-aed1-b157287d0cc4 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:41.701067 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5c032-35b9-4dfd-b4ca-2ef736f984f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:41.701715 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5c032-35b9-4dfd-b4ca-2ef736f984f6 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:41.701998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5c032-35b9-4dfd-b4ca-2ef736f984f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:41.702271 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5c032-35b9-4dfd-b4ca-2ef736f984f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:41.759170 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5c032-35b9-4dfd-b4ca-2ef736f984f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:41.760652 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5c032-35b9-4dfd-b4ca-2ef736f984f6 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:41.770241 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1294/2581] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:54:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:54:43.254304 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f9b69-454f-445b-b325-58b4ce6df55c None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:43.255800 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e49f9b69-454f-445b-b325-58b4ce6df55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:43.268219 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f9b69-454f-445b-b325-58b4ce6df55c None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:43.271815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899f306-f160-42bb-8714-96983f9f285d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:43.272441 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899f306-f160-42bb-8714-96983f9f285d service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:43.272722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899f306-f160-42bb-8714-96983f9f285d service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:43.273000 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899f306-f160-42bb-8714-96983f9f285d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:43.327834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:43.333316 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899f306-f160-42bb-8714-96983f9f285d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:43.335510 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899f306-f160-42bb-8714-96983f9f285d service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:43.344929 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1288/2582] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:54:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:54:43.904832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5c032-35b9-4dfd-b4ca-2ef736f984f6 service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:43.913686 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5c032-35b9-4dfd-b4ca-2ef736f984f6 service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:43.918345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532baf0b-cd13-4f6c-af78-fb9a5e73b4f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:43.918995 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532baf0b-cd13-4f6c-af78-fb9a5e73b4f8 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:43.919313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532baf0b-cd13-4f6c-af78-fb9a5e73b4f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:43.919597 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532baf0b-cd13-4f6c-af78-fb9a5e73b4f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:43.930345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532baf0b-cd13-4f6c-af78-fb9a5e73b4f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:43.931869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532baf0b-cd13-4f6c-af78-fb9a5e73b4f8 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:43.943088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1295/2583] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:54:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:54:48.091840 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899f306-f160-42bb-8714-96983f9f285d service cinder] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:48.162070 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899f306-f160-42bb-8714-96983f9f285d service cinder] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:48.166863 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69282de-437e-4eba-b743-46a120bd41a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:48.167813 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69282de-437e-4eba-b743-46a120bd41a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:48.168099 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69282de-437e-4eba-b743-46a120bd41a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:48.168539 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69282de-437e-4eba-b743-46a120bd41a0 admin admin] PATH_INFO: `/v3/users/ab0064300d08447c9afec525d5102ab7` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:48.169972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69282de-437e-4eba-b743-46a120bd41a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab0064300d08447c9afec525d5102ab7)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:48.172277 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69282de-437e-4eba-b743-46a120bd41a0 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:48.230251 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-c69282de-437e-4eba-b743-46a120bd41a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab0064300d08447c9afec525d5102ab7'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:48.239859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-c69282de-437e-4eba-b743-46a120bd41a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab0064300d08447c9afec525d5102ab7'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:48.253983 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-c69282de-437e-4eba-b743-46a120bd41a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab0064300d08447c9afec525d5102ab7'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:48.254728 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-c69282de-437e-4eba-b743-46a120bd41a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab0064300d08447c9afec525d5102ab7'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:48.265980 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-c69282de-437e-4eba-b743-46a120bd41a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab0064300d08447c9afec525d5102ab7'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:48.274081 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1289/2584] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:54:48 2022] DELETE /identity/v3/users/ab0064300d08447c9afec525d5102ab7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:48.279230 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f87907-63a4-4cf3-bafa-f9c3b4e427d6 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:48.279900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f87907-63a4-4cf3-bafa-f9c3b4e427d6 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:48.279900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f87907-63a4-4cf3-bafa-f9c3b4e427d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:48.299656 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-06f87907-63a4-4cf3-bafa-f9c3b4e427d6 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:48.300974 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-06f87907-63a4-4cf3-bafa-f9c3b4e427d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:48.367160 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:48.381027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1296/2585] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:54:48.392938 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69282de-437e-4eba-b743-46a120bd41a0 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:48.394756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-c69282de-437e-4eba-b743-46a120bd41a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:48.464223 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69282de-437e-4eba-b743-46a120bd41a0 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:48.468450 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa562f-06e2-4e5e-8adf-0aa45b31d7c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:48.469221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa562f-06e2-4e5e-8adf-0aa45b31d7c2 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:48.469510 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa562f-06e2-4e5e-8adf-0aa45b31d7c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:48.469803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa562f-06e2-4e5e-8adf-0aa45b31d7c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:48.480409 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa562f-06e2-4e5e-8adf-0aa45b31d7c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:48.481777 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aa562f-06e2-4e5e-8adf-0aa45b31d7c2 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:48.493469 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1290/2586] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:54:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:54:48.783299 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f87907-63a4-4cf3-bafa-f9c3b4e427d6 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:48.785490 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-06f87907-63a4-4cf3-bafa-f9c3b4e427d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:48.798058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f87907-63a4-4cf3-bafa-f9c3b4e427d6 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:48.803451 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8393a-184b-493b-bbb0-c6f659671604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:48.804338 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8393a-184b-493b-bbb0-c6f659671604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:48.804621 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8393a-184b-493b-bbb0-c6f659671604 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:48.804902 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8393a-184b-493b-bbb0-c6f659671604 admin admin] PATH_INFO: `/v3/projects/79e4769619094defb903175e1ec208c0` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:48.806122 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8393a-184b-493b-bbb0-c6f659671604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79e4769619094defb903175e1ec208c0)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:48.808124 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8393a-184b-493b-bbb0-c6f659671604 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:48.878448 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-fcf8393a-184b-493b-bbb0-c6f659671604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79e4769619094defb903175e1ec208c0', 'request_id': 'req-fcf8393a-184b-493b-bbb0-c6f659671604'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:48.891967 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-fcf8393a-184b-493b-bbb0-c6f659671604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79e4769619094defb903175e1ec208c0', 'request_id': 'req-fcf8393a-184b-493b-bbb0-c6f659671604'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:48.906222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-fcf8393a-184b-493b-bbb0-c6f659671604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79e4769619094defb903175e1ec208c0', 'request_id': 'req-fcf8393a-184b-493b-bbb0-c6f659671604'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:48.919486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-fcf8393a-184b-493b-bbb0-c6f659671604 admin admin] The token cache is being invalidate because project 79e4769619094defb903175e1ec208c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:54:48.919776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-fcf8393a-184b-493b-bbb0-c6f659671604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:48.920507 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-fcf8393a-184b-493b-bbb0-c6f659671604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:48.922118 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1297/2587] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:54:48 2022] DELETE /identity/v3/projects/79e4769619094defb903175e1ec208c0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:54:48.926785 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa562f-06e2-4e5e-8adf-0aa45b31d7c2 service neutron] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:48.937720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aa562f-06e2-4e5e-8adf-0aa45b31d7c2 service neutron] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:48.952682 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:49.013512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe712ac-c2b9-434d-806b-4507fd4dca9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:49.014419 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe712ac-c2b9-434d-806b-4507fd4dca9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:49.014701 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe712ac-c2b9-434d-806b-4507fd4dca9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:49.014978 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe712ac-c2b9-434d-806b-4507fd4dca9f admin admin] PATH_INFO: `/v3/users/0a6f72ba37e24aa0a928ce1270f389cd` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:49.016417 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe712ac-c2b9-434d-806b-4507fd4dca9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6f72ba37e24aa0a928ce1270f389cd)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:49.019141 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe712ac-c2b9-434d-806b-4507fd4dca9f admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:49.082790 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-cbe712ac-c2b9-434d-806b-4507fd4dca9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6f72ba37e24aa0a928ce1270f389cd'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:49.091028 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-cbe712ac-c2b9-434d-806b-4507fd4dca9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6f72ba37e24aa0a928ce1270f389cd'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:49.106048 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-cbe712ac-c2b9-434d-806b-4507fd4dca9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6f72ba37e24aa0a928ce1270f389cd'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:49.106786 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-cbe712ac-c2b9-434d-806b-4507fd4dca9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6f72ba37e24aa0a928ce1270f389cd'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:49.113930 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-cbe712ac-c2b9-434d-806b-4507fd4dca9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6f72ba37e24aa0a928ce1270f389cd'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:49.120040 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1291/2588] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:54:48 2022] DELETE /identity/v3/users/0a6f72ba37e24aa0a928ce1270f389cd => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:49.435986 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8393a-184b-493b-bbb0-c6f659671604 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:49.437474 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-fcf8393a-184b-493b-bbb0-c6f659671604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:49.467623 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8393a-184b-493b-bbb0-c6f659671604 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:49.537783 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0141d-8267-4caf-a4cd-ce8d4dc47c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:49.538668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0141d-8267-4caf-a4cd-ce8d4dc47c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:49.538951 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0141d-8267-4caf-a4cd-ce8d4dc47c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:49.539224 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0141d-8267-4caf-a4cd-ce8d4dc47c4a admin admin] PATH_INFO: `/v3/projects/58f6e6ff87a24b1c89395ffc0924fdbe` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:49.540753 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0141d-8267-4caf-a4cd-ce8d4dc47c4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=58f6e6ff87a24b1c89395ffc0924fdbe)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:49.542692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0141d-8267-4caf-a4cd-ce8d4dc47c4a admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:49.608770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-aee0141d-8267-4caf-a4cd-ce8d4dc47c4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58f6e6ff87a24b1c89395ffc0924fdbe', 'request_id': 'req-aee0141d-8267-4caf-a4cd-ce8d4dc47c4a'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:49.619350 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-aee0141d-8267-4caf-a4cd-ce8d4dc47c4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58f6e6ff87a24b1c89395ffc0924fdbe', 'request_id': 'req-aee0141d-8267-4caf-a4cd-ce8d4dc47c4a'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:49.633547 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-aee0141d-8267-4caf-a4cd-ce8d4dc47c4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58f6e6ff87a24b1c89395ffc0924fdbe', 'request_id': 'req-aee0141d-8267-4caf-a4cd-ce8d4dc47c4a'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:49.656242 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-aee0141d-8267-4caf-a4cd-ce8d4dc47c4a admin admin] The token cache is being invalidate because project 58f6e6ff87a24b1c89395ffc0924fdbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:54:49.656747 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-aee0141d-8267-4caf-a4cd-ce8d4dc47c4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:49.657963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-aee0141d-8267-4caf-a4cd-ce8d4dc47c4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:49.660717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1298/2589] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:54:49 2022] DELETE /identity/v3/projects/58f6e6ff87a24b1c89395ffc0924fdbe => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:49.667055 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe712ac-c2b9-434d-806b-4507fd4dca9f admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:49.668824 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-cbe712ac-c2b9-434d-806b-4507fd4dca9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:49.696215 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe712ac-c2b9-434d-806b-4507fd4dca9f admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:49.786301 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d106ff-6292-4f12-8073-0a4ad1f0183e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:49.787508 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d106ff-6292-4f12-8073-0a4ad1f0183e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:49.787796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d106ff-6292-4f12-8073-0a4ad1f0183e admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:49.788077 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d106ff-6292-4f12-8073-0a4ad1f0183e admin admin] PATH_INFO: `/v3/users/eb7d88ae833e4cb794ee4b10beef233a` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:49.789366 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d106ff-6292-4f12-8073-0a4ad1f0183e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb7d88ae833e4cb794ee4b10beef233a)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:49.791355 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d106ff-6292-4f12-8073-0a4ad1f0183e admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:49.856356 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:49.875070 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-43d106ff-6292-4f12-8073-0a4ad1f0183e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb7d88ae833e4cb794ee4b10beef233a'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:49.892606 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-43d106ff-6292-4f12-8073-0a4ad1f0183e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb7d88ae833e4cb794ee4b10beef233a'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:49.919419 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-43d106ff-6292-4f12-8073-0a4ad1f0183e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb7d88ae833e4cb794ee4b10beef233a'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:49.920693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-43d106ff-6292-4f12-8073-0a4ad1f0183e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb7d88ae833e4cb794ee4b10beef233a'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:49.933854 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-43d106ff-6292-4f12-8073-0a4ad1f0183e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb7d88ae833e4cb794ee4b10beef233a'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:49.942586 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1292/2590] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:54:49 2022] DELETE /identity/v3/users/eb7d88ae833e4cb794ee4b10beef233a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:50.283525 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0141d-8267-4caf-a4cd-ce8d4dc47c4a admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:50.285179 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-aee0141d-8267-4caf-a4cd-ce8d4dc47c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:50.303044 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0141d-8267-4caf-a4cd-ce8d4dc47c4a admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:50.307842 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:50.373095 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49f1ad-3541-46ac-a89a-452512b67c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:50.373874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49f1ad-3541-46ac-a89a-452512b67c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:50.374162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49f1ad-3541-46ac-a89a-452512b67c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:50.374441 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49f1ad-3541-46ac-a89a-452512b67c4f admin admin] PATH_INFO: `/v3/projects/c3a5d7434f2c41c2bde0a0d2c539beea` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:50.375862 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49f1ad-3541-46ac-a89a-452512b67c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3a5d7434f2c41c2bde0a0d2c539beea)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:50.378560 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49f1ad-3541-46ac-a89a-452512b67c4f admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:50.434978 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2d49f1ad-3541-46ac-a89a-452512b67c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3a5d7434f2c41c2bde0a0d2c539beea', 'request_id': 'req-2d49f1ad-3541-46ac-a89a-452512b67c4f'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:50.441784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2d49f1ad-3541-46ac-a89a-452512b67c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3a5d7434f2c41c2bde0a0d2c539beea', 'request_id': 'req-2d49f1ad-3541-46ac-a89a-452512b67c4f'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:50.452002 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2d49f1ad-3541-46ac-a89a-452512b67c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3a5d7434f2c41c2bde0a0d2c539beea', 'request_id': 'req-2d49f1ad-3541-46ac-a89a-452512b67c4f'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:50.467186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2d49f1ad-3541-46ac-a89a-452512b67c4f admin admin] The token cache is being invalidate because project c3a5d7434f2c41c2bde0a0d2c539beea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:54:50.467510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2d49f1ad-3541-46ac-a89a-452512b67c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:50.468190 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2d49f1ad-3541-46ac-a89a-452512b67c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:50.470286 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1299/2591] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:54:50 2022] DELETE /identity/v3/projects/c3a5d7434f2c41c2bde0a0d2c539beea => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:50.476743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959e60b-24bc-4790-a2aa-80dc79c91aae None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:50.477422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959e60b-24bc-4790-a2aa-80dc79c91aae None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:50.477422 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959e60b-24bc-4790-a2aa-80dc79c91aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:50.498454 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-d959e60b-24bc-4790-a2aa-80dc79c91aae None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:50.499772 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-d959e60b-24bc-4790-a2aa-80dc79c91aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:50.567041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1293/2592] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:54:50.576959 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32e5e2-bfb1-4555-911a-f688abf7c75b None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:50.577389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32e5e2-bfb1-4555-911a-f688abf7c75b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:50.577717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32e5e2-bfb1-4555-911a-f688abf7c75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:50.598009 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-ae32e5e2-bfb1-4555-911a-f688abf7c75b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:50.599234 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ae32e5e2-bfb1-4555-911a-f688abf7c75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:50.609146 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1300/2593] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:54:50.614583 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959e60b-24bc-4790-a2aa-80dc79c91aae None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:50.625166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959e60b-24bc-4790-a2aa-80dc79c91aae None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:50.630922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb4971-8688-41b0-ac32-6ab85ce0fc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:50.631663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb4971-8688-41b0-ac32-6ab85ce0fc23 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:50.631952 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb4971-8688-41b0-ac32-6ab85ce0fc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:50.632231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb4971-8688-41b0-ac32-6ab85ce0fc23 admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:50.632994 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb4971-8688-41b0-ac32-6ab85ce0fc23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:54:50.633322 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb4971-8688-41b0-ac32-6ab85ce0fc23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:50.635001 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb4971-8688-41b0-ac32-6ab85ce0fc23 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:50.649190 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1294/2594] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:54:50.656283 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32e5e2-bfb1-4555-911a-f688abf7c75b None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:50.674063 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32e5e2-bfb1-4555-911a-f688abf7c75b None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:50.682162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27feb337-b513-41c9-8746-d057d985f1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:50.683373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feb337-b513-41c9-8746-d057d985f1f3 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:50.683855 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feb337-b513-41c9-8746-d057d985f1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:50.684356 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feb337-b513-41c9-8746-d057d985f1f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:50.685689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27feb337-b513-41c9-8746-d057d985f1f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:50.689968 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27feb337-b513-41c9-8746-d057d985f1f3 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:50.730742 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1301/2595] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:54:50 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:54:50.735254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb4971-8688-41b0-ac32-6ab85ce0fc23 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:50.746534 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb4971-8688-41b0-ac32-6ab85ce0fc23 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:50.818087 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cc16c-fcf0-4473-81bf-fff7b983aaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:50.818808 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cc16c-fcf0-4473-81bf-fff7b983aaf5 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:50.819096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cc16c-fcf0-4473-81bf-fff7b983aaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:50.819415 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cc16c-fcf0-4473-81bf-fff7b983aaf5 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:50.820210 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cc16c-fcf0-4473-81bf-fff7b983aaf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:50.822168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cc16c-fcf0-4473-81bf-fff7b983aaf5 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:50.845835 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1295/2596] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:54:50 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:54:50.850764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27feb337-b513-41c9-8746-d057d985f1f3 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:50.869997 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27feb337-b513-41c9-8746-d057d985f1f3 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:50.876630 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c8031-3fe3-4412-9a80-b705d14eb88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:50.877318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c8031-3fe3-4412-9a80-b705d14eb88b admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:50.877675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c8031-3fe3-4412-9a80-b705d14eb88b admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:50.878018 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3c8031-3fe3-4412-9a80-b705d14eb88b admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:50.878826 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c8031-3fe3-4412-9a80-b705d14eb88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:50.880620 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3c8031-3fe3-4412-9a80-b705d14eb88b admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:50.894323 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1302/2597] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:54:50.899307 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cc16c-fcf0-4473-81bf-fff7b983aaf5 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:50.912327 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cc16c-fcf0-4473-81bf-fff7b983aaf5 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:50.917490 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36cc1b-71d3-4156-97f3-e1f702db3dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:50.918188 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36cc1b-71d3-4156-97f3-e1f702db3dab admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:50.918473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36cc1b-71d3-4156-97f3-e1f702db3dab admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:50.918751 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36cc1b-71d3-4156-97f3-e1f702db3dab admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:50.919535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36cc1b-71d3-4156-97f3-e1f702db3dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:50.921219 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36cc1b-71d3-4156-97f3-e1f702db3dab admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:50.934192 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1296/2598] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:54:50.941062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c8031-3fe3-4412-9a80-b705d14eb88b admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:50.958452 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3c8031-3fe3-4412-9a80-b705d14eb88b admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:50.966268 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1966d4-1d16-4abf-9e54-0632275530bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:50.967928 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1966d4-1d16-4abf-9e54-0632275530bc admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:50.968408 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1966d4-1d16-4abf-9e54-0632275530bc admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:50.968887 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1966d4-1d16-4abf-9e54-0632275530bc admin admin] PATH_INFO: `/v3/projects/a42a7cf371a445f6b6eee84a467ff991/users/a6e0172a08944ff5a4a39c1e22de6235/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:50.997977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1966d4-1d16-4abf-9e54-0632275530bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42a7cf371a445f6b6eee84a467ff991, user_id=a6e0172a08944ff5a4a39c1e22de6235, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:51.003558 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1966d4-1d16-4abf-9e54-0632275530bc admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:51.026042 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1303/2599] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:54:50 2022] PUT /identity/v3/projects/a42a7cf371a445f6b6eee84a467ff991/users/a6e0172a08944ff5a4a39c1e22de6235/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:51.044511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67c6e4-e93d-47c5-80b1-8a831e9ca022 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:51.044803 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67c6e4-e93d-47c5-80b1-8a831e9ca022 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:51.045089 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67c6e4-e93d-47c5-80b1-8a831e9ca022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:51.077202 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-2c67c6e4-e93d-47c5-80b1-8a831e9ca022 None None] MFA Rules not processed for user `a6e0172a08944ff5a4a39c1e22de6235`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:51.078445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-2c67c6e4-e93d-47c5-80b1-8a831e9ca022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:51.087357 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:51.179453 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1297/2600] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:54:51.196221 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1966d4-1d16-4abf-9e54-0632275530bc admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:51.199372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-eb1966d4-1d16-4abf-9e54-0632275530bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:51.246836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:51.275964 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1966d4-1d16-4abf-9e54-0632275530bc admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:51.280213 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a3578-a455-440e-8777-c4aca1cc11d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:51.280912 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a3578-a455-440e-8777-c4aca1cc11d9 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:51.281195 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a3578-a455-440e-8777-c4aca1cc11d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:51.281478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a3578-a455-440e-8777-c4aca1cc11d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:51.292188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a3578-a455-440e-8777-c4aca1cc11d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:51.293716 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a3578-a455-440e-8777-c4aca1cc11d9 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:51.308704 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1304/2601] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:54:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:54:54.034796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67c6e4-e93d-47c5-80b1-8a831e9ca022 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:54.125758 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67c6e4-e93d-47c5-80b1-8a831e9ca022 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:54.134675 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9cad7-a5d3-4594-9011-aff6a3f72a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:54.136710 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9cad7-a5d3-4594-9011-aff6a3f72a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:54.137214 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9cad7-a5d3-4594-9011-aff6a3f72a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:54.137702 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9cad7-a5d3-4594-9011-aff6a3f72a04 admin admin] PATH_INFO: `/v3/users/a6e0172a08944ff5a4a39c1e22de6235` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:54.140012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9cad7-a5d3-4594-9011-aff6a3f72a04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e0172a08944ff5a4a39c1e22de6235)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:54.144450 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d9cad7-a5d3-4594-9011-aff6a3f72a04 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:54.209990 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b4d9cad7-a5d3-4594-9011-aff6a3f72a04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e0172a08944ff5a4a39c1e22de6235'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:54.220286 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b4d9cad7-a5d3-4594-9011-aff6a3f72a04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e0172a08944ff5a4a39c1e22de6235'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:54.239673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b4d9cad7-a5d3-4594-9011-aff6a3f72a04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e0172a08944ff5a4a39c1e22de6235'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:54.240842 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b4d9cad7-a5d3-4594-9011-aff6a3f72a04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e0172a08944ff5a4a39c1e22de6235'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:54.254463 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-b4d9cad7-a5d3-4594-9011-aff6a3f72a04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e0172a08944ff5a4a39c1e22de6235'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:54.266036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1298/2602] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:54:54 2022] DELETE /identity/v3/users/a6e0172a08944ff5a4a39c1e22de6235 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:54.272353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43090ac4-7171-43aa-b3b2-6b557feae77e None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:54.273303 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43090ac4-7171-43aa-b3b2-6b557feae77e None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:54.273479 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43090ac4-7171-43aa-b3b2-6b557feae77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:54.296446 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-43090ac4-7171-43aa-b3b2-6b557feae77e None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:54.297717 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-43090ac4-7171-43aa-b3b2-6b557feae77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:54.373412 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1305/2603] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:54:54.387008 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9cad7-a5d3-4594-9011-aff6a3f72a04 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:54.389112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b4d9cad7-a5d3-4594-9011-aff6a3f72a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:54.448556 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:54.491928 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d9cad7-a5d3-4594-9011-aff6a3f72a04 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:54.498317 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702ad5d-98df-4ce8-85a9-50872ae2648f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:54.499494 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702ad5d-98df-4ce8-85a9-50872ae2648f service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:54.499995 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702ad5d-98df-4ce8-85a9-50872ae2648f service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:54.500500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702ad5d-98df-4ce8-85a9-50872ae2648f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:54.515813 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702ad5d-98df-4ce8-85a9-50872ae2648f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:54.517560 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702ad5d-98df-4ce8-85a9-50872ae2648f service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:54.534719 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1299/2604] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:54:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:54:54.894733 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43090ac4-7171-43aa-b3b2-6b557feae77e None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:54.897174 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-43090ac4-7171-43aa-b3b2-6b557feae77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:54.911936 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43090ac4-7171-43aa-b3b2-6b557feae77e None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:54.918945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868fe17-0af9-4243-bce8-2696cb203afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:54.920277 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868fe17-0af9-4243-bce8-2696cb203afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:54.920780 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868fe17-0af9-4243-bce8-2696cb203afd admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:54.921231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868fe17-0af9-4243-bce8-2696cb203afd admin admin] PATH_INFO: `/v3/projects/a42a7cf371a445f6b6eee84a467ff991` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:54.922946 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868fe17-0af9-4243-bce8-2696cb203afd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42a7cf371a445f6b6eee84a467ff991)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:54.925298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868fe17-0af9-4243-bce8-2696cb203afd admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:55.001006 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-8868fe17-0af9-4243-bce8-2696cb203afd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42a7cf371a445f6b6eee84a467ff991', 'request_id': 'req-8868fe17-0af9-4243-bce8-2696cb203afd'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:55.009481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-8868fe17-0af9-4243-bce8-2696cb203afd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42a7cf371a445f6b6eee84a467ff991', 'request_id': 'req-8868fe17-0af9-4243-bce8-2696cb203afd'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:55.020946 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702ad5d-98df-4ce8-85a9-50872ae2648f service neutron] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:55.022536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e702ad5d-98df-4ce8-85a9-50872ae2648f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:55.033711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-8868fe17-0af9-4243-bce8-2696cb203afd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42a7cf371a445f6b6eee84a467ff991', 'request_id': 'req-8868fe17-0af9-4243-bce8-2696cb203afd'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:55.061696 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-8868fe17-0af9-4243-bce8-2696cb203afd admin admin] The token cache is being invalidate because project a42a7cf371a445f6b6eee84a467ff991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:54:55.061993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-8868fe17-0af9-4243-bce8-2696cb203afd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:55.062795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-8868fe17-0af9-4243-bce8-2696cb203afd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:55.065575 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1306/2605] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:54:54 2022] DELETE /identity/v3/projects/a42a7cf371a445f6b6eee84a467ff991 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:55.072475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af46983-2636-4c8d-bd0b-38fd50d84338 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:55.072719 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af46983-2636-4c8d-bd0b-38fd50d84338 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:55.073013 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af46983-2636-4c8d-bd0b-38fd50d84338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:55.100849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-7af46983-2636-4c8d-bd0b-38fd50d84338 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:55.102110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7af46983-2636-4c8d-bd0b-38fd50d84338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:55.140039 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702ad5d-98df-4ce8-85a9-50872ae2648f service neutron] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:55.177768 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:55.199667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1307/2606] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:54:55.201878 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968a49f-764d-4d11-9b81-34ba36a4be34 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:55.202174 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968a49f-764d-4d11-9b81-34ba36a4be34 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:55.202482 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968a49f-764d-4d11-9b81-34ba36a4be34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:55.224389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-e968a49f-764d-4d11-9b81-34ba36a4be34 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:55.225637 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-e968a49f-764d-4d11-9b81-34ba36a4be34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:55.234815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1308/2607] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:54:55.243651 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968a49f-764d-4d11-9b81-34ba36a4be34 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:55.253254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f815b-8d08-4a5f-863b-2094891a74dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:55.254080 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f815b-8d08-4a5f-863b-2094891a74dc service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:55.254602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f815b-8d08-4a5f-863b-2094891a74dc service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:55.255094 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f815b-8d08-4a5f-863b-2094891a74dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:55.257169 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-6f2f815b-8d08-4a5f-863b-2094891a74dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:55.258524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968a49f-764d-4d11-9b81-34ba36a4be34 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:55.269287 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8b8b0-8848-4579-9686-596535f8620e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:55.271198 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8b8b0-8848-4579-9686-596535f8620e admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:55.271661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8b8b0-8848-4579-9686-596535f8620e admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:55.272192 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8b8b0-8848-4579-9686-596535f8620e admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:55.273812 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8b8b0-8848-4579-9686-596535f8620e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:54:55.274398 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8b8b0-8848-4579-9686-596535f8620e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:55.277543 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8b8b0-8848-4579-9686-596535f8620e admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:55.293474 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1309/2608] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:54:55.300076 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8b8b0-8848-4579-9686-596535f8620e admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:55.313246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8b8b0-8848-4579-9686-596535f8620e admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:55.319993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1217f58-8e36-46a7-8775-55b3bfb9da3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:55.320998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1217f58-8e36-46a7-8775-55b3bfb9da3d admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:55.321296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1217f58-8e36-46a7-8775-55b3bfb9da3d admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:55.321575 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1217f58-8e36-46a7-8775-55b3bfb9da3d admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:55.323543 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1217f58-8e36-46a7-8775-55b3bfb9da3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:55.325658 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1217f58-8e36-46a7-8775-55b3bfb9da3d admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:55.337095 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f815b-8d08-4a5f-863b-2094891a74dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:55.338895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f815b-8d08-4a5f-863b-2094891a74dc service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:55.351617 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1300/2609] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:54:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:54:55.371665 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1310/2610] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:54:55 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:54:55.384410 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f815b-8d08-4a5f-863b-2094891a74dc service nova] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:55.399698 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f815b-8d08-4a5f-863b-2094891a74dc service nova] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:55.404566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:55.490526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a5c33-211c-4876-88e1-02c1eab66e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:55.491718 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a5c33-211c-4876-88e1-02c1eab66e70 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:55.492015 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a5c33-211c-4876-88e1-02c1eab66e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:55.492301 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a5c33-211c-4876-88e1-02c1eab66e70 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:55.494104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a5c33-211c-4876-88e1-02c1eab66e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:55.496529 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a5c33-211c-4876-88e1-02c1eab66e70 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:55.524711 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1301/2611] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:54:55 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:54:55.528883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1217f58-8e36-46a7-8775-55b3bfb9da3d admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:55.542030 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1217f58-8e36-46a7-8775-55b3bfb9da3d admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:55.547682 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cde78-ae2a-4040-b12b-99501902b086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:55.548932 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cde78-ae2a-4040-b12b-99501902b086 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:55.549253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cde78-ae2a-4040-b12b-99501902b086 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:55.549607 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cde78-ae2a-4040-b12b-99501902b086 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:55.550376 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cde78-ae2a-4040-b12b-99501902b086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:55.552372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cde78-ae2a-4040-b12b-99501902b086 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:55.565051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1311/2612] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:54:55.570214 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a5c33-211c-4876-88e1-02c1eab66e70 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:55.585212 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a5c33-211c-4876-88e1-02c1eab66e70 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:55.596899 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cc679-f830-4262-b0b3-e3cfb9cf9744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:55.598345 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cc679-f830-4262-b0b3-e3cfb9cf9744 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:55.598850 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cc679-f830-4262-b0b3-e3cfb9cf9744 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:55.599396 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cc679-f830-4262-b0b3-e3cfb9cf9744 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:55.600781 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cc679-f830-4262-b0b3-e3cfb9cf9744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:55.606262 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cc679-f830-4262-b0b3-e3cfb9cf9744 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:55.624062 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1302/2613] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:54:55.629031 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cde78-ae2a-4040-b12b-99501902b086 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:55.644374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cde78-ae2a-4040-b12b-99501902b086 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:55.652083 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a43ca-22dd-42bd-b37e-c508796c1877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:55.653682 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a43ca-22dd-42bd-b37e-c508796c1877 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:55.654166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a43ca-22dd-42bd-b37e-c508796c1877 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:55.654438 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a43ca-22dd-42bd-b37e-c508796c1877 admin admin] PATH_INFO: `/v3/projects/64867af9828848e89f2d88c41a43197e/users/b73f053fe52b4c40a89e4f6860864681/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:55.680767 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a43ca-22dd-42bd-b37e-c508796c1877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64867af9828848e89f2d88c41a43197e, user_id=b73f053fe52b4c40a89e4f6860864681, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:55.684773 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a43ca-22dd-42bd-b37e-c508796c1877 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:55.726524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1312/2614] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:54:55 2022] PUT /identity/v3/projects/64867af9828848e89f2d88c41a43197e/users/b73f053fe52b4c40a89e4f6860864681/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:54:55.738513 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24345927-cf59-4867-9968-d8b40916e218 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:55.738788 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24345927-cf59-4867-9968-d8b40916e218 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:55.738982 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24345927-cf59-4867-9968-d8b40916e218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:55.780040 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-24345927-cf59-4867-9968-d8b40916e218 None None] MFA Rules not processed for user `b73f053fe52b4c40a89e4f6860864681`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:55.781333 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-24345927-cf59-4867-9968-d8b40916e218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:55.897057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1303/2615] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:54:55.909888 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a43ca-22dd-42bd-b37e-c508796c1877 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:55.911732 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-104a43ca-22dd-42bd-b37e-c508796c1877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:55.996636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a43ca-22dd-42bd-b37e-c508796c1877 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:56.000993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec803d-891e-45bc-832f-0e8243aec518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:56.001540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec803d-891e-45bc-832f-0e8243aec518 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:56.001829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec803d-891e-45bc-832f-0e8243aec518 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:56.002108 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec803d-891e-45bc-832f-0e8243aec518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:56.012973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec803d-891e-45bc-832f-0e8243aec518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:56.014630 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec803d-891e-45bc-832f-0e8243aec518 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:56.028483 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1313/2616] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:54:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:54:56.062306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24345927-cf59-4867-9968-d8b40916e218 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:56.137295 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24345927-cf59-4867-9968-d8b40916e218 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:56.142810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad580e-1472-481c-9d0e-32cab6a5782d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:56.143742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad580e-1472-481c-9d0e-32cab6a5782d admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:56.144026 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad580e-1472-481c-9d0e-32cab6a5782d admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:56.144307 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad580e-1472-481c-9d0e-32cab6a5782d admin admin] PATH_INFO: `/v3/users/b73f053fe52b4c40a89e4f6860864681` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:56.145578 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad580e-1472-481c-9d0e-32cab6a5782d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b73f053fe52b4c40a89e4f6860864681)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:56.147567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad580e-1472-481c-9d0e-32cab6a5782d admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:56.167025 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:56.215778 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-baad580e-1472-481c-9d0e-32cab6a5782d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b73f053fe52b4c40a89e4f6860864681'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:56.224858 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-baad580e-1472-481c-9d0e-32cab6a5782d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b73f053fe52b4c40a89e4f6860864681'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:56.240891 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-baad580e-1472-481c-9d0e-32cab6a5782d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b73f053fe52b4c40a89e4f6860864681'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:56.241695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-baad580e-1472-481c-9d0e-32cab6a5782d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b73f053fe52b4c40a89e4f6860864681'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:56.252320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-baad580e-1472-481c-9d0e-32cab6a5782d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b73f053fe52b4c40a89e4f6860864681'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:56.262432 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1304/2617] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:54:56 2022] DELETE /identity/v3/users/b73f053fe52b4c40a89e4f6860864681 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:56.269727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32393064-cc78-4675-bd1a-f1a3da6627a1 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:56.270334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32393064-cc78-4675-bd1a-f1a3da6627a1 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:56.270751 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32393064-cc78-4675-bd1a-f1a3da6627a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:56.300060 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-32393064-cc78-4675-bd1a-f1a3da6627a1 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:56.302222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-32393064-cc78-4675-bd1a-f1a3da6627a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:56.381801 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1314/2618] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:54:56.394333 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad580e-1472-481c-9d0e-32cab6a5782d admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:56.396581 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-baad580e-1472-481c-9d0e-32cab6a5782d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:56.467654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad580e-1472-481c-9d0e-32cab6a5782d admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:56.472262 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37a942-2452-4ea0-8f00-22a3083566db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:56.472930 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37a942-2452-4ea0-8f00-22a3083566db service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:56.473218 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37a942-2452-4ea0-8f00-22a3083566db service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:56.473499 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37a942-2452-4ea0-8f00-22a3083566db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:56.484352 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37a942-2452-4ea0-8f00-22a3083566db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:56.486339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37a942-2452-4ea0-8f00-22a3083566db service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:56.498527 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1305/2619] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:54:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:54:56.846207 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32393064-cc78-4675-bd1a-f1a3da6627a1 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:56.848583 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-32393064-cc78-4675-bd1a-f1a3da6627a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:56.873467 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32393064-cc78-4675-bd1a-f1a3da6627a1 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:56.879096 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2d8cd-e6b8-45fb-b81a-8de6e9acf88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:56.880285 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2d8cd-e6b8-45fb-b81a-8de6e9acf88c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:56.880849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2d8cd-e6b8-45fb-b81a-8de6e9acf88c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:56.881390 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2d8cd-e6b8-45fb-b81a-8de6e9acf88c admin admin] PATH_INFO: `/v3/projects/64867af9828848e89f2d88c41a43197e` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:56.883131 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2d8cd-e6b8-45fb-b81a-8de6e9acf88c admin admin] RBAC: Authorizing `identity:delete_project(project_id=64867af9828848e89f2d88c41a43197e)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:56.885927 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2d8cd-e6b8-45fb-b81a-8de6e9acf88c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:56.925492 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:56.956052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-abf2d8cd-e6b8-45fb-b81a-8de6e9acf88c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64867af9828848e89f2d88c41a43197e', 'request_id': 'req-abf2d8cd-e6b8-45fb-b81a-8de6e9acf88c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:56.962651 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-abf2d8cd-e6b8-45fb-b81a-8de6e9acf88c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64867af9828848e89f2d88c41a43197e', 'request_id': 'req-abf2d8cd-e6b8-45fb-b81a-8de6e9acf88c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:56.973059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-abf2d8cd-e6b8-45fb-b81a-8de6e9acf88c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64867af9828848e89f2d88c41a43197e', 'request_id': 'req-abf2d8cd-e6b8-45fb-b81a-8de6e9acf88c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:56.988119 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-abf2d8cd-e6b8-45fb-b81a-8de6e9acf88c admin admin] The token cache is being invalidate because project 64867af9828848e89f2d88c41a43197e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:54:56.988578 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-abf2d8cd-e6b8-45fb-b81a-8de6e9acf88c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:56.989100 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-abf2d8cd-e6b8-45fb-b81a-8de6e9acf88c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:54:56.990793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1315/2620] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:54:56 2022] DELETE /identity/v3/projects/64867af9828848e89f2d88c41a43197e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:54:56.996346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2f392-a27f-4b20-beaf-199c97dcaacb None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:56.996703 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2f392-a27f-4b20-beaf-199c97dcaacb None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:56.997027 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b2f392-a27f-4b20-beaf-199c97dcaacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:57.017391 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-14b2f392-a27f-4b20-beaf-199c97dcaacb None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:57.018645 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-14b2f392-a27f-4b20-beaf-199c97dcaacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:57.103785 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1306/2621] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:54:57.116740 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc26a6c-c3a9-44a9-85f2-4634aa8e7a79 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:57.117142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc26a6c-c3a9-44a9-85f2-4634aa8e7a79 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:57.117492 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc26a6c-c3a9-44a9-85f2-4634aa8e7a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:57.141925 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-8cc26a6c-c3a9-44a9-85f2-4634aa8e7a79 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:57.143162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-8cc26a6c-c3a9-44a9-85f2-4634aa8e7a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:57.160242 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1316/2622] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:54:57.162064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2f392-a27f-4b20-beaf-199c97dcaacb None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:57.178440 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b2f392-a27f-4b20-beaf-199c97dcaacb None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:57.184185 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f6b2f-e792-4c21-ba3d-976fc0f5d1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:57.184984 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f6b2f-e792-4c21-ba3d-976fc0f5d1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:57.185258 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f6b2f-e792-4c21-ba3d-976fc0f5d1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:57.185537 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f6b2f-e792-4c21-ba3d-976fc0f5d1d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:57.186305 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f6b2f-e792-4c21-ba3d-976fc0f5d1d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:54:57.186680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f6b2f-e792-4c21-ba3d-976fc0f5d1d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:57.188474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f6b2f-e792-4c21-ba3d-976fc0f5d1d0 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:57.208077 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1307/2623] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:54:57.214568 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc26a6c-c3a9-44a9-85f2-4634aa8e7a79 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:57.236309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc26a6c-c3a9-44a9-85f2-4634aa8e7a79 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:57.241524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc4ea5-a0ea-4173-a900-7d94641a9351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:57.242445 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc4ea5-a0ea-4173-a900-7d94641a9351 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:57.242708 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc4ea5-a0ea-4173-a900-7d94641a9351 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:57.243015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc4ea5-a0ea-4173-a900-7d94641a9351 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:57.243962 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc4ea5-a0ea-4173-a900-7d94641a9351 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:57.246199 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc4ea5-a0ea-4173-a900-7d94641a9351 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:57.277633 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1317/2624] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:54:57 2022] POST /identity/v3/projects => generated 399 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:54:57.283561 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f6b2f-e792-4c21-ba3d-976fc0f5d1d0 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:57.301667 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f6b2f-e792-4c21-ba3d-976fc0f5d1d0 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:57.342629 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:54:57.392199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1c2ea-2092-40a7-b443-9066dcf72b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:57.392922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1c2ea-2092-40a7-b443-9066dcf72b8f admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:57.393205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1c2ea-2092-40a7-b443-9066dcf72b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:57.393486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1c2ea-2092-40a7-b443-9066dcf72b8f admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:57.394259 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1c2ea-2092-40a7-b443-9066dcf72b8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:57.396273 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1c2ea-2092-40a7-b443-9066dcf72b8f admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:57.421863 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1308/2625] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:54:57 2022] POST /identity/v3/users => generated 300 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:54:57.426684 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc4ea5-a0ea-4173-a900-7d94641a9351 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:57.441525 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc4ea5-a0ea-4173-a900-7d94641a9351 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:57.446900 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbcdd2-ce0b-4875-9010-741239963831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:57.447732 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbcdd2-ce0b-4875-9010-741239963831 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:57.448015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbcdd2-ce0b-4875-9010-741239963831 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:57.448291 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dbcdd2-ce0b-4875-9010-741239963831 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:57.449400 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbcdd2-ce0b-4875-9010-741239963831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:57.451140 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dbcdd2-ce0b-4875-9010-741239963831 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:57.464438 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1318/2626] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:54:57.470797 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1c2ea-2092-40a7-b443-9066dcf72b8f admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:57.482472 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1c2ea-2092-40a7-b443-9066dcf72b8f admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:57.487988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fea28-c3a1-477f-afab-1fba792caa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:57.488768 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fea28-c3a1-477f-afab-1fba792caa65 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:57.489058 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fea28-c3a1-477f-afab-1fba792caa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:57.489340 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fea28-c3a1-477f-afab-1fba792caa65 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:57.490152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fea28-c3a1-477f-afab-1fba792caa65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:57.491900 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fea28-c3a1-477f-afab-1fba792caa65 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:57.504093 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1309/2627] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:54:57.508621 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbcdd2-ce0b-4875-9010-741239963831 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:57.525375 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dbcdd2-ce0b-4875-9010-741239963831 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:57.531934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cbd70-1fe3-4963-b44d-a4f188c6202f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:57.533599 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cbd70-1fe3-4963-b44d-a4f188c6202f admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:57.534091 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cbd70-1fe3-4963-b44d-a4f188c6202f admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:57.534588 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cbd70-1fe3-4963-b44d-a4f188c6202f admin admin] PATH_INFO: `/v3/projects/fc3ba3b746ce48e3ba8c73e1696ae204/users/ee12605c093448a193bd2fa91dad939e/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:57.558977 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cbd70-1fe3-4963-b44d-a4f188c6202f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc3ba3b746ce48e3ba8c73e1696ae204, user_id=ee12605c093448a193bd2fa91dad939e, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:57.562401 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cbd70-1fe3-4963-b44d-a4f188c6202f admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:57.584245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1319/2628] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:54:57 2022] PUT /identity/v3/projects/fc3ba3b746ce48e3ba8c73e1696ae204/users/ee12605c093448a193bd2fa91dad939e/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:54:57.596992 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681510b-a9bc-4b7d-91f6-cdf0a8949000 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:57.597456 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681510b-a9bc-4b7d-91f6-cdf0a8949000 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:57.597912 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681510b-a9bc-4b7d-91f6-cdf0a8949000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:57.630787 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-8681510b-a9bc-4b7d-91f6-cdf0a8949000 None None] MFA Rules not processed for user `ee12605c093448a193bd2fa91dad939e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:54:57.632069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-8681510b-a9bc-4b7d-91f6-cdf0a8949000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:57.712303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1310/2629] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:54:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:54:57.724920 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cbd70-1fe3-4963-b44d-a4f188c6202f admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:57.726726 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-496cbd70-1fe3-4963-b44d-a4f188c6202f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:57.805984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cbd70-1fe3-4963-b44d-a4f188c6202f admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:57.811143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe64c5-ef54-4b28-a7f6-5fcf0ff5a8e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:57.812131 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe64c5-ef54-4b28-a7f6-5fcf0ff5a8e0 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:57.812570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe64c5-ef54-4b28-a7f6-5fcf0ff5a8e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:57.812992 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe64c5-ef54-4b28-a7f6-5fcf0ff5a8e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:57.824367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe64c5-ef54-4b28-a7f6-5fcf0ff5a8e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:54:57.826149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe64c5-ef54-4b28-a7f6-5fcf0ff5a8e0 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:54:57.837745 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1320/2630] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:54:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:54:59.815459 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681510b-a9bc-4b7d-91f6-cdf0a8949000 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:54:59.817742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-8681510b-a9bc-4b7d-91f6-cdf0a8949000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:59.917739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681510b-a9bc-4b7d-91f6-cdf0a8949000 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:54:59.923514 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02ce81-6c7c-4a4c-a9d3-2d5659f17aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:54:59.924616 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02ce81-6c7c-4a4c-a9d3-2d5659f17aca service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:54:59.925143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02ce81-6c7c-4a4c-a9d3-2d5659f17aca service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:54:59.925382 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02ce81-6c7c-4a4c-a9d3-2d5659f17aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:54:59.927541 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-ad02ce81-6c7c-4a4c-a9d3-2d5659f17aca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:54:59.981068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:00.004446 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02ce81-6c7c-4a4c-a9d3-2d5659f17aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:00.006143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02ce81-6c7c-4a4c-a9d3-2d5659f17aca service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:00.017686 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1311/2631] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:54:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:55:03.276332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe64c5-ef54-4b28-a7f6-5fcf0ff5a8e0 service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:03.296001 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe64c5-ef54-4b28-a7f6-5fcf0ff5a8e0 service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:03.305541 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f0d9d-fc68-4373-9879-8a9a688b4c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:03.307110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f0d9d-fc68-4373-9879-8a9a688b4c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:03.307649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f0d9d-fc68-4373-9879-8a9a688b4c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:03.309561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f0d9d-fc68-4373-9879-8a9a688b4c94 admin admin] PATH_INFO: `/v3/users/ee12605c093448a193bd2fa91dad939e` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:03.312178 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f0d9d-fc68-4373-9879-8a9a688b4c94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee12605c093448a193bd2fa91dad939e)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:03.317531 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f0d9d-fc68-4373-9879-8a9a688b4c94 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:03.463991 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:03.489795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-158f0d9d-fc68-4373-9879-8a9a688b4c94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee12605c093448a193bd2fa91dad939e'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:03.524228 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-158f0d9d-fc68-4373-9879-8a9a688b4c94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee12605c093448a193bd2fa91dad939e'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:03.571332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-158f0d9d-fc68-4373-9879-8a9a688b4c94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee12605c093448a193bd2fa91dad939e'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:03.595568 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-158f0d9d-fc68-4373-9879-8a9a688b4c94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee12605c093448a193bd2fa91dad939e'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:03.596470 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-158f0d9d-fc68-4373-9879-8a9a688b4c94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee12605c093448a193bd2fa91dad939e'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:03.611043 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1321/2632] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:55:03 2022] DELETE /identity/v3/users/ee12605c093448a193bd2fa91dad939e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:55:03.619179 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca31e5-0ac6-4961-b5f9-696d4ccfc479 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:03.620069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca31e5-0ac6-4961-b5f9-696d4ccfc479 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:03.620069 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca31e5-0ac6-4961-b5f9-696d4ccfc479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:03.649068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-4eca31e5-0ac6-4961-b5f9-696d4ccfc479 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:55:03.651175 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-4eca31e5-0ac6-4961-b5f9-696d4ccfc479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:03.799601 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1312/2633] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:55:03.816429 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f0d9d-fc68-4373-9879-8a9a688b4c94 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:03.818226 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-158f0d9d-fc68-4373-9879-8a9a688b4c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:03.910829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f0d9d-fc68-4373-9879-8a9a688b4c94 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:03.919890 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b5a6e-fc85-4ec8-8fbf-321839dc7239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:03.921420 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b5a6e-fc85-4ec8-8fbf-321839dc7239 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:03.922266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b5a6e-fc85-4ec8-8fbf-321839dc7239 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:03.922864 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b5a6e-fc85-4ec8-8fbf-321839dc7239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:03.941919 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b5a6e-fc85-4ec8-8fbf-321839dc7239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:03.943686 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b5a6e-fc85-4ec8-8fbf-321839dc7239 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:03.956047 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1322/2634] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:55:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:55:04.381359 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca31e5-0ac6-4961-b5f9-696d4ccfc479 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:04.383122 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-4eca31e5-0ac6-4961-b5f9-696d4ccfc479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:04.401821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca31e5-0ac6-4961-b5f9-696d4ccfc479 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:04.408630 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db216f-0909-4933-9334-e086082571fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:04.410153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db216f-0909-4933-9334-e086082571fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:04.410473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db216f-0909-4933-9334-e086082571fe admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:04.410796 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db216f-0909-4933-9334-e086082571fe admin admin] PATH_INFO: `/v3/users/4e8c2119269a4b79a880b4adf78c1dec` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:04.412319 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db216f-0909-4933-9334-e086082571fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e8c2119269a4b79a880b4adf78c1dec)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:04.414717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db216f-0909-4933-9334-e086082571fe admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:04.483990 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b5a6e-fc85-4ec8-8fbf-321839dc7239 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:04.486054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a78b5a6e-fc85-4ec8-8fbf-321839dc7239 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:04.494323 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-f5db216f-0909-4933-9334-e086082571fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e8c2119269a4b79a880b4adf78c1dec'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:04.503468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b5a6e-fc85-4ec8-8fbf-321839dc7239 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:04.504339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-f5db216f-0909-4933-9334-e086082571fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e8c2119269a4b79a880b4adf78c1dec'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:04.509686 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920153c0-67ad-41d6-b4be-a49b0acfeeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:04.510787 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920153c0-67ad-41d6-b4be-a49b0acfeeda admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:04.511327 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920153c0-67ad-41d6-b4be-a49b0acfeeda admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:04.511641 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920153c0-67ad-41d6-b4be-a49b0acfeeda admin admin] PATH_INFO: `/v3/projects/fc3ba3b746ce48e3ba8c73e1696ae204` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:04.512932 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920153c0-67ad-41d6-b4be-a49b0acfeeda admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc3ba3b746ce48e3ba8c73e1696ae204)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:04.515796 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920153c0-67ad-41d6-b4be-a49b0acfeeda admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:04.525887 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-f5db216f-0909-4933-9334-e086082571fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e8c2119269a4b79a880b4adf78c1dec'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:04.526755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-f5db216f-0909-4933-9334-e086082571fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e8c2119269a4b79a880b4adf78c1dec'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:04.535761 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-f5db216f-0909-4933-9334-e086082571fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e8c2119269a4b79a880b4adf78c1dec'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:04.546839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1313/2635] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:55:04 2022] DELETE /identity/v3/users/4e8c2119269a4b79a880b4adf78c1dec => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:55:04.575992 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-920153c0-67ad-41d6-b4be-a49b0acfeeda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc3ba3b746ce48e3ba8c73e1696ae204', 'request_id': 'req-920153c0-67ad-41d6-b4be-a49b0acfeeda'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:04.584540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-920153c0-67ad-41d6-b4be-a49b0acfeeda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc3ba3b746ce48e3ba8c73e1696ae204', 'request_id': 'req-920153c0-67ad-41d6-b4be-a49b0acfeeda'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:04.593568 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-920153c0-67ad-41d6-b4be-a49b0acfeeda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc3ba3b746ce48e3ba8c73e1696ae204', 'request_id': 'req-920153c0-67ad-41d6-b4be-a49b0acfeeda'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:04.609387 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-920153c0-67ad-41d6-b4be-a49b0acfeeda admin admin] The token cache is being invalidate because project fc3ba3b746ce48e3ba8c73e1696ae204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:55:04.609730 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-920153c0-67ad-41d6-b4be-a49b0acfeeda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:04.610404 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-920153c0-67ad-41d6-b4be-a49b0acfeeda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:04.612016 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1323/2636] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:55:04 2022] DELETE /identity/v3/projects/fc3ba3b746ce48e3ba8c73e1696ae204 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:55:04.791170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db216f-0909-4933-9334-e086082571fe admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:04.793942 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-f5db216f-0909-4933-9334-e086082571fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:04.896641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:04.903324 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db216f-0909-4933-9334-e086082571fe admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:04.967799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37eadf-bf83-479e-ad76-2057a8138672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:04.968687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37eadf-bf83-479e-ad76-2057a8138672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:04.968970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37eadf-bf83-479e-ad76-2057a8138672 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:04.969239 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37eadf-bf83-479e-ad76-2057a8138672 admin admin] PATH_INFO: `/v3/projects/deb2e26326d8462197eb7b9bd9f34916` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:04.970528 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37eadf-bf83-479e-ad76-2057a8138672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=deb2e26326d8462197eb7b9bd9f34916)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:04.972510 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37eadf-bf83-479e-ad76-2057a8138672 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:05.032537 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ea37eadf-bf83-479e-ad76-2057a8138672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb2e26326d8462197eb7b9bd9f34916', 'request_id': 'req-ea37eadf-bf83-479e-ad76-2057a8138672'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:05.042506 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ea37eadf-bf83-479e-ad76-2057a8138672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb2e26326d8462197eb7b9bd9f34916', 'request_id': 'req-ea37eadf-bf83-479e-ad76-2057a8138672'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:05.052533 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ea37eadf-bf83-479e-ad76-2057a8138672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb2e26326d8462197eb7b9bd9f34916', 'request_id': 'req-ea37eadf-bf83-479e-ad76-2057a8138672'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:05.069711 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ea37eadf-bf83-479e-ad76-2057a8138672 admin admin] The token cache is being invalidate because project deb2e26326d8462197eb7b9bd9f34916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:55:05.069991 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ea37eadf-bf83-479e-ad76-2057a8138672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:05.070731 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ea37eadf-bf83-479e-ad76-2057a8138672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:05.072558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1314/2637] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:55:04 2022] DELETE /identity/v3/projects/deb2e26326d8462197eb7b9bd9f34916 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:55:05.078695 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2496a40-be11-4514-ae62-75136e836101 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:05.078998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2496a40-be11-4514-ae62-75136e836101 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:05.079387 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2496a40-be11-4514-ae62-75136e836101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:05.102144 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-a2496a40-be11-4514-ae62-75136e836101 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:55:05.104136 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a2496a40-be11-4514-ae62-75136e836101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:05.150849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:05.174699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1324/2638] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:55:05.188443 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac37e1-606b-4583-87df-b26a3d35f2fb None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:05.188745 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac37e1-606b-4583-87df-b26a3d35f2fb None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:05.189057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac37e1-606b-4583-87df-b26a3d35f2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:05.220773 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-dcac37e1-606b-4583-87df-b26a3d35f2fb None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:55:05.222845 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-dcac37e1-606b-4583-87df-b26a3d35f2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:05.237197 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1315/2639] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:55:05.242393 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2496a40-be11-4514-ae62-75136e836101 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:05.259744 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2496a40-be11-4514-ae62-75136e836101 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:05.267440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aafc12-ba41-4a4a-ab6b-4ab9a7ea4dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:05.268137 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aafc12-ba41-4a4a-ab6b-4ab9a7ea4dbe admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:05.268425 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aafc12-ba41-4a4a-ab6b-4ab9a7ea4dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:05.268705 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aafc12-ba41-4a4a-ab6b-4ab9a7ea4dbe admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:05.269460 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aafc12-ba41-4a4a-ab6b-4ab9a7ea4dbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:55:05.269771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aafc12-ba41-4a4a-ab6b-4ab9a7ea4dbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:05.271452 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aafc12-ba41-4a4a-ab6b-4ab9a7ea4dbe admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:05.288309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1325/2640] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:55:05.292924 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac37e1-606b-4583-87df-b26a3d35f2fb None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:05.309723 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac37e1-606b-4583-87df-b26a3d35f2fb None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:05.318288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2a79d-d7bb-48ff-9ace-b502933d2827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:05.319280 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2a79d-d7bb-48ff-9ace-b502933d2827 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:05.319823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2a79d-d7bb-48ff-9ace-b502933d2827 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:05.320481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2a79d-d7bb-48ff-9ace-b502933d2827 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:05.321870 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2a79d-d7bb-48ff-9ace-b502933d2827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:05.325602 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2a79d-d7bb-48ff-9ace-b502933d2827 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:05.371060 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1316/2641] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:55:05 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:55:05.375416 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aafc12-ba41-4a4a-ab6b-4ab9a7ea4dbe admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:05.386833 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aafc12-ba41-4a4a-ab6b-4ab9a7ea4dbe admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:05.452025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6873f-275b-47a9-8d56-e0f24d72cf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:05.452825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6873f-275b-47a9-8d56-e0f24d72cf02 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:05.453155 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6873f-275b-47a9-8d56-e0f24d72cf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:05.453475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6873f-275b-47a9-8d56-e0f24d72cf02 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:05.454318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6873f-275b-47a9-8d56-e0f24d72cf02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:05.456417 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6873f-275b-47a9-8d56-e0f24d72cf02 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:05.480135 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1326/2642] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:55:05 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:55:05.486072 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2a79d-d7bb-48ff-9ace-b502933d2827 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:05.498578 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2a79d-d7bb-48ff-9ace-b502933d2827 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:05.505458 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c2976-9a03-4440-a923-49e6f763fcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:05.506633 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c2976-9a03-4440-a923-49e6f763fcbd admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:05.507022 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c2976-9a03-4440-a923-49e6f763fcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:05.507372 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c2976-9a03-4440-a923-49e6f763fcbd admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:05.508332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c2976-9a03-4440-a923-49e6f763fcbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:05.510241 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c2976-9a03-4440-a923-49e6f763fcbd admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:05.523573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1317/2643] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:55:05.528867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6873f-275b-47a9-8d56-e0f24d72cf02 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:05.547290 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6873f-275b-47a9-8d56-e0f24d72cf02 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:05.554328 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fcddeb-be77-4a67-992a-51e8ea050241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:05.555035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcddeb-be77-4a67-992a-51e8ea050241 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:05.555345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcddeb-be77-4a67-992a-51e8ea050241 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:05.555671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fcddeb-be77-4a67-992a-51e8ea050241 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:05.556361 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcddeb-be77-4a67-992a-51e8ea050241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:05.558036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fcddeb-be77-4a67-992a-51e8ea050241 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:05.569921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1327/2644] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:55:05.574420 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c2976-9a03-4440-a923-49e6f763fcbd admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:05.585508 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c2976-9a03-4440-a923-49e6f763fcbd admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:05.590411 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc668f5-cd6a-4574-b6d8-8f2456a3e358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:05.591365 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc668f5-cd6a-4574-b6d8-8f2456a3e358 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:05.591649 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc668f5-cd6a-4574-b6d8-8f2456a3e358 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:05.591947 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc668f5-cd6a-4574-b6d8-8f2456a3e358 admin admin] PATH_INFO: `/v3/projects/da9c60730376499090a0d325d433a0d5/users/27d115ae902a42c9b6c521e43d867440/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:05.608822 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc668f5-cd6a-4574-b6d8-8f2456a3e358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9c60730376499090a0d325d433a0d5, user_id=27d115ae902a42c9b6c521e43d867440, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:05.611556 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc668f5-cd6a-4574-b6d8-8f2456a3e358 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:05.628367 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1318/2645] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:55:05 2022] PUT /identity/v3/projects/da9c60730376499090a0d325d433a0d5/users/27d115ae902a42c9b6c521e43d867440/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:55:05.639293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87dbc6-3c4d-4234-af02-ef7abd978db3 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:05.639586 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87dbc6-3c4d-4234-af02-ef7abd978db3 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:05.639866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87dbc6-3c4d-4234-af02-ef7abd978db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:05.670790 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-8b87dbc6-3c4d-4234-af02-ef7abd978db3 None None] MFA Rules not processed for user `27d115ae902a42c9b6c521e43d867440`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:55:05.672065 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-8b87dbc6-3c4d-4234-af02-ef7abd978db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:05.753012 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1328/2646] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:55:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:55:05.757745 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc668f5-cd6a-4574-b6d8-8f2456a3e358 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:05.796052 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:05.850558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc668f5-cd6a-4574-b6d8-8f2456a3e358 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:05.858655 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b67a9-9f9b-44c4-abc1-5d37ce6a9096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:05.859797 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b67a9-9f9b-44c4-abc1-5d37ce6a9096 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:05.860273 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b67a9-9f9b-44c4-abc1-5d37ce6a9096 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:05.860740 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b67a9-9f9b-44c4-abc1-5d37ce6a9096 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:05.862018 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b67a9-9f9b-44c4-abc1-5d37ce6a9096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:05.865583 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b67a9-9f9b-44c4-abc1-5d37ce6a9096 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:05.908277 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1319/2647] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:55:05 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:55:05.912574 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87dbc6-3c4d-4234-af02-ef7abd978db3 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:05.926959 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87dbc6-3c4d-4234-af02-ef7abd978db3 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:05.986851 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:06.011844 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8ecea-d1e7-474c-9afe-04e035bac62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:06.012508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8ecea-d1e7-474c-9afe-04e035bac62c admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:06.012912 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8ecea-d1e7-474c-9afe-04e035bac62c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:06.013236 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8ecea-d1e7-474c-9afe-04e035bac62c admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:06.014020 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8ecea-d1e7-474c-9afe-04e035bac62c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:06.016067 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8ecea-d1e7-474c-9afe-04e035bac62c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:06.039568 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1329/2648] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:55:05 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:55:06.045334 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b67a9-9f9b-44c4-abc1-5d37ce6a9096 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:06.056598 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b67a9-9f9b-44c4-abc1-5d37ce6a9096 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:06.061716 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb9dab-0a77-4189-8c9b-cbe2d1f06834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:06.062408 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9dab-0a77-4189-8c9b-cbe2d1f06834 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:06.062694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9dab-0a77-4189-8c9b-cbe2d1f06834 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:06.062970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9dab-0a77-4189-8c9b-cbe2d1f06834 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:06.064247 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb9dab-0a77-4189-8c9b-cbe2d1f06834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:06.065853 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb9dab-0a77-4189-8c9b-cbe2d1f06834 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:06.077734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1320/2649] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:55:06.084692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8ecea-d1e7-474c-9afe-04e035bac62c admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:06.096292 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8ecea-d1e7-474c-9afe-04e035bac62c admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:06.101525 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f247656-7f02-4c8b-9d2e-f87c1011f8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:06.102426 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f247656-7f02-4c8b-9d2e-f87c1011f8cb admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:06.102708 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f247656-7f02-4c8b-9d2e-f87c1011f8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:06.102980 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f247656-7f02-4c8b-9d2e-f87c1011f8cb admin admin] PATH_INFO: `/v3/projects/2588d6ccfd744eeca047617a05c4286a/users/283e94c00abb4c0aac33f46876469eb2/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:06.120403 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f247656-7f02-4c8b-9d2e-f87c1011f8cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2588d6ccfd744eeca047617a05c4286a, user_id=283e94c00abb4c0aac33f46876469eb2, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:06.123148 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f247656-7f02-4c8b-9d2e-f87c1011f8cb admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:06.139493 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1330/2650] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:55:06 2022] PUT /identity/v3/projects/2588d6ccfd744eeca047617a05c4286a/users/283e94c00abb4c0aac33f46876469eb2/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:55:06.144453 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb9dab-0a77-4189-8c9b-cbe2d1f06834 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:06.155074 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb9dab-0a77-4189-8c9b-cbe2d1f06834 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:06.226262 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc7247-dffe-486c-9716-f0a2dbe0f77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:06.227384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc7247-dffe-486c-9716-f0a2dbe0f77a admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:06.227847 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc7247-dffe-486c-9716-f0a2dbe0f77a admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:06.228310 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc7247-dffe-486c-9716-f0a2dbe0f77a admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:06.229586 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc7247-dffe-486c-9716-f0a2dbe0f77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:06.232434 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc7247-dffe-486c-9716-f0a2dbe0f77a admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:06.250503 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1321/2651] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:55:06.257965 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f247656-7f02-4c8b-9d2e-f87c1011f8cb admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:06.274785 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f247656-7f02-4c8b-9d2e-f87c1011f8cb admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:06.280544 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b4a3d-87b7-4153-97c9-a274047e7bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:06.281705 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b4a3d-87b7-4153-97c9-a274047e7bd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:06.282113 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b4a3d-87b7-4153-97c9-a274047e7bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:06.282508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b4a3d-87b7-4153-97c9-a274047e7bd4 admin admin] PATH_INFO: `/v3/projects/2588d6ccfd744eeca047617a05c4286a/users/283e94c00abb4c0aac33f46876469eb2/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:06.285351 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b4a3d-87b7-4153-97c9-a274047e7bd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2588d6ccfd744eeca047617a05c4286a, user_id=283e94c00abb4c0aac33f46876469eb2, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:06.288368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b4a3d-87b7-4153-97c9-a274047e7bd4 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:06.300918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1331/2652] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:55:06 2022] PUT /identity/v3/projects/2588d6ccfd744eeca047617a05c4286a/users/283e94c00abb4c0aac33f46876469eb2/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:55:06.311081 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6bbbc-a712-4eb5-bc99-0c29434532dc None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:06.311407 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6bbbc-a712-4eb5-bc99-0c29434532dc None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:06.311693 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6bbbc-a712-4eb5-bc99-0c29434532dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:06.363908 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-d0b6bbbc-a712-4eb5-bc99-0c29434532dc None None] MFA Rules not processed for user `283e94c00abb4c0aac33f46876469eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:55:06.365320 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-d0b6bbbc-a712-4eb5-bc99-0c29434532dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:06.466850 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1322/2653] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:55:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:55:06.478963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b4a3d-87b7-4153-97c9-a274047e7bd4 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:06.481448 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-074b4a3d-87b7-4153-97c9-a274047e7bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:06.583447 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b4a3d-87b7-4153-97c9-a274047e7bd4 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:06.589562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b59d87-ef80-453f-bd86-621e7fe9d029 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:06.590661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b59d87-ef80-453f-bd86-621e7fe9d029 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:06.591149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b59d87-ef80-453f-bd86-621e7fe9d029 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:06.591671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b59d87-ef80-453f-bd86-621e7fe9d029 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:06.609134 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b59d87-ef80-453f-bd86-621e7fe9d029 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:06.612871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b59d87-ef80-453f-bd86-621e7fe9d029 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:06.627746 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1332/2654] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:55:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:55:06.717357 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6bbbc-a712-4eb5-bc99-0c29434532dc None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:06.728857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6bbbc-a712-4eb5-bc99-0c29434532dc None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:06.732894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893204c3-de8b-494b-a42c-4932065a495e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:06.733629 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893204c3-de8b-494b-a42c-4932065a495e service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:06.733967 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893204c3-de8b-494b-a42c-4932065a495e service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:06.734293 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893204c3-de8b-494b-a42c-4932065a495e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:06.758219 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:06.802818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893204c3-de8b-494b-a42c-4932065a495e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:06.804329 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893204c3-de8b-494b-a42c-4932065a495e service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:06.815377 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1323/2655] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:55:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:55:16.622463 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=51,keystone:INSERT=5 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:16.810024 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=17 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:21.624759 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb7c6f-0811-4250-9d8a-c95f7754cb22 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:21.625448 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb7c6f-0811-4250-9d8a-c95f7754cb22 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:21.625448 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb7c6f-0811-4250-9d8a-c95f7754cb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:21.645623 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-dbeb7c6f-0811-4250-9d8a-c95f7754cb22 None None] MFA Rules not processed for user `c8f314167aa94d81955ac761a5a28504`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:55:21.646864 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-dbeb7c6f-0811-4250-9d8a-c95f7754cb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:21.713889 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1333/2656] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jul 19 20:55:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:55:21.770464 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893204c3-de8b-494b-a42c-4932065a495e service cinder] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:21.771966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-893204c3-de8b-494b-a42c-4932065a495e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:21.874809 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893204c3-de8b-494b-a42c-4932065a495e service cinder] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:21.879993 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc7b9c-2f1e-4ea0-ba44-555cf307e4e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7987846276ad4ccd90899128ceb1354e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:21.880686 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc7b9c-2f1e-4ea0-ba44-555cf307e4e1 service swift] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:21.880971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc7b9c-2f1e-4ea0-ba44-555cf307e4e1 service swift] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:21.881247 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc7b9c-2f1e-4ea0-ba44-555cf307e4e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:21.891461 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc7b9c-2f1e-4ea0-ba44-555cf307e4e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:21.892420 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc7b9c-2f1e-4ea0-ba44-555cf307e4e1 service swift] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:21.901679 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1324/2657] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jul 19 20:55:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 20:55:31.706649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=25 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:31.897751 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=32 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:37.763095 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75189834-4087-4145-89ba-0e69a0cb7d8b None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:37.764062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75189834-4087-4145-89ba-0e69a0cb7d8b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:37.764062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75189834-4087-4145-89ba-0e69a0cb7d8b None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:37.765162 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1334/2658] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jul 19 20:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 20:55:37.780429 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3f732-a846-41a8-9a92-7d65aba0d05f None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:37.781930 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3f732-a846-41a8-9a92-7d65aba0d05f None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:37.781930 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3f732-a846-41a8-9a92-7d65aba0d05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:37.805538 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-c6d3f732-a846-41a8-9a92-7d65aba0d05f None None] MFA Rules not processed for user `6dbbb8f7b3f2449fb9c64ca3815b6c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:55:37.806916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-c6d3f732-a846-41a8-9a92-7d65aba0d05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:37.925824 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1325/2659] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jul 19 20:55:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:55:37.940742 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75189834-4087-4145-89ba-0e69a0cb7d8b None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:37.943519 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-75189834-4087-4145-89ba-0e69a0cb7d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:38.023576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75189834-4087-4145-89ba-0e69a0cb7d8b None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:38.027617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd11e3-98a9-4baa-999f-74e332d236bd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d9a41e10cb64ee9972debaf856503d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:38.028284 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd11e3-98a9-4baa-999f-74e332d236bd service glance] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:38.028566 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd11e3-98a9-4baa-999f-74e332d236bd service glance] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:38.028843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd11e3-98a9-4baa-999f-74e332d236bd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:38.041196 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd11e3-98a9-4baa-999f-74e332d236bd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:38.042647 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fd11e3-98a9-4baa-999f-74e332d236bd service glance] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:38.055246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1335/2660] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:55:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:55:38.135735 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a40fc-cd77-4d84-aa1f-6e04e2ade480 None None] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:38.136156 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a40fc-cd77-4d84-aa1f-6e04e2ade480 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:38.136566 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a40fc-cd77-4d84-aa1f-6e04e2ade480 None None] PATH_INFO: `/` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:38.138179 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1326/2661] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jul 19 20:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:55:38.144740 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37cc1f-ad85-4b1c-84c6-08ed75155837 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:38.144955 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37cc1f-ad85-4b1c-84c6-08ed75155837 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:38.145284 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37cc1f-ad85-4b1c-84c6-08ed75155837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:38.164812 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-ee37cc1f-ad85-4b1c-84c6-08ed75155837 None None] MFA Rules not processed for user `5b2c0f24d666462aa14ea4eee0592062`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:55:38.166209 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ee37cc1f-ad85-4b1c-84c6-08ed75155837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:38.222658 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1336/2662] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jul 19 20:55:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:55:38.235770 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a40fc-cd77-4d84-aa1f-6e04e2ade480 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:38.237711 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-831a40fc-cd77-4d84-aa1f-6e04e2ade480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:38.252660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a40fc-cd77-4d84-aa1f-6e04e2ade480 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:38.256870 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bf95b-6c03-48e3-b6fb-1bdac00e6a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:38.257529 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bf95b-6c03-48e3-b6fb-1bdac00e6a66 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:38.257813 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bf95b-6c03-48e3-b6fb-1bdac00e6a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:38.258088 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bf95b-6c03-48e3-b6fb-1bdac00e6a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:38.266303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069bf95b-6c03-48e3-b6fb-1bdac00e6a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:38.267956 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069bf95b-6c03-48e3-b6fb-1bdac00e6a66 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:38.276800 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1327/2663] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:55:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:55:38.375737 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ac619-6b61-4ec7-b530-55189d529d95 None None] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:38.376230 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ac619-6b61-4ec7-b530-55189d529d95 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:38.376577 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ac619-6b61-4ec7-b530-55189d529d95 None None] PATH_INFO: `/` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:38.378145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1337/2664] 10.222.0.77 () {54 vars in 921 bytes} [Tue Jul 19 20:55:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 20:55:38.387855 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c81bff-8eae-4d27-be83-846ce3489d29 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:38.388359 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c81bff-8eae-4d27-be83-846ce3489d29 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:38.388841 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c81bff-8eae-4d27-be83-846ce3489d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:38.418367 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-f1c81bff-8eae-4d27-be83-846ce3489d29 None None] MFA Rules not processed for user `6dbbb8f7b3f2449fb9c64ca3815b6c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:55:38.419614 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-f1c81bff-8eae-4d27-be83-846ce3489d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:38.430479 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1328/2665] 10.222.0.77 () {58 vars in 1018 bytes} [Tue Jul 19 20:55:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:55:38.442108 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ac619-6b61-4ec7-b530-55189d529d95 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:38.455051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ac619-6b61-4ec7-b530-55189d529d95 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:38.458897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dee1f-2914-4bb4-ba18-3d740dd69ada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:38.459672 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dee1f-2914-4bb4-ba18-3d740dd69ada service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:38.460001 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dee1f-2914-4bb4-ba18-3d740dd69ada service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:38.460321 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dee1f-2914-4bb4-ba18-3d740dd69ada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:38.472500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dee1f-2914-4bb4-ba18-3d740dd69ada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:38.474003 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dee1f-2914-4bb4-ba18-3d740dd69ada service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:38.487300 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1338/2666] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:55:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:55:39.121420 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c81bff-8eae-4d27-be83-846ce3489d29 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:39.256550 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c81bff-8eae-4d27-be83-846ce3489d29 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:39.267012 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed612a5d-a275-4bb9-af13-02f49517944c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:39.268452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed612a5d-a275-4bb9-af13-02f49517944c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:39.268786 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed612a5d-a275-4bb9-af13-02f49517944c admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:39.269146 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed612a5d-a275-4bb9-af13-02f49517944c admin admin] PATH_INFO: `/v3/users/27d115ae902a42c9b6c521e43d867440` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:39.270815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed612a5d-a275-4bb9-af13-02f49517944c admin admin] RBAC: Authorizing `identity:delete_user(user_id=27d115ae902a42c9b6c521e43d867440)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:39.273059 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed612a5d-a275-4bb9-af13-02f49517944c admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:39.345853 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ed612a5d-a275-4bb9-af13-02f49517944c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27d115ae902a42c9b6c521e43d867440'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:39.356810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ed612a5d-a275-4bb9-af13-02f49517944c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27d115ae902a42c9b6c521e43d867440'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:39.376823 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ed612a5d-a275-4bb9-af13-02f49517944c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27d115ae902a42c9b6c521e43d867440'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:39.379287 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ed612a5d-a275-4bb9-af13-02f49517944c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27d115ae902a42c9b6c521e43d867440'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:39.384583 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:39.398587 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ed612a5d-a275-4bb9-af13-02f49517944c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27d115ae902a42c9b6c521e43d867440'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:39.407949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1329/2667] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:55:39 2022] DELETE /identity/v3/users/27d115ae902a42c9b6c521e43d867440 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:55:39.414020 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119fc60-a08f-4bec-83be-b46b105b4d39 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:39.414867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119fc60-a08f-4bec-83be-b46b105b4d39 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:39.414867 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119fc60-a08f-4bec-83be-b46b105b4d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:39.435074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-d119fc60-a08f-4bec-83be-b46b105b4d39 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:55:39.436359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d119fc60-a08f-4bec-83be-b46b105b4d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:39.501704 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1339/2668] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:55:39.514495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed612a5d-a275-4bb9-af13-02f49517944c admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:39.516500 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-ed612a5d-a275-4bb9-af13-02f49517944c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:39.590098 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed612a5d-a275-4bb9-af13-02f49517944c admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:39.594526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10369562-b12e-4753-b4aa-5842512da9b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:39.595191 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10369562-b12e-4753-b4aa-5842512da9b1 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:39.595517 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10369562-b12e-4753-b4aa-5842512da9b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:39.595788 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10369562-b12e-4753-b4aa-5842512da9b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:39.605761 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10369562-b12e-4753-b4aa-5842512da9b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:39.607210 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10369562-b12e-4753-b4aa-5842512da9b1 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:39.618558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1330/2669] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:55:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:55:40.079346 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119fc60-a08f-4bec-83be-b46b105b4d39 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:40.080839 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d119fc60-a08f-4bec-83be-b46b105b4d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:40.093231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119fc60-a08f-4bec-83be-b46b105b4d39 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:40.098727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f07b8c-8cbe-45d3-99cc-d666d13dbcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:40.099866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f07b8c-8cbe-45d3-99cc-d666d13dbcad admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:40.100225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f07b8c-8cbe-45d3-99cc-d666d13dbcad admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:40.100596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f07b8c-8cbe-45d3-99cc-d666d13dbcad admin admin] PATH_INFO: `/v3/projects/da9c60730376499090a0d325d433a0d5` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:40.101953 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f07b8c-8cbe-45d3-99cc-d666d13dbcad admin admin] RBAC: Authorizing `identity:delete_project(project_id=da9c60730376499090a0d325d433a0d5)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:40.104227 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f07b8c-8cbe-45d3-99cc-d666d13dbcad admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:40.153850 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:40.167108 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-48f07b8c-8cbe-45d3-99cc-d666d13dbcad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9c60730376499090a0d325d433a0d5', 'request_id': 'req-48f07b8c-8cbe-45d3-99cc-d666d13dbcad'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:40.173983 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-48f07b8c-8cbe-45d3-99cc-d666d13dbcad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9c60730376499090a0d325d433a0d5', 'request_id': 'req-48f07b8c-8cbe-45d3-99cc-d666d13dbcad'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:40.182777 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-48f07b8c-8cbe-45d3-99cc-d666d13dbcad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9c60730376499090a0d325d433a0d5', 'request_id': 'req-48f07b8c-8cbe-45d3-99cc-d666d13dbcad'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:40.197036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-48f07b8c-8cbe-45d3-99cc-d666d13dbcad admin admin] The token cache is being invalidate because project da9c60730376499090a0d325d433a0d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:55:40.199871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-48f07b8c-8cbe-45d3-99cc-d666d13dbcad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:40.199871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-48f07b8c-8cbe-45d3-99cc-d666d13dbcad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:40.199871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1340/2670] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:55:40 2022] DELETE /identity/v3/projects/da9c60730376499090a0d325d433a0d5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:55:40.204182 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10369562-b12e-4753-b4aa-5842512da9b1 service neutron] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:40.214562 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10369562-b12e-4753-b4aa-5842512da9b1 service neutron] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:40.287480 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae838b-72b8-40fd-87bb-23b467ff48bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:40.288431 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae838b-72b8-40fd-87bb-23b467ff48bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:40.288761 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae838b-72b8-40fd-87bb-23b467ff48bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:40.289128 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae838b-72b8-40fd-87bb-23b467ff48bf admin admin] PATH_INFO: `/v3/users/283e94c00abb4c0aac33f46876469eb2` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:40.290247 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae838b-72b8-40fd-87bb-23b467ff48bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=283e94c00abb4c0aac33f46876469eb2)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:40.292662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae838b-72b8-40fd-87bb-23b467ff48bf admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:40.364582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-49ae838b-72b8-40fd-87bb-23b467ff48bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '283e94c00abb4c0aac33f46876469eb2'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:40.376548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-49ae838b-72b8-40fd-87bb-23b467ff48bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '283e94c00abb4c0aac33f46876469eb2'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:40.396818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-49ae838b-72b8-40fd-87bb-23b467ff48bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '283e94c00abb4c0aac33f46876469eb2'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:40.397582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-49ae838b-72b8-40fd-87bb-23b467ff48bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '283e94c00abb4c0aac33f46876469eb2'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:40.407192 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-49ae838b-72b8-40fd-87bb-23b467ff48bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '283e94c00abb4c0aac33f46876469eb2'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:40.414858 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1331/2671] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:55:40 2022] DELETE /identity/v3/users/283e94c00abb4c0aac33f46876469eb2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:55:40.785770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de08b6-5423-48cb-a385-f65985ca04d3 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:40.786330 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de08b6-5423-48cb-a385-f65985ca04d3 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:40.786330 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de08b6-5423-48cb-a385-f65985ca04d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:40.801629 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae838b-72b8-40fd-87bb-23b467ff48bf admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:40.805159 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-49ae838b-72b8-40fd-87bb-23b467ff48bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:40.814304 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-30de08b6-5423-48cb-a385-f65985ca04d3 None None] MFA Rules not processed for user `c8f314167aa94d81955ac761a5a28504`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:55:40.816486 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-30de08b6-5423-48cb-a385-f65985ca04d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:40.842209 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:40.906182 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1341/2672] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jul 19 20:55:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:55:40.922244 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de08b6-5423-48cb-a385-f65985ca04d3 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:40.922495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae838b-72b8-40fd-87bb-23b467ff48bf admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:40.923729 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-30de08b6-5423-48cb-a385-f65985ca04d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:40.927351 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3b88a-fbfc-4505-8b5f-b18a41a99f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:40.928257 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3b88a-fbfc-4505-8b5f-b18a41a99f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:40.928580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3b88a-fbfc-4505-8b5f-b18a41a99f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:40.928866 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3b88a-fbfc-4505-8b5f-b18a41a99f54 admin admin] PATH_INFO: `/v3/projects/2588d6ccfd744eeca047617a05c4286a` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:40.930168 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3b88a-fbfc-4505-8b5f-b18a41a99f54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2588d6ccfd744eeca047617a05c4286a)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:40.932160 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3b88a-fbfc-4505-8b5f-b18a41a99f54 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:40.991634 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ffc3b88a-fbfc-4505-8b5f-b18a41a99f54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2588d6ccfd744eeca047617a05c4286a', 'request_id': 'req-ffc3b88a-fbfc-4505-8b5f-b18a41a99f54'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:41.002542 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ffc3b88a-fbfc-4505-8b5f-b18a41a99f54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2588d6ccfd744eeca047617a05c4286a', 'request_id': 'req-ffc3b88a-fbfc-4505-8b5f-b18a41a99f54'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:41.012870 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ffc3b88a-fbfc-4505-8b5f-b18a41a99f54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2588d6ccfd744eeca047617a05c4286a', 'request_id': 'req-ffc3b88a-fbfc-4505-8b5f-b18a41a99f54'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:41.031072 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de08b6-5423-48cb-a385-f65985ca04d3 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:41.033193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ffc3b88a-fbfc-4505-8b5f-b18a41a99f54 admin admin] The token cache is being invalidate because project 2588d6ccfd744eeca047617a05c4286a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:55:41.033644 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ffc3b88a-fbfc-4505-8b5f-b18a41a99f54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:41.034800 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-ffc3b88a-fbfc-4505-8b5f-b18a41a99f54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:41.037636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1332/2673] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:55:40 2022] DELETE /identity/v3/projects/2588d6ccfd744eeca047617a05c4286a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:55:41.044974 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2253995-d6e6-4f34-8246-905dc3bbdcd9 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:41.045532 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2253995-d6e6-4f34-8246-905dc3bbdcd9 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:41.045958 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2253995-d6e6-4f34-8246-905dc3bbdcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:41.068416 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-a2253995-d6e6-4f34-8246-905dc3bbdcd9 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:55:41.069657 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-a2253995-d6e6-4f34-8246-905dc3bbdcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:41.102874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3788a-b01d-4090-acb5-a1e48a6f4edb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7987846276ad4ccd90899128ceb1354e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:41.103498 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3788a-b01d-4090-acb5-a1e48a6f4edb service swift] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:41.103787 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3788a-b01d-4090-acb5-a1e48a6f4edb service swift] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:41.104062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3788a-b01d-4090-acb5-a1e48a6f4edb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:41.106173 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d9b3788a-b01d-4090-acb5-a1e48a6f4edb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:41.121225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:41.151938 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1333/2674] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:55:41.154880 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32621c1-68b7-483b-8f83-9e3aeed9d4e4 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:41.155444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32621c1-68b7-483b-8f83-9e3aeed9d4e4 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:41.155847 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32621c1-68b7-483b-8f83-9e3aeed9d4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:41.177285 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-a32621c1-68b7-483b-8f83-9e3aeed9d4e4 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:55:41.178541 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-a32621c1-68b7-483b-8f83-9e3aeed9d4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:41.183781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3788a-b01d-4090-acb5-a1e48a6f4edb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:41.185411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3788a-b01d-4090-acb5-a1e48a6f4edb service swift] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:41.187013 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1334/2675] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:55:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:55:41.191652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32621c1-68b7-483b-8f83-9e3aeed9d4e4 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:41.195062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1342/2676] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jul 19 20:55:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 20:55:41.204668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32621c1-68b7-483b-8f83-9e3aeed9d4e4 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:41.210068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316eefeb-1426-47f3-b0be-90487956f4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:41.210789 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316eefeb-1426-47f3-b0be-90487956f4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:41.211078 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316eefeb-1426-47f3-b0be-90487956f4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:41.211434 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316eefeb-1426-47f3-b0be-90487956f4d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:41.212330 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316eefeb-1426-47f3-b0be-90487956f4d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:55:41.212768 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316eefeb-1426-47f3-b0be-90487956f4d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:41.214299 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316eefeb-1426-47f3-b0be-90487956f4d0 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:41.228849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1335/2677] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:55:41.233121 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3788a-b01d-4090-acb5-a1e48a6f4edb service swift] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:41.246849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3788a-b01d-4090-acb5-a1e48a6f4edb service swift] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:41.252176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543dd34-4d37-4b12-9f30-7e185a4de74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:41.252859 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543dd34-4d37-4b12-9f30-7e185a4de74f admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:41.253142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543dd34-4d37-4b12-9f30-7e185a4de74f admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:41.253423 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543dd34-4d37-4b12-9f30-7e185a4de74f admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:41.254147 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543dd34-4d37-4b12-9f30-7e185a4de74f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:41.256099 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543dd34-4d37-4b12-9f30-7e185a4de74f admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:41.299217 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1343/2678] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:55:41 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:55:41.303603 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316eefeb-1426-47f3-b0be-90487956f4d0 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:41.318916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316eefeb-1426-47f3-b0be-90487956f4d0 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:41.348125 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:41.409817 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7bad0-88bd-4c59-9df8-e3d098b46ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:41.410702 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7bad0-88bd-4c59-9df8-e3d098b46ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:41.411092 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7bad0-88bd-4c59-9df8-e3d098b46ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:41.411758 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7bad0-88bd-4c59-9df8-e3d098b46ed5 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:41.413028 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7bad0-88bd-4c59-9df8-e3d098b46ed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:41.415965 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7bad0-88bd-4c59-9df8-e3d098b46ed5 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:41.455251 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1336/2679] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:55:41 2022] POST /identity/v3/users => generated 283 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:55:41.460371 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543dd34-4d37-4b12-9f30-7e185a4de74f admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:41.488945 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543dd34-4d37-4b12-9f30-7e185a4de74f admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:41.512323 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f3d83-2ba2-4a59-a6dc-5c853b283225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:41.514493 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f3d83-2ba2-4a59-a6dc-5c853b283225 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:41.516814 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f3d83-2ba2-4a59-a6dc-5c853b283225 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:41.518026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f3d83-2ba2-4a59-a6dc-5c853b283225 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:41.529932 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f3d83-2ba2-4a59-a6dc-5c853b283225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:41.535728 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f3d83-2ba2-4a59-a6dc-5c853b283225 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:41.569338 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1344/2680] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:55:41.573737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7bad0-88bd-4c59-9df8-e3d098b46ed5 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:41.593179 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7bad0-88bd-4c59-9df8-e3d098b46ed5 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:41.602439 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde2cff-66cc-4bdd-9805-3342af4a7e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:41.603759 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde2cff-66cc-4bdd-9805-3342af4a7e89 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:41.604390 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde2cff-66cc-4bdd-9805-3342af4a7e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:41.605038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde2cff-66cc-4bdd-9805-3342af4a7e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:41.606375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde2cff-66cc-4bdd-9805-3342af4a7e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:41.609812 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde2cff-66cc-4bdd-9805-3342af4a7e89 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:41.641642 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1337/2681] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:55:41.643068 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f3d83-2ba2-4a59-a6dc-5c853b283225 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:41.654121 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f3d83-2ba2-4a59-a6dc-5c853b283225 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:41.679616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82134fe9-1b7f-4d41-ae58-859389378822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:41.679616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82134fe9-1b7f-4d41-ae58-859389378822 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:41.679616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82134fe9-1b7f-4d41-ae58-859389378822 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:41.679616 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82134fe9-1b7f-4d41-ae58-859389378822 admin admin] PATH_INFO: `/v3/projects/0b8b6184f8664bca8aca8e9faffd3bc8/users/f0a1eb6a24954add959a58eab9bfb6a0/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:41.713453 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82134fe9-1b7f-4d41-ae58-859389378822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8b6184f8664bca8aca8e9faffd3bc8, user_id=f0a1eb6a24954add959a58eab9bfb6a0, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:41.716190 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82134fe9-1b7f-4d41-ae58-859389378822 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:41.746578 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1345/2682] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:55:41 2022] PUT /identity/v3/projects/0b8b6184f8664bca8aca8e9faffd3bc8/users/f0a1eb6a24954add959a58eab9bfb6a0/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:55:41.756881 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329db5b-bb74-4d66-a333-4e03115617fa None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:41.757455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329db5b-bb74-4d66-a333-4e03115617fa None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:41.757895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329db5b-bb74-4d66-a333-4e03115617fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:41.802373 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-5329db5b-bb74-4d66-a333-4e03115617fa None None] MFA Rules not processed for user `f0a1eb6a24954add959a58eab9bfb6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:55:41.804090 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-5329db5b-bb74-4d66-a333-4e03115617fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:41.931230 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1338/2683] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:55:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:55:41.935617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82134fe9-1b7f-4d41-ae58-859389378822 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:42.031954 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82134fe9-1b7f-4d41-ae58-859389378822 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:42.040816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be50ec-5560-4a85-a339-848bef077ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:42.041653 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be50ec-5560-4a85-a339-848bef077ebb admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:42.041939 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be50ec-5560-4a85-a339-848bef077ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:42.042216 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be50ec-5560-4a85-a339-848bef077ebb admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:42.043001 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be50ec-5560-4a85-a339-848bef077ebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:42.045466 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be50ec-5560-4a85-a339-848bef077ebb admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:42.079462 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1346/2684] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:55:41 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:55:42.081739 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329db5b-bb74-4d66-a333-4e03115617fa None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:42.093812 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329db5b-bb74-4d66-a333-4e03115617fa None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:42.163635 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcc951-7937-4ea7-8dda-47783a33747c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:42.164342 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcc951-7937-4ea7-8dda-47783a33747c admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:42.164655 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcc951-7937-4ea7-8dda-47783a33747c admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:42.164969 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcc951-7937-4ea7-8dda-47783a33747c admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:42.165986 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcc951-7937-4ea7-8dda-47783a33747c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:42.168121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcc951-7937-4ea7-8dda-47783a33747c admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:42.196954 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1339/2685] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:55:42 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:55:42.203108 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be50ec-5560-4a85-a339-848bef077ebb admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:42.232120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be50ec-5560-4a85-a339-848bef077ebb admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:42.249924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd089e07-503b-4a3d-8b41-9f1bf788baaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:42.251175 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd089e07-503b-4a3d-8b41-9f1bf788baaa admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:42.252067 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd089e07-503b-4a3d-8b41-9f1bf788baaa admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:42.252067 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd089e07-503b-4a3d-8b41-9f1bf788baaa admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:42.252556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd089e07-503b-4a3d-8b41-9f1bf788baaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:42.254229 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd089e07-503b-4a3d-8b41-9f1bf788baaa admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:42.278554 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1347/2686] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:55:42.282669 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcc951-7937-4ea7-8dda-47783a33747c admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:42.294574 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcc951-7937-4ea7-8dda-47783a33747c admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:42.300876 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf98c6-0eb5-43e9-88bd-157525e3a6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:42.301880 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf98c6-0eb5-43e9-88bd-157525e3a6ec admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:42.302243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf98c6-0eb5-43e9-88bd-157525e3a6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:42.302595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf98c6-0eb5-43e9-88bd-157525e3a6ec admin admin] PATH_INFO: `/v3/projects/05ae806cc7ca460587a078832dc6601e/users/5ed65835e9a948d9989c2862a92c87d2/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:42.321523 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf98c6-0eb5-43e9-88bd-157525e3a6ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ae806cc7ca460587a078832dc6601e, user_id=5ed65835e9a948d9989c2862a92c87d2, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:42.324437 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf98c6-0eb5-43e9-88bd-157525e3a6ec admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:42.340241 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:42.352681 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1340/2687] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:55:42 2022] PUT /identity/v3/projects/05ae806cc7ca460587a078832dc6601e/users/5ed65835e9a948d9989c2862a92c87d2/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:55:42.354551 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd089e07-503b-4a3d-8b41-9f1bf788baaa admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:42.371512 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd089e07-503b-4a3d-8b41-9f1bf788baaa admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:42.405082 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:42.472683 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb55deb-a44f-4e92-a02b-109c14274800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:42.473705 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb55deb-a44f-4e92-a02b-109c14274800 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:42.474089 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb55deb-a44f-4e92-a02b-109c14274800 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:42.474591 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb55deb-a44f-4e92-a02b-109c14274800 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:42.475548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb55deb-a44f-4e92-a02b-109c14274800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:42.477705 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb55deb-a44f-4e92-a02b-109c14274800 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:42.491203 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1348/2688] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:55:42.496649 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf98c6-0eb5-43e9-88bd-157525e3a6ec admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:42.520636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf98c6-0eb5-43e9-88bd-157525e3a6ec admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:42.529478 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29cc6d-0f4d-4b7f-9d6b-c520e3d21e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:42.531049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29cc6d-0f4d-4b7f-9d6b-c520e3d21e84 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:42.531534 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29cc6d-0f4d-4b7f-9d6b-c520e3d21e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:42.531690 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc29cc6d-0f4d-4b7f-9d6b-c520e3d21e84 admin admin] PATH_INFO: `/v3/projects/05ae806cc7ca460587a078832dc6601e/users/5ed65835e9a948d9989c2862a92c87d2/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:42.535070 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc29cc6d-0f4d-4b7f-9d6b-c520e3d21e84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ae806cc7ca460587a078832dc6601e, user_id=5ed65835e9a948d9989c2862a92c87d2, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:42.540236 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc29cc6d-0f4d-4b7f-9d6b-c520e3d21e84 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:42.559929 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1341/2689] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:55:42 2022] PUT /identity/v3/projects/05ae806cc7ca460587a078832dc6601e/users/5ed65835e9a948d9989c2862a92c87d2/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:55:42.579224 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e61a8-58f7-4577-bbae-1a693b32a045 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:42.581941 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e61a8-58f7-4577-bbae-1a693b32a045 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:42.581941 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e61a8-58f7-4577-bbae-1a693b32a045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:42.622669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-768e61a8-58f7-4577-bbae-1a693b32a045 None None] MFA Rules not processed for user `5ed65835e9a948d9989c2862a92c87d2`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:55:42.623979 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-768e61a8-58f7-4577-bbae-1a693b32a045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:42.716114 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1349/2690] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:55:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:55:42.727586 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29cc6d-0f4d-4b7f-9d6b-c520e3d21e84 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:42.730208 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-dc29cc6d-0f4d-4b7f-9d6b-c520e3d21e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:42.849660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc29cc6d-0f4d-4b7f-9d6b-c520e3d21e84 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:42.856814 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d511b-83c9-4369-bac6-512f6a3acd31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:42.858089 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d511b-83c9-4369-bac6-512f6a3acd31 service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:42.858700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d511b-83c9-4369-bac6-512f6a3acd31 service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:42.859604 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d511b-83c9-4369-bac6-512f6a3acd31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:42.880593 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d511b-83c9-4369-bac6-512f6a3acd31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:42.893988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d511b-83c9-4369-bac6-512f6a3acd31 service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:42.926194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1342/2691] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:55:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:55:43.746709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e61a8-58f7-4577-bbae-1a693b32a045 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:43.845726 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e61a8-58f7-4577-bbae-1a693b32a045 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:43.857767 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f311a91-02c4-42d4-a93a-48c04ff31322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:43.858776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f311a91-02c4-42d4-a93a-48c04ff31322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:43.859132 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f311a91-02c4-42d4-a93a-48c04ff31322 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:43.860051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f311a91-02c4-42d4-a93a-48c04ff31322 admin admin] PATH_INFO: `/v3/users/f0a1eb6a24954add959a58eab9bfb6a0` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:43.861380 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f311a91-02c4-42d4-a93a-48c04ff31322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a1eb6a24954add959a58eab9bfb6a0)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:43.863485 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f311a91-02c4-42d4-a93a-48c04ff31322 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:43.974164 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-3f311a91-02c4-42d4-a93a-48c04ff31322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a1eb6a24954add959a58eab9bfb6a0'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:43.984467 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:43.991950 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-3f311a91-02c4-42d4-a93a-48c04ff31322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a1eb6a24954add959a58eab9bfb6a0'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:44.023639 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-3f311a91-02c4-42d4-a93a-48c04ff31322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a1eb6a24954add959a58eab9bfb6a0'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:44.039821 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-3f311a91-02c4-42d4-a93a-48c04ff31322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a1eb6a24954add959a58eab9bfb6a0'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:44.040811 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-3f311a91-02c4-42d4-a93a-48c04ff31322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a1eb6a24954add959a58eab9bfb6a0'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:44.050081 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1350/2692] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:55:43 2022] DELETE /identity/v3/users/f0a1eb6a24954add959a58eab9bfb6a0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:55:44.054692 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e92909-6da9-48ab-a2a2-32caea111c43 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:44.055736 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e92909-6da9-48ab-a2a2-32caea111c43 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:44.055736 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e92909-6da9-48ab-a2a2-32caea111c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:44.076645 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-85e92909-6da9-48ab-a2a2-32caea111c43 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:55:44.079242 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-85e92909-6da9-48ab-a2a2-32caea111c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:44.175057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1343/2693] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:55:44.185956 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f311a91-02c4-42d4-a93a-48c04ff31322 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:44.188105 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3f311a91-02c4-42d4-a93a-48c04ff31322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:44.299804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f311a91-02c4-42d4-a93a-48c04ff31322 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:44.308067 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82630008-2e07-4bed-b633-c2300db69865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:44.308778 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82630008-2e07-4bed-b633-c2300db69865 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:44.309033 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82630008-2e07-4bed-b633-c2300db69865 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:44.309318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82630008-2e07-4bed-b633-c2300db69865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:44.360453 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82630008-2e07-4bed-b633-c2300db69865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:44.376792 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82630008-2e07-4bed-b633-c2300db69865 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:44.402774 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1351/2694] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:55:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:55:45.025048 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e92909-6da9-48ab-a2a2-32caea111c43 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:45.026783 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-85e92909-6da9-48ab-a2a2-32caea111c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:45.050801 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e92909-6da9-48ab-a2a2-32caea111c43 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:45.075465 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b79a16-a513-4aa9-897b-87244dea4524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:45.079476 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b79a16-a513-4aa9-897b-87244dea4524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:45.080270 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b79a16-a513-4aa9-897b-87244dea4524 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:45.082164 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b79a16-a513-4aa9-897b-87244dea4524 admin admin] PATH_INFO: `/v3/projects/0b8b6184f8664bca8aca8e9faffd3bc8` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:45.086629 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b79a16-a513-4aa9-897b-87244dea4524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b8b6184f8664bca8aca8e9faffd3bc8)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:45.093068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b79a16-a513-4aa9-897b-87244dea4524 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:45.224436 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-f2b79a16-a513-4aa9-897b-87244dea4524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b8b6184f8664bca8aca8e9faffd3bc8', 'request_id': 'req-f2b79a16-a513-4aa9-897b-87244dea4524'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:45.237893 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-f2b79a16-a513-4aa9-897b-87244dea4524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b8b6184f8664bca8aca8e9faffd3bc8', 'request_id': 'req-f2b79a16-a513-4aa9-897b-87244dea4524'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:45.246404 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-f2b79a16-a513-4aa9-897b-87244dea4524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b8b6184f8664bca8aca8e9faffd3bc8', 'request_id': 'req-f2b79a16-a513-4aa9-897b-87244dea4524'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:45.270794 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-f2b79a16-a513-4aa9-897b-87244dea4524 admin admin] The token cache is being invalidate because project 0b8b6184f8664bca8aca8e9faffd3bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:55:45.272162 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-f2b79a16-a513-4aa9-897b-87244dea4524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:45.273547 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-f2b79a16-a513-4aa9-897b-87244dea4524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:45.281700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1344/2695] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:55:45 2022] DELETE /identity/v3/projects/0b8b6184f8664bca8aca8e9faffd3bc8 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:55:45.283614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82630008-2e07-4bed-b633-c2300db69865 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:45.301588 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82630008-2e07-4bed-b633-c2300db69865 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:45.408197 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39953e-464a-44a4-9a95-5365744f9790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:45.409096 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39953e-464a-44a4-9a95-5365744f9790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:45.409382 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39953e-464a-44a4-9a95-5365744f9790 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:45.409656 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39953e-464a-44a4-9a95-5365744f9790 admin admin] PATH_INFO: `/v3/users/5ed65835e9a948d9989c2862a92c87d2` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:45.410935 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39953e-464a-44a4-9a95-5365744f9790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed65835e9a948d9989c2862a92c87d2)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:45.412919 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39953e-464a-44a4-9a95-5365744f9790 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:45.506191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-0c39953e-464a-44a4-9a95-5365744f9790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed65835e9a948d9989c2862a92c87d2'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:45.514335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-0c39953e-464a-44a4-9a95-5365744f9790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed65835e9a948d9989c2862a92c87d2'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:45.540861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-0c39953e-464a-44a4-9a95-5365744f9790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed65835e9a948d9989c2862a92c87d2'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:45.543277 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:45.553319 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-0c39953e-464a-44a4-9a95-5365744f9790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed65835e9a948d9989c2862a92c87d2'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:45.554537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-0c39953e-464a-44a4-9a95-5365744f9790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed65835e9a948d9989c2862a92c87d2'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:45.573766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1352/2696] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:55:45 2022] DELETE /identity/v3/users/5ed65835e9a948d9989c2862a92c87d2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:55:46.017345 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b79a16-a513-4aa9-897b-87244dea4524 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:46.019511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-f2b79a16-a513-4aa9-897b-87244dea4524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:46.049622 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b79a16-a513-4aa9-897b-87244dea4524 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:46.098939 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:46.211889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462dbb96-5762-4bf5-b6a9-30cdaa6a7d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:46.219758 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dbb96-5762-4bf5-b6a9-30cdaa6a7d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:46.221264 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dbb96-5762-4bf5-b6a9-30cdaa6a7d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:46.222080 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dbb96-5762-4bf5-b6a9-30cdaa6a7d12 admin admin] PATH_INFO: `/v3/projects/05ae806cc7ca460587a078832dc6601e` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:46.224338 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462dbb96-5762-4bf5-b6a9-30cdaa6a7d12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ae806cc7ca460587a078832dc6601e)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:46.232904 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462dbb96-5762-4bf5-b6a9-30cdaa6a7d12 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:46.311405 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-462dbb96-5762-4bf5-b6a9-30cdaa6a7d12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ae806cc7ca460587a078832dc6601e', 'request_id': 'req-462dbb96-5762-4bf5-b6a9-30cdaa6a7d12'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:46.331079 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-462dbb96-5762-4bf5-b6a9-30cdaa6a7d12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ae806cc7ca460587a078832dc6601e', 'request_id': 'req-462dbb96-5762-4bf5-b6a9-30cdaa6a7d12'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:46.343182 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-462dbb96-5762-4bf5-b6a9-30cdaa6a7d12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ae806cc7ca460587a078832dc6601e', 'request_id': 'req-462dbb96-5762-4bf5-b6a9-30cdaa6a7d12'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:46.372374 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-462dbb96-5762-4bf5-b6a9-30cdaa6a7d12 admin admin] The token cache is being invalidate because project 05ae806cc7ca460587a078832dc6601e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:55:46.372882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-462dbb96-5762-4bf5-b6a9-30cdaa6a7d12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:46.374477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-462dbb96-5762-4bf5-b6a9-30cdaa6a7d12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:55:46.377849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1345/2697] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:55:46 2022] DELETE /identity/v3/projects/05ae806cc7ca460587a078832dc6601e => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:55:46.384909 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f5c62-6a53-4764-9928-50bb91a8f50d None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:46.385948 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f5c62-6a53-4764-9928-50bb91a8f50d None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:46.386507 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f5c62-6a53-4764-9928-50bb91a8f50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:46.409918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-270f5c62-6a53-4764-9928-50bb91a8f50d None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:55:46.411533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-270f5c62-6a53-4764-9928-50bb91a8f50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:46.497497 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1353/2698] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:55:46.510501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f318ab-6e7f-4d35-b6a0-952ff6e4c442 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:46.511161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f318ab-6e7f-4d35-b6a0-952ff6e4c442 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:46.511713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f318ab-6e7f-4d35-b6a0-952ff6e4c442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:46.547974 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-42f318ab-6e7f-4d35-b6a0-952ff6e4c442 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:55:46.550486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-42f318ab-6e7f-4d35-b6a0-952ff6e4c442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:46.567464 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1346/2699] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:55:46.573988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f5c62-6a53-4764-9928-50bb91a8f50d None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:46.592995 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f5c62-6a53-4764-9928-50bb91a8f50d None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:46.609158 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf366e8-e5c3-48df-a295-52c01c645c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:46.610266 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf366e8-e5c3-48df-a295-52c01c645c1c admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:46.610825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf366e8-e5c3-48df-a295-52c01c645c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:46.611298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf366e8-e5c3-48df-a295-52c01c645c1c admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:46.612930 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf366e8-e5c3-48df-a295-52c01c645c1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:55:46.613432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf366e8-e5c3-48df-a295-52c01c645c1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:46.615770 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf366e8-e5c3-48df-a295-52c01c645c1c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:46.639648 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1354/2700] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:55:46.647039 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f318ab-6e7f-4d35-b6a0-952ff6e4c442 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:46.664629 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f318ab-6e7f-4d35-b6a0-952ff6e4c442 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:46.675653 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50b632-c224-4239-9a3c-42e3abc6355a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:46.676762 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50b632-c224-4239-9a3c-42e3abc6355a admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:46.677233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50b632-c224-4239-9a3c-42e3abc6355a admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:46.677710 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c50b632-c224-4239-9a3c-42e3abc6355a admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:46.678993 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50b632-c224-4239-9a3c-42e3abc6355a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:46.683609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c50b632-c224-4239-9a3c-42e3abc6355a admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:46.726326 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1347/2701] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:55:46 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:55:46.739695 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf366e8-e5c3-48df-a295-52c01c645c1c admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:46.767423 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf366e8-e5c3-48df-a295-52c01c645c1c admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:46.872498 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b05e89-88ea-4036-a5b6-0d6b3d4497ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:46.873090 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b05e89-88ea-4036-a5b6-0d6b3d4497ff admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:46.873376 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b05e89-88ea-4036-a5b6-0d6b3d4497ff admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:46.873656 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b05e89-88ea-4036-a5b6-0d6b3d4497ff admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:46.874374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b05e89-88ea-4036-a5b6-0d6b3d4497ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:46.876454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b05e89-88ea-4036-a5b6-0d6b3d4497ff admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:46.915125 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1355/2702] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:55:46 2022] POST /identity/v3/users => generated 288 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:55:46.916784 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50b632-c224-4239-9a3c-42e3abc6355a admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:46.947847 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c50b632-c224-4239-9a3c-42e3abc6355a admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:46.972777 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c94460-cf7d-42b6-a311-1d9f06ca07de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:46.974192 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c94460-cf7d-42b6-a311-1d9f06ca07de admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:46.974786 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c94460-cf7d-42b6-a311-1d9f06ca07de admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:46.975492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c94460-cf7d-42b6-a311-1d9f06ca07de admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:46.977117 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c94460-cf7d-42b6-a311-1d9f06ca07de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:46.983655 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c94460-cf7d-42b6-a311-1d9f06ca07de admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:47.035643 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b05e89-88ea-4036-a5b6-0d6b3d4497ff admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:47.036414 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1348/2703] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:55:47.073501 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b05e89-88ea-4036-a5b6-0d6b3d4497ff admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:47.093239 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079e62b-8d0c-4e50-93f0-c4c918dd4031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:47.095356 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079e62b-8d0c-4e50-93f0-c4c918dd4031 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:47.096321 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079e62b-8d0c-4e50-93f0-c4c918dd4031 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:47.097022 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079e62b-8d0c-4e50-93f0-c4c918dd4031 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:47.098731 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079e62b-8d0c-4e50-93f0-c4c918dd4031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:47.102866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079e62b-8d0c-4e50-93f0-c4c918dd4031 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:47.134064 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1356/2704] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:55:47.141163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c94460-cf7d-42b6-a311-1d9f06ca07de admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:47.173384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c94460-cf7d-42b6-a311-1d9f06ca07de admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:47.182456 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac27a5-9ead-4446-9de0-5862131061fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:47.184511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac27a5-9ead-4446-9de0-5862131061fb admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:47.185229 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac27a5-9ead-4446-9de0-5862131061fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:47.185859 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac27a5-9ead-4446-9de0-5862131061fb admin admin] PATH_INFO: `/v3/projects/067ce20775be49ba8e681570d6199e39/users/b3a7825a66bf4d6b8f914140e692f56c/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:47.214724 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac27a5-9ead-4446-9de0-5862131061fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=067ce20775be49ba8e681570d6199e39, user_id=b3a7825a66bf4d6b8f914140e692f56c, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:47.220471 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac27a5-9ead-4446-9de0-5862131061fb admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:47.269720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1349/2705] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:55:47 2022] PUT /identity/v3/projects/067ce20775be49ba8e681570d6199e39/users/b3a7825a66bf4d6b8f914140e692f56c/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:55:47.282042 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1f5b6-31ff-4363-b998-6229b570a26a None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:47.282672 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1f5b6-31ff-4363-b998-6229b570a26a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:47.283689 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1f5b6-31ff-4363-b998-6229b570a26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:47.344826 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-bba1f5b6-31ff-4363-b998-6229b570a26a None None] MFA Rules not processed for user `b3a7825a66bf4d6b8f914140e692f56c`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:55:47.345079 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-bba1f5b6-31ff-4363-b998-6229b570a26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:47.447828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:47.496329 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1357/2706] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:55:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:55:47.516889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac27a5-9ead-4446-9de0-5862131061fb admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:47.520445 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-d4ac27a5-9ead-4446-9de0-5862131061fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:47.621294 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:47.651241 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac27a5-9ead-4446-9de0-5862131061fb admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:47.656847 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da0f98-3972-40db-96d8-36bd0353bfdc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d9a41e10cb64ee9972debaf856503d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:47.658177 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da0f98-3972-40db-96d8-36bd0353bfdc service glance] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:47.658743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da0f98-3972-40db-96d8-36bd0353bfdc service glance] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:47.659114 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da0f98-3972-40db-96d8-36bd0353bfdc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:47.676080 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da0f98-3972-40db-96d8-36bd0353bfdc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:47.677681 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da0f98-3972-40db-96d8-36bd0353bfdc service glance] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:47.688702 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1350/2707] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:55:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:55:51.228366 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1f5b6-31ff-4363-b998-6229b570a26a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:51.229976 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-bba1f5b6-31ff-4363-b998-6229b570a26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:51.313614 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1f5b6-31ff-4363-b998-6229b570a26a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:51.319904 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d1667-07df-47d4-9d6a-44af4626f6ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:51.321072 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d1667-07df-47d4-9d6a-44af4626f6ce service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:51.321568 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d1667-07df-47d4-9d6a-44af4626f6ce service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:51.322070 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d1667-07df-47d4-9d6a-44af4626f6ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:51.325236 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-794d1667-07df-47d4-9d6a-44af4626f6ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:51.436280 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d1667-07df-47d4-9d6a-44af4626f6ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:51.438231 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794d1667-07df-47d4-9d6a-44af4626f6ce service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:51.452444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1358/2708] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:55:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:55:56.505689 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bc1b7-97d7-461d-bb6a-80cfb9ab44cc None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:56.507152 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bc1b7-97d7-461d-bb6a-80cfb9ab44cc None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:56.507936 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bc1b7-97d7-461d-bb6a-80cfb9ab44cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:56.559191 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-624bc1b7-97d7-461d-bb6a-80cfb9ab44cc None None] MFA Rules not processed for user `c8f314167aa94d81955ac761a5a28504`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:55:56.561421 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-624bc1b7-97d7-461d-bb6a-80cfb9ab44cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:56.668817 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1351/2709] 10.222.0.77 () {58 vars in 967 bytes} [Tue Jul 19 20:55:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:55:56.692022 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d1667-07df-47d4-9d6a-44af4626f6ce service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:56.693988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-794d1667-07df-47d4-9d6a-44af4626f6ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:56.877152 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=100 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:55:56.880142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794d1667-07df-47d4-9d6a-44af4626f6ce service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:56.891409 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7005de-b3fd-48ca-aa7d-e63ef7b8014e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7987846276ad4ccd90899128ceb1354e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:56.891959 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7005de-b3fd-48ca-aa7d-e63ef7b8014e service swift] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:56.892280 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7005de-b3fd-48ca-aa7d-e63ef7b8014e service swift] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:56.892587 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7005de-b3fd-48ca-aa7d-e63ef7b8014e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:56.910824 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7005de-b3fd-48ca-aa7d-e63ef7b8014e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:56.912940 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7005de-b3fd-48ca-aa7d-e63ef7b8014e service swift] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:56.926264 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1359/2710] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jul 19 20:55:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 20:55:57.937448 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624bc1b7-97d7-461d-bb6a-80cfb9ab44cc None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:55:57.939243 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-624bc1b7-97d7-461d-bb6a-80cfb9ab44cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:57.951191 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624bc1b7-97d7-461d-bb6a-80cfb9ab44cc None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:55:57.955534 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ccb32-00fd-4cbf-98d7-21d9986b5860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:55:57.956330 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ccb32-00fd-4cbf-98d7-21d9986b5860 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:55:57.956717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ccb32-00fd-4cbf-98d7-21d9986b5860 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:55:57.957103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ccb32-00fd-4cbf-98d7-21d9986b5860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:55:57.959753 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-0a2ccb32-00fd-4cbf-98d7-21d9986b5860 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:55:58.073449 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ccb32-00fd-4cbf-98d7-21d9986b5860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:55:58.075492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ccb32-00fd-4cbf-98d7-21d9986b5860 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:55:58.104030 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1352/2711] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:55:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:56:01.745568 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7005de-b3fd-48ca-aa7d-e63ef7b8014e service swift] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:01.747222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-fe7005de-b3fd-48ca-aa7d-e63ef7b8014e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:01.886379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7005de-b3fd-48ca-aa7d-e63ef7b8014e service swift] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:01.893737 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64bd3b-a15e-400f-809a-0f86d3205083 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04843ec31eb84585944c7a2b9cd1c0cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:01.894512 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64bd3b-a15e-400f-809a-0f86d3205083 service placement] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:01.894872 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64bd3b-a15e-400f-809a-0f86d3205083 service placement] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:01.895221 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64bd3b-a15e-400f-809a-0f86d3205083 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:01.897379 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-eb64bd3b-a15e-400f-809a-0f86d3205083 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:01.915813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64bd3b-a15e-400f-809a-0f86d3205083 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:01.917408 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64bd3b-a15e-400f-809a-0f86d3205083 service placement] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:01.929655 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1360/2712] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:56:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:56:05.087788 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ccb32-00fd-4cbf-98d7-21d9986b5860 service neutron] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:05.108508 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ccb32-00fd-4cbf-98d7-21d9986b5860 service neutron] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:05.117749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f45153-8181-4b54-ba4a-3e44bfca0e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:05.119613 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f45153-8181-4b54-ba4a-3e44bfca0e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:05.120111 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f45153-8181-4b54-ba4a-3e44bfca0e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:05.120664 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f45153-8181-4b54-ba4a-3e44bfca0e30 admin admin] PATH_INFO: `/v3/users/b3a7825a66bf4d6b8f914140e692f56c` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:05.122865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f45153-8181-4b54-ba4a-3e44bfca0e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3a7825a66bf4d6b8f914140e692f56c)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:05.126885 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f45153-8181-4b54-ba4a-3e44bfca0e30 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:05.148312 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=100 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:05.228752 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-72f45153-8181-4b54-ba4a-3e44bfca0e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3a7825a66bf4d6b8f914140e692f56c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:05.239997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-72f45153-8181-4b54-ba4a-3e44bfca0e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3a7825a66bf4d6b8f914140e692f56c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:05.255895 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-72f45153-8181-4b54-ba4a-3e44bfca0e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3a7825a66bf4d6b8f914140e692f56c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:05.256727 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-72f45153-8181-4b54-ba4a-3e44bfca0e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3a7825a66bf4d6b8f914140e692f56c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:05.267858 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-72f45153-8181-4b54-ba4a-3e44bfca0e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3a7825a66bf4d6b8f914140e692f56c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:05.278244 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1353/2713] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:56:05 2022] DELETE /identity/v3/users/b3a7825a66bf4d6b8f914140e692f56c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:56:05.285902 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c39885-7191-433d-8710-1dd3dd4d4a22 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:05.286788 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c39885-7191-433d-8710-1dd3dd4d4a22 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:05.287138 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c39885-7191-433d-8710-1dd3dd4d4a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:05.330511 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-99c39885-7191-433d-8710-1dd3dd4d4a22 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:56:05.331906 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-99c39885-7191-433d-8710-1dd3dd4d4a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:05.439203 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1361/2714] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:56:05.450297 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f45153-8181-4b54-ba4a-3e44bfca0e30 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:05.451850 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-72f45153-8181-4b54-ba4a-3e44bfca0e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:05.547018 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f45153-8181-4b54-ba4a-3e44bfca0e30 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:05.551481 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0774aa-0ffe-44fa-898c-17b4e8531627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:05.552311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0774aa-0ffe-44fa-898c-17b4e8531627 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:05.552658 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0774aa-0ffe-44fa-898c-17b4e8531627 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:05.553000 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0774aa-0ffe-44fa-898c-17b4e8531627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:05.564652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0774aa-0ffe-44fa-898c-17b4e8531627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:05.566216 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0774aa-0ffe-44fa-898c-17b4e8531627 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:05.580572 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1354/2715] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:56:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:56:06.162211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c39885-7191-433d-8710-1dd3dd4d4a22 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:06.162211 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-99c39885-7191-433d-8710-1dd3dd4d4a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:06.191245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c39885-7191-433d-8710-1dd3dd4d4a22 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:06.200365 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e5aa04-2d8f-4f83-aa69-c9b6aed489d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:06.201514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5aa04-2d8f-4f83-aa69-c9b6aed489d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:06.201919 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5aa04-2d8f-4f83-aa69-c9b6aed489d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:06.202295 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e5aa04-2d8f-4f83-aa69-c9b6aed489d5 admin admin] PATH_INFO: `/v3/projects/067ce20775be49ba8e681570d6199e39` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:06.204505 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5aa04-2d8f-4f83-aa69-c9b6aed489d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=067ce20775be49ba8e681570d6199e39)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:06.207481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e5aa04-2d8f-4f83-aa69-c9b6aed489d5 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:06.313408 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b3e5aa04-2d8f-4f83-aa69-c9b6aed489d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '067ce20775be49ba8e681570d6199e39', 'request_id': 'req-b3e5aa04-2d8f-4f83-aa69-c9b6aed489d5'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:06.320476 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:06.334146 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b3e5aa04-2d8f-4f83-aa69-c9b6aed489d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '067ce20775be49ba8e681570d6199e39', 'request_id': 'req-b3e5aa04-2d8f-4f83-aa69-c9b6aed489d5'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:06.348011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b3e5aa04-2d8f-4f83-aa69-c9b6aed489d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '067ce20775be49ba8e681570d6199e39', 'request_id': 'req-b3e5aa04-2d8f-4f83-aa69-c9b6aed489d5'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:06.383057 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b3e5aa04-2d8f-4f83-aa69-c9b6aed489d5 admin admin] The token cache is being invalidate because project 067ce20775be49ba8e681570d6199e39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:56:06.384293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b3e5aa04-2d8f-4f83-aa69-c9b6aed489d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:06.385548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b3e5aa04-2d8f-4f83-aa69-c9b6aed489d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:06.387929 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1362/2716] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:56:06 2022] DELETE /identity/v3/projects/067ce20775be49ba8e681570d6199e39 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:56:06.395163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c3f24-fbc0-4aac-8653-4c229b41a5b4 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:06.396141 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c3f24-fbc0-4aac-8653-4c229b41a5b4 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:06.396141 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c3f24-fbc0-4aac-8653-4c229b41a5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:06.454472 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-9f9c3f24-fbc0-4aac-8653-4c229b41a5b4 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:56:06.455774 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9f9c3f24-fbc0-4aac-8653-4c229b41a5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:06.561630 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1355/2717] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:56:06.571355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e622f1-cbbe-4ddc-989b-aab65c15cd82 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:06.571716 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e622f1-cbbe-4ddc-989b-aab65c15cd82 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:06.572101 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e622f1-cbbe-4ddc-989b-aab65c15cd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:06.601460 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-70e622f1-cbbe-4ddc-989b-aab65c15cd82 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:56:06.603826 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-70e622f1-cbbe-4ddc-989b-aab65c15cd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:06.615186 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1363/2718] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:56:06.620398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c3f24-fbc0-4aac-8653-4c229b41a5b4 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:06.637339 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c3f24-fbc0-4aac-8653-4c229b41a5b4 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:06.645400 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d260f8c-8984-417d-b7a2-9d84e44306cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:06.646565 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d260f8c-8984-417d-b7a2-9d84e44306cc admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:06.647075 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d260f8c-8984-417d-b7a2-9d84e44306cc admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:06.647609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d260f8c-8984-417d-b7a2-9d84e44306cc admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:06.649084 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d260f8c-8984-417d-b7a2-9d84e44306cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:56:06.649654 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d260f8c-8984-417d-b7a2-9d84e44306cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:06.652786 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d260f8c-8984-417d-b7a2-9d84e44306cc admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:06.656737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:06.684588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1356/2719] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:56:06.685975 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e622f1-cbbe-4ddc-989b-aab65c15cd82 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:06.697653 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e622f1-cbbe-4ddc-989b-aab65c15cd82 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:06.706741 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad24f0-ff89-4a88-b7bc-7e451679af87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:06.707488 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad24f0-ff89-4a88-b7bc-7e451679af87 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:06.707778 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad24f0-ff89-4a88-b7bc-7e451679af87 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:06.708062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad24f0-ff89-4a88-b7bc-7e451679af87 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:06.708781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad24f0-ff89-4a88-b7bc-7e451679af87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:06.710697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad24f0-ff89-4a88-b7bc-7e451679af87 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:06.742632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1364/2720] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:56:06 2022] POST /identity/v3/projects => generated 359 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:56:06.748802 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d260f8c-8984-417d-b7a2-9d84e44306cc admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:06.764255 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d260f8c-8984-417d-b7a2-9d84e44306cc admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:06.788719 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad24f0-ff89-4a88-b7bc-7e451679af87 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:06.791668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a6ad24f0-ff89-4a88-b7bc-7e451679af87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:06.875438 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bef127-c3de-4543-90ed-fd8c90366a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:06.876657 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bef127-c3de-4543-90ed-fd8c90366a32 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:06.877156 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bef127-c3de-4543-90ed-fd8c90366a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:06.877656 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bef127-c3de-4543-90ed-fd8c90366a32 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:06.879241 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bef127-c3de-4543-90ed-fd8c90366a32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:06.885570 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bef127-c3de-4543-90ed-fd8c90366a32 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:06.899997 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad24f0-ff89-4a88-b7bc-7e451679af87 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:06.906315 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8be837-30a0-48a5-9b74-e25f2e7acdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:06.907601 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8be837-30a0-48a5-9b74-e25f2e7acdee admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:06.907856 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8be837-30a0-48a5-9b74-e25f2e7acdee admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:06.908169 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8be837-30a0-48a5-9b74-e25f2e7acdee admin admin] PATH_INFO: `/v3/users/cbaa2dbe97bf4abe925a1e9c587353d5` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:06.909481 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8be837-30a0-48a5-9b74-e25f2e7acdee admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbaa2dbe97bf4abe925a1e9c587353d5)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:06.911551 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8be837-30a0-48a5-9b74-e25f2e7acdee admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:06.918418 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1357/2721] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:56:06 2022] POST /identity/v3/users => generated 280 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:56:06.925650 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bef127-c3de-4543-90ed-fd8c90366a32 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:06.943546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bef127-c3de-4543-90ed-fd8c90366a32 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:06.951043 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38407fe0-b8cd-4a1a-8ced-1206eecbac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:06.951916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38407fe0-b8cd-4a1a-8ced-1206eecbac7e admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:06.952172 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38407fe0-b8cd-4a1a-8ced-1206eecbac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:06.952604 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38407fe0-b8cd-4a1a-8ced-1206eecbac7e admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:06.953375 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38407fe0-b8cd-4a1a-8ced-1206eecbac7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:06.955093 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38407fe0-b8cd-4a1a-8ced-1206eecbac7e admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:06.971983 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1358/2722] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:56:06.974083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38407fe0-b8cd-4a1a-8ced-1206eecbac7e admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:06.988512 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38407fe0-b8cd-4a1a-8ced-1206eecbac7e admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:06.990539 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-fb8be837-30a0-48a5-9b74-e25f2e7acdee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbaa2dbe97bf4abe925a1e9c587353d5'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:06.994552 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59156a74-ac6c-448b-b953-89f9ae0f1203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:06.995496 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59156a74-ac6c-448b-b953-89f9ae0f1203 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:06.995894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59156a74-ac6c-448b-b953-89f9ae0f1203 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:06.996274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59156a74-ac6c-448b-b953-89f9ae0f1203 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:06.997126 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59156a74-ac6c-448b-b953-89f9ae0f1203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:06.999127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59156a74-ac6c-448b-b953-89f9ae0f1203 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:07.001384 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-fb8be837-30a0-48a5-9b74-e25f2e7acdee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbaa2dbe97bf4abe925a1e9c587353d5'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:07.011975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1359/2723] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:56:07.016814 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59156a74-ac6c-448b-b953-89f9ae0f1203 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:07.021172 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-fb8be837-30a0-48a5-9b74-e25f2e7acdee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbaa2dbe97bf4abe925a1e9c587353d5'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:07.029272 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59156a74-ac6c-448b-b953-89f9ae0f1203 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:07.031656 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-fb8be837-30a0-48a5-9b74-e25f2e7acdee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbaa2dbe97bf4abe925a1e9c587353d5'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:07.033159 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-fb8be837-30a0-48a5-9b74-e25f2e7acdee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbaa2dbe97bf4abe925a1e9c587353d5'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:07.037498 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fafd7-89b0-4f99-b924-588ffe5be784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:07.039288 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fafd7-89b0-4f99-b924-588ffe5be784 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:07.039852 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fafd7-89b0-4f99-b924-588ffe5be784 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:07.040358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fafd7-89b0-4f99-b924-588ffe5be784 admin admin] PATH_INFO: `/v3/projects/9317c1d9f3e64ea3b2479465cb59ce16/users/9865646758db4a7b9f273e39b77c0566/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:07.040584 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1365/2724] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:56:06 2022] DELETE /identity/v3/users/cbaa2dbe97bf4abe925a1e9c587353d5 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:56:07.066222 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fafd7-89b0-4f99-b924-588ffe5be784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9317c1d9f3e64ea3b2479465cb59ce16, user_id=9865646758db4a7b9f273e39b77c0566, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:07.069206 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fafd7-89b0-4f99-b924-588ffe5be784 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:07.087629 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1360/2725] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:56:07 2022] PUT /identity/v3/projects/9317c1d9f3e64ea3b2479465cb59ce16/users/9865646758db4a7b9f273e39b77c0566/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:56:07.104926 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8a610-97db-49e0-9119-4a96e99b79b3 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:07.105581 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8a610-97db-49e0-9119-4a96e99b79b3 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:07.106029 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8a610-97db-49e0-9119-4a96e99b79b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:07.145831 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-44f8a610-97db-49e0-9119-4a96e99b79b3 None None] MFA Rules not processed for user `9865646758db4a7b9f273e39b77c0566`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:56:07.148337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-44f8a610-97db-49e0-9119-4a96e99b79b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:07.181721 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:07.268222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1366/2726] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:56:07 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:56:07.275429 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fafd7-89b0-4f99-b924-588ffe5be784 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:07.277399 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-bb5fafd7-89b0-4f99-b924-588ffe5be784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:07.309198 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8a610-97db-49e0-9119-4a96e99b79b3 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:07.311609 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-44f8a610-97db-49e0-9119-4a96e99b79b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:07.371713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fafd7-89b0-4f99-b924-588ffe5be784 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:07.377490 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b1ca7-ce2a-41da-ac02-386ca667fd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:07.378524 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b1ca7-ce2a-41da-ac02-386ca667fd68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:07.379147 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b1ca7-ce2a-41da-ac02-386ca667fd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:07.379466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b1ca7-ce2a-41da-ac02-386ca667fd68 admin admin] PATH_INFO: `/v3/projects/cb3bffc501684bb586a051f3bd48f49f` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:07.380866 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b1ca7-ce2a-41da-ac02-386ca667fd68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb3bffc501684bb586a051f3bd48f49f)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:07.382822 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b1ca7-ce2a-41da-ac02-386ca667fd68 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:07.392333 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8a610-97db-49e0-9119-4a96e99b79b3 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:07.398611 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148c706-471e-4fe2-823a-adb2337084a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:07.399793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148c706-471e-4fe2-823a-adb2337084a1 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:07.400298 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148c706-471e-4fe2-823a-adb2337084a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:07.400779 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148c706-471e-4fe2-823a-adb2337084a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:07.415668 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148c706-471e-4fe2-823a-adb2337084a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:07.417542 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148c706-471e-4fe2-823a-adb2337084a1 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:07.432766 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1367/2727] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:56:07 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:56:07.439928 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:07.455225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148c706-471e-4fe2-823a-adb2337084a1 service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:07.455707 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-551b1ca7-ce2a-41da-ac02-386ca667fd68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb3bffc501684bb586a051f3bd48f49f', 'request_id': 'req-551b1ca7-ce2a-41da-ac02-386ca667fd68'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:07.457532 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a148c706-471e-4fe2-823a-adb2337084a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:07.467081 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-551b1ca7-ce2a-41da-ac02-386ca667fd68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb3bffc501684bb586a051f3bd48f49f', 'request_id': 'req-551b1ca7-ce2a-41da-ac02-386ca667fd68'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:07.474245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-551b1ca7-ce2a-41da-ac02-386ca667fd68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb3bffc501684bb586a051f3bd48f49f', 'request_id': 'req-551b1ca7-ce2a-41da-ac02-386ca667fd68'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:07.477372 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148c706-471e-4fe2-823a-adb2337084a1 service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:07.489350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-551b1ca7-ce2a-41da-ac02-386ca667fd68 admin admin] The token cache is being invalidate because project cb3bffc501684bb586a051f3bd48f49f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:56:07.489860 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-551b1ca7-ce2a-41da-ac02-386ca667fd68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:07.490906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-551b1ca7-ce2a-41da-ac02-386ca667fd68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:07.493186 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1361/2728] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:56:07 2022] DELETE /identity/v3/projects/cb3bffc501684bb586a051f3bd48f49f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:56:07.497838 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b1ca7-ce2a-41da-ac02-386ca667fd68 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:07.499849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-551b1ca7-ce2a-41da-ac02-386ca667fd68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:07.560410 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af56a06-7cd0-4a85-a966-0d800150fe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:07.562398 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af56a06-7cd0-4a85-a966-0d800150fe54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:07.562783 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af56a06-7cd0-4a85-a966-0d800150fe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:07.563159 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af56a06-7cd0-4a85-a966-0d800150fe54 admin admin] PATH_INFO: `/v3/users/9865646758db4a7b9f273e39b77c0566` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:07.564777 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af56a06-7cd0-4a85-a966-0d800150fe54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9865646758db4a7b9f273e39b77c0566)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:07.566715 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af56a06-7cd0-4a85-a966-0d800150fe54 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:07.583519 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b1ca7-ce2a-41da-ac02-386ca667fd68 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:07.589074 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40945b7b-2cbe-4669-9859-bb336ea2315c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:07.590091 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40945b7b-2cbe-4669-9859-bb336ea2315c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:07.590485 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40945b7b-2cbe-4669-9859-bb336ea2315c admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:07.590956 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40945b7b-2cbe-4669-9859-bb336ea2315c admin admin] PATH_INFO: `/v3/users/3f803a69c5e746f4ae14906084a0056d` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:07.592972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40945b7b-2cbe-4669-9859-bb336ea2315c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f803a69c5e746f4ae14906084a0056d)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:07.596661 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40945b7b-2cbe-4669-9859-bb336ea2315c admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:07.626258 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-0af56a06-7cd0-4a85-a966-0d800150fe54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9865646758db4a7b9f273e39b77c0566'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:07.634871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-0af56a06-7cd0-4a85-a966-0d800150fe54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9865646758db4a7b9f273e39b77c0566'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:07.641095 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:07.652889 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-0af56a06-7cd0-4a85-a966-0d800150fe54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9865646758db4a7b9f273e39b77c0566'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:07.665631 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-0af56a06-7cd0-4a85-a966-0d800150fe54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9865646758db4a7b9f273e39b77c0566'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:07.666527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-0af56a06-7cd0-4a85-a966-0d800150fe54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9865646758db4a7b9f273e39b77c0566'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:07.667523 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-40945b7b-2cbe-4669-9859-bb336ea2315c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f803a69c5e746f4ae14906084a0056d'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:07.677051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1368/2729] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:56:07 2022] DELETE /identity/v3/users/9865646758db4a7b9f273e39b77c0566 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:56:07.678301 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-40945b7b-2cbe-4669-9859-bb336ea2315c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f803a69c5e746f4ae14906084a0056d'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:07.683752 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603e426-1c50-4317-a8d0-c743e665cd28 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:07.684332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603e426-1c50-4317-a8d0-c743e665cd28 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:07.684792 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603e426-1c50-4317-a8d0-c743e665cd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:07.698982 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-40945b7b-2cbe-4669-9859-bb336ea2315c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f803a69c5e746f4ae14906084a0056d'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:07.700332 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-40945b7b-2cbe-4669-9859-bb336ea2315c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f803a69c5e746f4ae14906084a0056d'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:07.709975 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-40945b7b-2cbe-4669-9859-bb336ea2315c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f803a69c5e746f4ae14906084a0056d'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:07.711127 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-d603e426-1c50-4317-a8d0-c743e665cd28 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:56:07.712510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d603e426-1c50-4317-a8d0-c743e665cd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:07.717716 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1362/2730] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:56:07 2022] DELETE /identity/v3/users/3f803a69c5e746f4ae14906084a0056d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:56:07.802885 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1369/2731] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:56:07.815186 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40945b7b-2cbe-4669-9859-bb336ea2315c admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:07.816981 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-40945b7b-2cbe-4669-9859-bb336ea2315c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:07.878814 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:07.891513 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40945b7b-2cbe-4669-9859-bb336ea2315c admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:07.896952 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ba63f-66c3-419c-9bd8-6e221f77dcde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:07.897678 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ba63f-66c3-419c-9bd8-6e221f77dcde service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:07.898158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ba63f-66c3-419c-9bd8-6e221f77dcde service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:07.898443 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ba63f-66c3-419c-9bd8-6e221f77dcde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:07.946722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603e426-1c50-4317-a8d0-c743e665cd28 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:07.948523 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d603e426-1c50-4317-a8d0-c743e665cd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:07.967219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603e426-1c50-4317-a8d0-c743e665cd28 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:08.003199 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ba63f-66c3-419c-9bd8-6e221f77dcde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:08.005596 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ba63f-66c3-419c-9bd8-6e221f77dcde service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:08.022441 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1363/2732] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:56:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:56:08.058902 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53ed50-692c-48b3-aaef-48daf105042c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:08.060168 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53ed50-692c-48b3-aaef-48daf105042c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:08.060567 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53ed50-692c-48b3-aaef-48daf105042c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:08.061042 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53ed50-692c-48b3-aaef-48daf105042c admin admin] PATH_INFO: `/v3/projects/bd36b77205374489b8514d31d5706292` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:08.063171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53ed50-692c-48b3-aaef-48daf105042c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd36b77205374489b8514d31d5706292)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:08.066135 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53ed50-692c-48b3-aaef-48daf105042c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:08.128759 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-5e53ed50-692c-48b3-aaef-48daf105042c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd36b77205374489b8514d31d5706292', 'request_id': 'req-5e53ed50-692c-48b3-aaef-48daf105042c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:08.135058 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-5e53ed50-692c-48b3-aaef-48daf105042c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd36b77205374489b8514d31d5706292', 'request_id': 'req-5e53ed50-692c-48b3-aaef-48daf105042c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:08.146507 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-5e53ed50-692c-48b3-aaef-48daf105042c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd36b77205374489b8514d31d5706292', 'request_id': 'req-5e53ed50-692c-48b3-aaef-48daf105042c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:08.160759 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-5e53ed50-692c-48b3-aaef-48daf105042c admin admin] The token cache is being invalidate because project bd36b77205374489b8514d31d5706292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:56:08.161210 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-5e53ed50-692c-48b3-aaef-48daf105042c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:08.162089 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-5e53ed50-692c-48b3-aaef-48daf105042c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:08.164805 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1370/2733] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:56:07 2022] DELETE /identity/v3/projects/bd36b77205374489b8514d31d5706292 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:56:08.395694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ba63f-66c3-419c-9bd8-6e221f77dcde service neutron] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:08.398501 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-c83ba63f-66c3-419c-9bd8-6e221f77dcde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:08.422452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ba63f-66c3-419c-9bd8-6e221f77dcde service neutron] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:08.499127 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a66ef7b-8c86-4c96-871d-c5b5a6ffe408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:08.500936 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66ef7b-8c86-4c96-871d-c5b5a6ffe408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:08.501121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66ef7b-8c86-4c96-871d-c5b5a6ffe408 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:08.501286 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a66ef7b-8c86-4c96-871d-c5b5a6ffe408 admin admin] PATH_INFO: `/v3/projects/9317c1d9f3e64ea3b2479465cb59ce16` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:08.502528 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66ef7b-8c86-4c96-871d-c5b5a6ffe408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9317c1d9f3e64ea3b2479465cb59ce16)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:08.504485 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a66ef7b-8c86-4c96-871d-c5b5a6ffe408 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:08.553086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-1a66ef7b-8c86-4c96-871d-c5b5a6ffe408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9317c1d9f3e64ea3b2479465cb59ce16', 'request_id': 'req-1a66ef7b-8c86-4c96-871d-c5b5a6ffe408'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:08.561160 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-1a66ef7b-8c86-4c96-871d-c5b5a6ffe408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9317c1d9f3e64ea3b2479465cb59ce16', 'request_id': 'req-1a66ef7b-8c86-4c96-871d-c5b5a6ffe408'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:08.568138 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-1a66ef7b-8c86-4c96-871d-c5b5a6ffe408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9317c1d9f3e64ea3b2479465cb59ce16', 'request_id': 'req-1a66ef7b-8c86-4c96-871d-c5b5a6ffe408'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:08.579696 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-1a66ef7b-8c86-4c96-871d-c5b5a6ffe408 admin admin] The token cache is being invalidate because project 9317c1d9f3e64ea3b2479465cb59ce16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:56:08.579988 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-1a66ef7b-8c86-4c96-871d-c5b5a6ffe408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:08.580711 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-1a66ef7b-8c86-4c96-871d-c5b5a6ffe408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:08.582650 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1364/2734] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:56:08 2022] DELETE /identity/v3/projects/9317c1d9f3e64ea3b2479465cb59ce16 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:56:08.590036 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d80ee-ba4b-497b-9f3e-80e04493942f None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:08.590571 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d80ee-ba4b-497b-9f3e-80e04493942f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:08.590673 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d80ee-ba4b-497b-9f3e-80e04493942f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:08.610368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-b40d80ee-ba4b-497b-9f3e-80e04493942f None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:56:08.611641 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b40d80ee-ba4b-497b-9f3e-80e04493942f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:08.617242 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:08.679279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1371/2735] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:56:08.690086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dbc40-3960-41b0-813e-7f485a4ca70c None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:08.690373 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dbc40-3960-41b0-813e-7f485a4ca70c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:08.690652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dbc40-3960-41b0-813e-7f485a4ca70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:08.711045 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-390dbc40-3960-41b0-813e-7f485a4ca70c None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:56:08.712301 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-390dbc40-3960-41b0-813e-7f485a4ca70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:08.720514 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1365/2736] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:56:08.724825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d80ee-ba4b-497b-9f3e-80e04493942f None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:08.736110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d80ee-ba4b-497b-9f3e-80e04493942f None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:08.740621 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ead343-3c43-4047-9bcb-3cee68ba35a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:08.741296 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ead343-3c43-4047-9bcb-3cee68ba35a4 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:08.741581 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ead343-3c43-4047-9bcb-3cee68ba35a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:08.741878 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ead343-3c43-4047-9bcb-3cee68ba35a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:08.742591 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ead343-3c43-4047-9bcb-3cee68ba35a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:56:08.742897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ead343-3c43-4047-9bcb-3cee68ba35a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:08.744544 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ead343-3c43-4047-9bcb-3cee68ba35a4 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:08.764059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1372/2737] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:56:08.768543 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390dbc40-3960-41b0-813e-7f485a4ca70c None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:08.778420 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390dbc40-3960-41b0-813e-7f485a4ca70c None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:08.783799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94527dd9-abf2-4f39-9d34-339c4e095806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:08.784483 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94527dd9-abf2-4f39-9d34-339c4e095806 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:08.784773 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94527dd9-abf2-4f39-9d34-339c4e095806 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:08.785162 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94527dd9-abf2-4f39-9d34-339c4e095806 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:08.785759 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94527dd9-abf2-4f39-9d34-339c4e095806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:08.787721 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94527dd9-abf2-4f39-9d34-339c4e095806 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:08.809673 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:08.820806 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1366/2738] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:56:08 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:56:08.825172 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ead343-3c43-4047-9bcb-3cee68ba35a4 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:08.837847 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ead343-3c43-4047-9bcb-3cee68ba35a4 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:08.907661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656764d-5421-4f5b-8e2f-5b0a5b9fc541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:08.908846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656764d-5421-4f5b-8e2f-5b0a5b9fc541 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:08.909351 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656764d-5421-4f5b-8e2f-5b0a5b9fc541 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:08.909856 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656764d-5421-4f5b-8e2f-5b0a5b9fc541 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:08.911040 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656764d-5421-4f5b-8e2f-5b0a5b9fc541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:08.917817 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656764d-5421-4f5b-8e2f-5b0a5b9fc541 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:08.952321 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1373/2739] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:56:08 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:56:08.956610 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94527dd9-abf2-4f39-9d34-339c4e095806 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:08.969104 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94527dd9-abf2-4f39-9d34-339c4e095806 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:08.974011 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f201a63-76db-4de8-8432-b964c2c83303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:08.974751 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f201a63-76db-4de8-8432-b964c2c83303 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:08.975048 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f201a63-76db-4de8-8432-b964c2c83303 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:08.975365 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f201a63-76db-4de8-8432-b964c2c83303 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:08.976103 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f201a63-76db-4de8-8432-b964c2c83303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:08.977737 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f201a63-76db-4de8-8432-b964c2c83303 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:08.990824 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1367/2740] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:56:08.995166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656764d-5421-4f5b-8e2f-5b0a5b9fc541 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:09.007787 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656764d-5421-4f5b-8e2f-5b0a5b9fc541 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:09.012844 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532c54d8-3183-4f0c-907a-8fc5e5cef48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:09.013518 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c54d8-3183-4f0c-907a-8fc5e5cef48c admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:09.013800 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c54d8-3183-4f0c-907a-8fc5e5cef48c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:09.014077 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532c54d8-3183-4f0c-907a-8fc5e5cef48c admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:09.014807 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c54d8-3183-4f0c-907a-8fc5e5cef48c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:09.017074 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532c54d8-3183-4f0c-907a-8fc5e5cef48c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:09.029389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1374/2741] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:56:09.037910 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f201a63-76db-4de8-8432-b964c2c83303 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:09.053369 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f201a63-76db-4de8-8432-b964c2c83303 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:09.058584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa395ed8-e7a8-42e0-91f7-77fce5eca7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:09.059520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa395ed8-e7a8-42e0-91f7-77fce5eca7ed admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:09.059808 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa395ed8-e7a8-42e0-91f7-77fce5eca7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:09.060084 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa395ed8-e7a8-42e0-91f7-77fce5eca7ed admin admin] PATH_INFO: `/v3/projects/8c21ec5dc954479b8a36e2a3d5bcb49e/users/69af4909d88c4a83b96754adee21f739/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:09.077309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa395ed8-e7a8-42e0-91f7-77fce5eca7ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c21ec5dc954479b8a36e2a3d5bcb49e, user_id=69af4909d88c4a83b96754adee21f739, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:09.080577 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa395ed8-e7a8-42e0-91f7-77fce5eca7ed admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:09.099289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1368/2742] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:56:09 2022] PUT /identity/v3/projects/8c21ec5dc954479b8a36e2a3d5bcb49e/users/69af4909d88c4a83b96754adee21f739/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:56:09.109875 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf62dcb-d19e-4cc0-a4f6-917c9049421c None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:09.110181 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf62dcb-d19e-4cc0-a4f6-917c9049421c None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:09.110469 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf62dcb-d19e-4cc0-a4f6-917c9049421c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:09.138833 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-acf62dcb-d19e-4cc0-a4f6-917c9049421c None None] MFA Rules not processed for user `69af4909d88c4a83b96754adee21f739`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:56:09.140657 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-acf62dcb-d19e-4cc0-a4f6-917c9049421c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:09.210970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1375/2743] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:56:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:56:09.223161 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa395ed8-e7a8-42e0-91f7-77fce5eca7ed admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:09.225529 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-aa395ed8-e7a8-42e0-91f7-77fce5eca7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:09.305678 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa395ed8-e7a8-42e0-91f7-77fce5eca7ed admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:09.309702 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba576d-ddf2-413f-9cf1-a06c26fb6e75 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d9a41e10cb64ee9972debaf856503d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:09.310370 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba576d-ddf2-413f-9cf1-a06c26fb6e75 service glance] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:09.310651 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba576d-ddf2-413f-9cf1-a06c26fb6e75 service glance] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:09.310925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba576d-ddf2-413f-9cf1-a06c26fb6e75 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:09.324097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba576d-ddf2-413f-9cf1-a06c26fb6e75 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:09.324827 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba576d-ddf2-413f-9cf1-a06c26fb6e75 service glance] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:09.334568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1369/2744] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:56:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:56:19.207870 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=94,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:19.330380 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:32.438658 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf62dcb-d19e-4cc0-a4f6-917c9049421c None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:32.549778 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf62dcb-d19e-4cc0-a4f6-917c9049421c None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:32.557311 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be14371-e13c-421c-af97-72ea114a88f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:32.558858 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be14371-e13c-421c-af97-72ea114a88f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:32.559383 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be14371-e13c-421c-af97-72ea114a88f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:32.559877 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be14371-e13c-421c-af97-72ea114a88f9 admin admin] PATH_INFO: `/v3/users/69af4909d88c4a83b96754adee21f739` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:32.561933 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be14371-e13c-421c-af97-72ea114a88f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69af4909d88c4a83b96754adee21f739)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:32.565658 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be14371-e13c-421c-af97-72ea114a88f9 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:32.635199 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-9be14371-e13c-421c-af97-72ea114a88f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69af4909d88c4a83b96754adee21f739'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:32.643088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-9be14371-e13c-421c-af97-72ea114a88f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69af4909d88c4a83b96754adee21f739'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:32.656452 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-9be14371-e13c-421c-af97-72ea114a88f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69af4909d88c4a83b96754adee21f739'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:32.668319 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-9be14371-e13c-421c-af97-72ea114a88f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69af4909d88c4a83b96754adee21f739'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:32.669038 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-9be14371-e13c-421c-af97-72ea114a88f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69af4909d88c4a83b96754adee21f739'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:32.675645 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1376/2745] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:56:32 2022] DELETE /identity/v3/users/69af4909d88c4a83b96754adee21f739 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:56:32.680346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12d53e-081a-4b7e-a01a-5339d9bebc17 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:32.681126 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12d53e-081a-4b7e-a01a-5339d9bebc17 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:32.681126 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12d53e-081a-4b7e-a01a-5339d9bebc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:32.703981 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-cd12d53e-081a-4b7e-a01a-5339d9bebc17 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:56:32.705231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-cd12d53e-081a-4b7e-a01a-5339d9bebc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:32.777850 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1370/2746] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:56:32.795415 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be14371-e13c-421c-af97-72ea114a88f9 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:32.796993 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-9be14371-e13c-421c-af97-72ea114a88f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:32.887909 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be14371-e13c-421c-af97-72ea114a88f9 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:32.893585 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f24a9-3c23-409b-8ab1-fa8f5faf4017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:32.894833 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f24a9-3c23-409b-8ab1-fa8f5faf4017 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:32.895366 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f24a9-3c23-409b-8ab1-fa8f5faf4017 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:32.895875 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f24a9-3c23-409b-8ab1-fa8f5faf4017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:32.913027 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f24a9-3c23-409b-8ab1-fa8f5faf4017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:32.915798 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f24a9-3c23-409b-8ab1-fa8f5faf4017 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:32.933973 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1377/2747] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:56:33.234882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12d53e-081a-4b7e-a01a-5339d9bebc17 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:33.236473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-cd12d53e-081a-4b7e-a01a-5339d9bebc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:33.250956 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12d53e-081a-4b7e-a01a-5339d9bebc17 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:33.255937 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87139c8-5c10-4663-b53b-7af1512af493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:33.256842 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87139c8-5c10-4663-b53b-7af1512af493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:33.257123 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87139c8-5c10-4663-b53b-7af1512af493 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:33.257391 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87139c8-5c10-4663-b53b-7af1512af493 admin admin] PATH_INFO: `/v3/projects/8c21ec5dc954479b8a36e2a3d5bcb49e` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:33.258733 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87139c8-5c10-4663-b53b-7af1512af493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c21ec5dc954479b8a36e2a3d5bcb49e)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:33.261557 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87139c8-5c10-4663-b53b-7af1512af493 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:33.335822 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-c87139c8-5c10-4663-b53b-7af1512af493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c21ec5dc954479b8a36e2a3d5bcb49e', 'request_id': 'req-c87139c8-5c10-4663-b53b-7af1512af493'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:33.344826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-c87139c8-5c10-4663-b53b-7af1512af493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c21ec5dc954479b8a36e2a3d5bcb49e', 'request_id': 'req-c87139c8-5c10-4663-b53b-7af1512af493'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:33.352196 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-c87139c8-5c10-4663-b53b-7af1512af493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c21ec5dc954479b8a36e2a3d5bcb49e', 'request_id': 'req-c87139c8-5c10-4663-b53b-7af1512af493'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:33.365645 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-c87139c8-5c10-4663-b53b-7af1512af493 admin admin] The token cache is being invalidate because project 8c21ec5dc954479b8a36e2a3d5bcb49e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:56:33.365946 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-c87139c8-5c10-4663-b53b-7af1512af493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:33.366754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-c87139c8-5c10-4663-b53b-7af1512af493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:33.368380 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1371/2748] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:56:33 2022] DELETE /identity/v3/projects/8c21ec5dc954479b8a36e2a3d5bcb49e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:56:33.374381 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac1dc-85d5-4b08-b58e-206e05ac4547 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:33.374713 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac1dc-85d5-4b08-b58e-206e05ac4547 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:33.375031 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac1dc-85d5-4b08-b58e-206e05ac4547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:33.384671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:33.402103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-8fbac1dc-85d5-4b08-b58e-206e05ac4547 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:56:33.403378 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-8fbac1dc-85d5-4b08-b58e-206e05ac4547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:33.469258 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1378/2749] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:56:33.477977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f42e7a-6fc5-417d-86f5-06a55c987bb0 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:33.478205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f42e7a-6fc5-417d-86f5-06a55c987bb0 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:33.478474 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f42e7a-6fc5-417d-86f5-06a55c987bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:33.500829 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-66f42e7a-6fc5-417d-86f5-06a55c987bb0 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:56:33.502119 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-66f42e7a-6fc5-417d-86f5-06a55c987bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:33.510891 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1372/2750] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:56:33.515629 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbac1dc-85d5-4b08-b58e-206e05ac4547 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:33.526461 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbac1dc-85d5-4b08-b58e-206e05ac4547 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:33.531709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864ed24-a70a-4218-a772-03c34cca1ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:33.532655 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864ed24-a70a-4218-a772-03c34cca1ecf admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:33.532932 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864ed24-a70a-4218-a772-03c34cca1ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:33.533203 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2864ed24-a70a-4218-a772-03c34cca1ecf admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:33.533960 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864ed24-a70a-4218-a772-03c34cca1ecf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:56:33.534264 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864ed24-a70a-4218-a772-03c34cca1ecf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:33.535981 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2864ed24-a70a-4218-a772-03c34cca1ecf admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:33.550267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1379/2751] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 20:56:33.555083 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f42e7a-6fc5-417d-86f5-06a55c987bb0 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:33.566287 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f42e7a-6fc5-417d-86f5-06a55c987bb0 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:33.571984 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8d933-a6c8-4a99-9f08-930eb5f35438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:33.572674 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8d933-a6c8-4a99-9f08-930eb5f35438 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:33.574039 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8d933-a6c8-4a99-9f08-930eb5f35438 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:33.574326 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8d933-a6c8-4a99-9f08-930eb5f35438 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:33.575064 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8d933-a6c8-4a99-9f08-930eb5f35438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:33.577115 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8d933-a6c8-4a99-9f08-930eb5f35438 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:33.607928 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1373/2752] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:56:33 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:56:33.612869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864ed24-a70a-4218-a772-03c34cca1ecf admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:33.624131 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2864ed24-a70a-4218-a772-03c34cca1ecf admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:33.698659 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e9630-6d69-491c-81aa-4ebc859d964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:33.699370 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e9630-6d69-491c-81aa-4ebc859d964b admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:33.699660 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e9630-6d69-491c-81aa-4ebc859d964b admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:33.699942 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e9630-6d69-491c-81aa-4ebc859d964b admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:33.700829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e9630-6d69-491c-81aa-4ebc859d964b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:33.702727 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e9630-6d69-491c-81aa-4ebc859d964b admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:33.724711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1380/2753] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:56:33 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:56:33.729585 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8d933-a6c8-4a99-9f08-930eb5f35438 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:33.741037 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8d933-a6c8-4a99-9f08-930eb5f35438 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:33.746047 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76edaa8-3a20-435d-90ea-061c516a558d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:33.746738 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76edaa8-3a20-435d-90ea-061c516a558d admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:33.747019 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76edaa8-3a20-435d-90ea-061c516a558d admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:33.747328 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76edaa8-3a20-435d-90ea-061c516a558d admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:33.748073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76edaa8-3a20-435d-90ea-061c516a558d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:33.749703 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76edaa8-3a20-435d-90ea-061c516a558d admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:33.761583 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1374/2754] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:56:33.766119 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e9630-6d69-491c-81aa-4ebc859d964b admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:33.777267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e9630-6d69-491c-81aa-4ebc859d964b admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:33.783548 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfbf49-8203-4139-aae1-6734d570973d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:33.784369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfbf49-8203-4139-aae1-6734d570973d admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:33.784777 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfbf49-8203-4139-aae1-6734d570973d admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:33.785157 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfbf49-8203-4139-aae1-6734d570973d admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:33.786011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfbf49-8203-4139-aae1-6734d570973d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:33.787866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfbf49-8203-4139-aae1-6734d570973d admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:33.800082 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1381/2755] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:56:33.804791 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76edaa8-3a20-435d-90ea-061c516a558d admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:33.815924 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76edaa8-3a20-435d-90ea-061c516a558d admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:33.821118 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a2009-3c3f-4d8a-8dc0-1a50d4911d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:33.822005 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a2009-3c3f-4d8a-8dc0-1a50d4911d92 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:33.822315 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a2009-3c3f-4d8a-8dc0-1a50d4911d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:33.822589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a2009-3c3f-4d8a-8dc0-1a50d4911d92 admin admin] PATH_INFO: `/v3/projects/0df3fe3b4c584fb7a75c27d5d5e797c2/users/f94a6cc1595e4bfc9a777d0682713694/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:33.839141 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a2009-3c3f-4d8a-8dc0-1a50d4911d92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0df3fe3b4c584fb7a75c27d5d5e797c2, user_id=f94a6cc1595e4bfc9a777d0682713694, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:33.841842 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a2009-3c3f-4d8a-8dc0-1a50d4911d92 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:33.864558 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1375/2756] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:56:33 2022] PUT /identity/v3/projects/0df3fe3b4c584fb7a75c27d5d5e797c2/users/f94a6cc1595e4bfc9a777d0682713694/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:56:33.876355 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb6070-d346-466d-a8b7-639de483afa8 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:33.876679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb6070-d346-466d-a8b7-639de483afa8 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:33.876924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb6070-d346-466d-a8b7-639de483afa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:33.910066 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-a9cb6070-d346-466d-a8b7-639de483afa8 None None] MFA Rules not processed for user `f94a6cc1595e4bfc9a777d0682713694`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:56:33.911396 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a9cb6070-d346-466d-a8b7-639de483afa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:33.990951 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:34.000531 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1382/2757] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:56:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:56:34.012319 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a2009-3c3f-4d8a-8dc0-1a50d4911d92 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:34.014200 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e67a2009-3c3f-4d8a-8dc0-1a50d4911d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:34.042402 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:34.123268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a2009-3c3f-4d8a-8dc0-1a50d4911d92 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:34.130309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cf9d3-51c4-4865-bf46-0e573f3ee6bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:34.131498 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cf9d3-51c4-4865-bf46-0e573f3ee6bf service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:34.131999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cf9d3-51c4-4865-bf46-0e573f3ee6bf service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:34.132488 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cf9d3-51c4-4865-bf46-0e573f3ee6bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:34.148746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cf9d3-51c4-4865-bf46-0e573f3ee6bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:34.151582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cf9d3-51c4-4865-bf46-0e573f3ee6bf service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:34.169756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1376/2758] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:56:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:56:41.027836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb6070-d346-466d-a8b7-639de483afa8 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:41.029521 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a9cb6070-d346-466d-a8b7-639de483afa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:41.129405 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb6070-d346-466d-a8b7-639de483afa8 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:41.135241 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c64a6-78b9-4a4b-aa00-0e87b664acc1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04843ec31eb84585944c7a2b9cd1c0cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:41.135951 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c64a6-78b9-4a4b-aa00-0e87b664acc1 service placement] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:41.136670 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c64a6-78b9-4a4b-aa00-0e87b664acc1 service placement] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:41.136953 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c64a6-78b9-4a4b-aa00-0e87b664acc1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:41.138852 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a70c64a6-78b9-4a4b-aa00-0e87b664acc1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:41.152780 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c64a6-78b9-4a4b-aa00-0e87b664acc1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:41.154608 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c64a6-78b9-4a4b-aa00-0e87b664acc1 service placement] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:41.169018 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1383/2759] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:56:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:56:44.161845 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=26 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:44.802838 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cf9d3-51c4-4865-bf46-0e573f3ee6bf service cinder] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:44.899545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cf9d3-51c4-4865-bf46-0e573f3ee6bf service cinder] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:44.904631 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c88a1c-dacd-4d3a-9aea-8317a03c9ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:44.906050 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c88a1c-dacd-4d3a-9aea-8317a03c9ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:44.906329 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c88a1c-dacd-4d3a-9aea-8317a03c9ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:44.906611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c88a1c-dacd-4d3a-9aea-8317a03c9ac9 admin admin] PATH_INFO: `/v3/users/f94a6cc1595e4bfc9a777d0682713694` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:44.908254 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c88a1c-dacd-4d3a-9aea-8317a03c9ac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f94a6cc1595e4bfc9a777d0682713694)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:44.910223 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c88a1c-dacd-4d3a-9aea-8317a03c9ac9 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:44.969998 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-08c88a1c-dacd-4d3a-9aea-8317a03c9ac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f94a6cc1595e4bfc9a777d0682713694'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:44.980853 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-08c88a1c-dacd-4d3a-9aea-8317a03c9ac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f94a6cc1595e4bfc9a777d0682713694'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:45.001922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-08c88a1c-dacd-4d3a-9aea-8317a03c9ac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f94a6cc1595e4bfc9a777d0682713694'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:45.002906 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-08c88a1c-dacd-4d3a-9aea-8317a03c9ac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f94a6cc1595e4bfc9a777d0682713694'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:45.012123 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-08c88a1c-dacd-4d3a-9aea-8317a03c9ac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f94a6cc1595e4bfc9a777d0682713694'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:45.019073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1377/2760] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:56:44 2022] DELETE /identity/v3/users/f94a6cc1595e4bfc9a777d0682713694 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:56:45.024500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a09f07-f020-49bd-8793-593088b7d477 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:45.025063 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a09f07-f020-49bd-8793-593088b7d477 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:45.025063 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a09f07-f020-49bd-8793-593088b7d477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:45.048475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-71a09f07-f020-49bd-8793-593088b7d477 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:56:45.049804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-71a09f07-f020-49bd-8793-593088b7d477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:45.115595 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1384/2761] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:56:45.125311 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c88a1c-dacd-4d3a-9aea-8317a03c9ac9 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:45.126790 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-08c88a1c-dacd-4d3a-9aea-8317a03c9ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:45.193452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c88a1c-dacd-4d3a-9aea-8317a03c9ac9 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:45.197194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ba6ad-651c-49f7-b5cd-a6a18fad6727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:45.197849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ba6ad-651c-49f7-b5cd-a6a18fad6727 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:45.198130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ba6ad-651c-49f7-b5cd-a6a18fad6727 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:45.198405 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ba6ad-651c-49f7-b5cd-a6a18fad6727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:45.208226 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ba6ad-651c-49f7-b5cd-a6a18fad6727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:45.209884 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ba6ad-651c-49f7-b5cd-a6a18fad6727 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:45.220557 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1378/2762] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:56:45.519190 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a09f07-f020-49bd-8793-593088b7d477 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:45.521207 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-71a09f07-f020-49bd-8793-593088b7d477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:45.543879 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a09f07-f020-49bd-8793-593088b7d477 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:45.549494 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9b431-4bbe-4c2f-b0df-65c4aa8fac8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:45.550592 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9b431-4bbe-4c2f-b0df-65c4aa8fac8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:45.551143 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9b431-4bbe-4c2f-b0df-65c4aa8fac8e admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:45.551506 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9b431-4bbe-4c2f-b0df-65c4aa8fac8e admin admin] PATH_INFO: `/v3/projects/0df3fe3b4c584fb7a75c27d5d5e797c2` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:45.552913 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9b431-4bbe-4c2f-b0df-65c4aa8fac8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0df3fe3b4c584fb7a75c27d5d5e797c2)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:45.555026 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9b431-4bbe-4c2f-b0df-65c4aa8fac8e admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:45.610307 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-c6f9b431-4bbe-4c2f-b0df-65c4aa8fac8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0df3fe3b4c584fb7a75c27d5d5e797c2', 'request_id': 'req-c6f9b431-4bbe-4c2f-b0df-65c4aa8fac8e'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:45.616473 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-c6f9b431-4bbe-4c2f-b0df-65c4aa8fac8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0df3fe3b4c584fb7a75c27d5d5e797c2', 'request_id': 'req-c6f9b431-4bbe-4c2f-b0df-65c4aa8fac8e'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:45.628045 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-c6f9b431-4bbe-4c2f-b0df-65c4aa8fac8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0df3fe3b4c584fb7a75c27d5d5e797c2', 'request_id': 'req-c6f9b431-4bbe-4c2f-b0df-65c4aa8fac8e'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:45.642126 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-c6f9b431-4bbe-4c2f-b0df-65c4aa8fac8e admin admin] The token cache is being invalidate because project 0df3fe3b4c584fb7a75c27d5d5e797c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:56:45.642522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-c6f9b431-4bbe-4c2f-b0df-65c4aa8fac8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:45.643240 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-c6f9b431-4bbe-4c2f-b0df-65c4aa8fac8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:45.644916 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1385/2763] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:56:45 2022] DELETE /identity/v3/projects/0df3fe3b4c584fb7a75c27d5d5e797c2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:56:45.650046 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f577c75-6210-4873-84fc-388b1db94b30 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:45.650335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f577c75-6210-4873-84fc-388b1db94b30 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:45.650618 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f577c75-6210-4873-84fc-388b1db94b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:45.669894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-4f577c75-6210-4873-84fc-388b1db94b30 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:56:45.671151 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-4f577c75-6210-4873-84fc-388b1db94b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:45.689954 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:45.741744 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1379/2764] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:56:45.750445 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d516f7c-4113-4974-a4fc-3fde242820e3 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:45.750732 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d516f7c-4113-4974-a4fc-3fde242820e3 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:45.751015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d516f7c-4113-4974-a4fc-3fde242820e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:45.770894 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-7d516f7c-4113-4974-a4fc-3fde242820e3 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:56:45.772135 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-7d516f7c-4113-4974-a4fc-3fde242820e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:45.780316 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1386/2765] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:56:45.785233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f577c75-6210-4873-84fc-388b1db94b30 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:45.797025 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f577c75-6210-4873-84fc-388b1db94b30 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:45.802067 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76f770-3757-401a-91b8-5abb77fd577d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:45.802754 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76f770-3757-401a-91b8-5abb77fd577d admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:45.803029 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76f770-3757-401a-91b8-5abb77fd577d admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:45.803335 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76f770-3757-401a-91b8-5abb77fd577d admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:45.804089 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76f770-3757-401a-91b8-5abb77fd577d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:56:45.804393 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76f770-3757-401a-91b8-5abb77fd577d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:45.806041 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b76f770-3757-401a-91b8-5abb77fd577d admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:45.827924 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1380/2766] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:56:45.832387 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d516f7c-4113-4974-a4fc-3fde242820e3 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:45.838113 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:45.843876 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d516f7c-4113-4974-a4fc-3fde242820e3 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:45.851013 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bce25b-3a9d-431f-ae38-1e55d3fd6dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:45.851627 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bce25b-3a9d-431f-ae38-1e55d3fd6dac admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:45.851966 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bce25b-3a9d-431f-ae38-1e55d3fd6dac admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:45.852460 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bce25b-3a9d-431f-ae38-1e55d3fd6dac admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:45.853202 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bce25b-3a9d-431f-ae38-1e55d3fd6dac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:45.855155 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bce25b-3a9d-431f-ae38-1e55d3fd6dac admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:45.887092 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1387/2767] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:56:45 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:56:45.896842 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76f770-3757-401a-91b8-5abb77fd577d admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:45.913082 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76f770-3757-401a-91b8-5abb77fd577d admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:45.990658 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bce25b-3a9d-431f-ae38-1e55d3fd6dac admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:45.992697 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-84bce25b-3a9d-431f-ae38-1e55d3fd6dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:46.005248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db0dcd-bc4a-447f-aea8-588abeb6ae9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:46.005958 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db0dcd-bc4a-447f-aea8-588abeb6ae9f admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:46.006186 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db0dcd-bc4a-447f-aea8-588abeb6ae9f admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:46.006588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db0dcd-bc4a-447f-aea8-588abeb6ae9f admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:46.007146 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db0dcd-bc4a-447f-aea8-588abeb6ae9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:46.009134 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db0dcd-bc4a-447f-aea8-588abeb6ae9f admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:46.031372 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1381/2768] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:56:45 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:56:46.035658 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db0dcd-bc4a-447f-aea8-588abeb6ae9f admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:46.051705 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db0dcd-bc4a-447f-aea8-588abeb6ae9f admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:46.059940 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80adcba-fd3b-42da-ae68-c7551c95b93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:46.060965 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80adcba-fd3b-42da-ae68-c7551c95b93e admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:46.061443 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80adcba-fd3b-42da-ae68-c7551c95b93e admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:46.061734 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bce25b-3a9d-431f-ae38-1e55d3fd6dac admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:46.062196 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80adcba-fd3b-42da-ae68-c7551c95b93e admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:46.063194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80adcba-fd3b-42da-ae68-c7551c95b93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:46.065795 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80adcba-fd3b-42da-ae68-c7551c95b93e admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:46.066413 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef175f-562c-4abc-989b-b6f258415db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:46.067085 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef175f-562c-4abc-989b-b6f258415db1 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:46.067417 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef175f-562c-4abc-989b-b6f258415db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:46.067866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef175f-562c-4abc-989b-b6f258415db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:46.069690 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-96ef175f-562c-4abc-989b-b6f258415db1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:46.081792 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1382/2769] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:56:46.083477 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80adcba-fd3b-42da-ae68-c7551c95b93e admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:46.090924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef175f-562c-4abc-989b-b6f258415db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:46.093654 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef175f-562c-4abc-989b-b6f258415db1 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:46.096507 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80adcba-fd3b-42da-ae68-c7551c95b93e admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:46.102426 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f756156b-69c5-4807-ac42-25be80c5cc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:46.104401 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756156b-69c5-4807-ac42-25be80c5cc8b admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:46.104401 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756156b-69c5-4807-ac42-25be80c5cc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:46.104401 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f756156b-69c5-4807-ac42-25be80c5cc8b admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:46.105025 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756156b-69c5-4807-ac42-25be80c5cc8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:46.106420 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f756156b-69c5-4807-ac42-25be80c5cc8b admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:46.114362 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1388/2770] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:56:46.127319 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1383/2771] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:56:46.132251 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef175f-562c-4abc-989b-b6f258415db1 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:46.147175 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef175f-562c-4abc-989b-b6f258415db1 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:46.152781 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b4abf-8acd-4ad4-afe0-86144461df42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:46.153919 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b4abf-8acd-4ad4-afe0-86144461df42 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:46.154285 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b4abf-8acd-4ad4-afe0-86144461df42 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:46.155378 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b4abf-8acd-4ad4-afe0-86144461df42 admin admin] PATH_INFO: `/v3/projects/ff2fd200c0bd4039abb7f280d43a7d76/users/5235248d8a96401f96e797262017f5df/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:46.175110 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b4abf-8acd-4ad4-afe0-86144461df42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff2fd200c0bd4039abb7f280d43a7d76, user_id=5235248d8a96401f96e797262017f5df, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:46.178546 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b4abf-8acd-4ad4-afe0-86144461df42 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:46.199505 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1389/2772] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:56:46 2022] PUT /identity/v3/projects/ff2fd200c0bd4039abb7f280d43a7d76/users/5235248d8a96401f96e797262017f5df/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:56:46.204882 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7052a08-cec5-45e6-92c1-5ef7d62ed94f None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:46.205534 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7052a08-cec5-45e6-92c1-5ef7d62ed94f None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:46.205694 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7052a08-cec5-45e6-92c1-5ef7d62ed94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:46.226591 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-f7052a08-cec5-45e6-92c1-5ef7d62ed94f None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:56:46.228145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-f7052a08-cec5-45e6-92c1-5ef7d62ed94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:46.324997 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1384/2773] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:56:46.336041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b4abf-8acd-4ad4-afe0-86144461df42 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:46.337866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-9f9b4abf-8acd-4ad4-afe0-86144461df42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:46.434834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b4abf-8acd-4ad4-afe0-86144461df42 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:46.441597 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898b18c-48bd-42ef-9168-6d679546f666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:46.442475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898b18c-48bd-42ef-9168-6d679546f666 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:46.442761 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898b18c-48bd-42ef-9168-6d679546f666 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:46.443041 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898b18c-48bd-42ef-9168-6d679546f666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:46.454392 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898b18c-48bd-42ef-9168-6d679546f666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:46.455806 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898b18c-48bd-42ef-9168-6d679546f666 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:46.466747 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1390/2774] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:56:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:56:50.728084 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7052a08-cec5-45e6-92c1-5ef7d62ed94f None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:50.729826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-f7052a08-cec5-45e6-92c1-5ef7d62ed94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:50.743290 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7052a08-cec5-45e6-92c1-5ef7d62ed94f None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:50.757359 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79349980-92f9-4f55-a11e-540437aab97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:50.760189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79349980-92f9-4f55-a11e-540437aab97c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:50.760973 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79349980-92f9-4f55-a11e-540437aab97c admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:50.761703 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79349980-92f9-4f55-a11e-540437aab97c admin admin] PATH_INFO: `/v3/users/51a4587770ba48f480de96dfd5162bf3` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:50.765917 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79349980-92f9-4f55-a11e-540437aab97c admin admin] RBAC: Authorizing `identity:delete_user(user_id=51a4587770ba48f480de96dfd5162bf3)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:50.770413 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79349980-92f9-4f55-a11e-540437aab97c admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:50.796563 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:50.846555 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-79349980-92f9-4f55-a11e-540437aab97c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51a4587770ba48f480de96dfd5162bf3'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:50.858575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-79349980-92f9-4f55-a11e-540437aab97c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51a4587770ba48f480de96dfd5162bf3'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:50.885778 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-79349980-92f9-4f55-a11e-540437aab97c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51a4587770ba48f480de96dfd5162bf3'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:50.885778 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-79349980-92f9-4f55-a11e-540437aab97c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51a4587770ba48f480de96dfd5162bf3'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:50.899301 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-79349980-92f9-4f55-a11e-540437aab97c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51a4587770ba48f480de96dfd5162bf3'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:50.903535 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1385/2775] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:56:50 2022] DELETE /identity/v3/users/51a4587770ba48f480de96dfd5162bf3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:56:51.364714 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898b18c-48bd-42ef-9168-6d679546f666 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:51.392835 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898b18c-48bd-42ef-9168-6d679546f666 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:51.500015 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cd76f-c704-400e-a6c3-a382f9254822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:51.502961 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cd76f-c704-400e-a6c3-a382f9254822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:51.503817 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cd76f-c704-400e-a6c3-a382f9254822 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:51.504802 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cd76f-c704-400e-a6c3-a382f9254822 admin admin] PATH_INFO: `/v3/projects/c18db8feb06040198f3bc00c84792de0` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:51.506695 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528cd76f-c704-400e-a6c3-a382f9254822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c18db8feb06040198f3bc00c84792de0)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:51.510632 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528cd76f-c704-400e-a6c3-a382f9254822 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:51.523646 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:51.603090 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-528cd76f-c704-400e-a6c3-a382f9254822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c18db8feb06040198f3bc00c84792de0', 'request_id': 'req-528cd76f-c704-400e-a6c3-a382f9254822'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:51.614933 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-528cd76f-c704-400e-a6c3-a382f9254822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c18db8feb06040198f3bc00c84792de0', 'request_id': 'req-528cd76f-c704-400e-a6c3-a382f9254822'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:51.631097 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-528cd76f-c704-400e-a6c3-a382f9254822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c18db8feb06040198f3bc00c84792de0', 'request_id': 'req-528cd76f-c704-400e-a6c3-a382f9254822'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:51.656450 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-528cd76f-c704-400e-a6c3-a382f9254822 admin admin] The token cache is being invalidate because project c18db8feb06040198f3bc00c84792de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:56:51.656808 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-528cd76f-c704-400e-a6c3-a382f9254822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:51.659167 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-528cd76f-c704-400e-a6c3-a382f9254822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:56:51.665916 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1391/2776] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:56:51 2022] DELETE /identity/v3/projects/c18db8feb06040198f3bc00c84792de0 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 20:56:51.668080 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390931a1-1d3f-4356-931a-309523513087 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:51.668370 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390931a1-1d3f-4356-931a-309523513087 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:51.668652 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390931a1-1d3f-4356-931a-309523513087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:51.696303 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-390931a1-1d3f-4356-931a-309523513087 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:56:51.698699 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-390931a1-1d3f-4356-931a-309523513087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:51.852775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1386/2777] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:56:51.862141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939995f-975e-4726-b389-6c2fa13070b9 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:51.862665 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939995f-975e-4726-b389-6c2fa13070b9 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:51.863990 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939995f-975e-4726-b389-6c2fa13070b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:51.924121 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-9939995f-975e-4726-b389-6c2fa13070b9 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:56:51.926331 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-9939995f-975e-4726-b389-6c2fa13070b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:51.936994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1392/2778] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:56:51.941350 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390931a1-1d3f-4356-931a-309523513087 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:51.952534 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390931a1-1d3f-4356-931a-309523513087 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:51.958178 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81df7e-5249-42d7-a67d-155498cfa4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:51.959143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81df7e-5249-42d7-a67d-155498cfa4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:51.959667 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81df7e-5249-42d7-a67d-155498cfa4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:51.960121 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81df7e-5249-42d7-a67d-155498cfa4f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:51.961074 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81df7e-5249-42d7-a67d-155498cfa4f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 20:56:51.961563 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81df7e-5249-42d7-a67d-155498cfa4f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:51.963839 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81df7e-5249-42d7-a67d-155498cfa4f0 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:51.985526 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939995f-975e-4726-b389-6c2fa13070b9 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:51.990387 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1387/2779] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 20:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 20:56:51.996325 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939995f-975e-4726-b389-6c2fa13070b9 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:52.001805 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414eae5-5e4f-46b1-92a3-c794d62bc7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:52.002775 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414eae5-5e4f-46b1-92a3-c794d62bc7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:52.003192 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414eae5-5e4f-46b1-92a3-c794d62bc7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:52.003639 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414eae5-5e4f-46b1-92a3-c794d62bc7d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:52.004505 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414eae5-5e4f-46b1-92a3-c794d62bc7d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:52.006424 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414eae5-5e4f-46b1-92a3-c794d62bc7d6 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:52.057823 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1393/2780] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:56:51 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:56:52.063040 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81df7e-5249-42d7-a67d-155498cfa4f0 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:52.075539 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81df7e-5249-42d7-a67d-155498cfa4f0 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:52.201316 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee3a65-2c21-4661-939d-00a55e4e2c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:52.202274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee3a65-2c21-4661-939d-00a55e4e2c18 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:52.202903 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee3a65-2c21-4661-939d-00a55e4e2c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:52.203314 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee3a65-2c21-4661-939d-00a55e4e2c18 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:52.204076 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee3a65-2c21-4661-939d-00a55e4e2c18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:52.206836 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee3a65-2c21-4661-939d-00a55e4e2c18 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:52.275249 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c66033-7d34-4ae5-b787-d3ac71c407ba None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:52.277757 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c66033-7d34-4ae5-b787-d3ac71c407ba None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:52.278056 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c66033-7d34-4ae5-b787-d3ac71c407ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:52.300287 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1388/2781] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:56:52 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:56:52.306359 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee3a65-2c21-4661-939d-00a55e4e2c18 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:52.323049 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee3a65-2c21-4661-939d-00a55e4e2c18 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:52.328897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-a2c66033-7d34-4ae5-b787-d3ac71c407ba None None] MFA Rules not processed for user `5235248d8a96401f96e797262017f5df`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:56:52.330497 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a2c66033-7d34-4ae5-b787-d3ac71c407ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:52.347548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13f7e9-14dd-4027-ab74-56b62494f28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:52.348867 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13f7e9-14dd-4027-ab74-56b62494f28f admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:52.349348 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13f7e9-14dd-4027-ab74-56b62494f28f admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:52.351817 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13f7e9-14dd-4027-ab74-56b62494f28f admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:52.353358 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13f7e9-14dd-4027-ab74-56b62494f28f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:52.356751 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13f7e9-14dd-4027-ab74-56b62494f28f admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:52.360296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:52.381971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1389/2782] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 20:56:52.383226 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13f7e9-14dd-4027-ab74-56b62494f28f admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:52.405218 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13f7e9-14dd-4027-ab74-56b62494f28f admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:52.414189 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8266c-21ac-4276-9311-9a44ba8bf133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:52.415051 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8266c-21ac-4276-9311-9a44ba8bf133 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:52.415575 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8266c-21ac-4276-9311-9a44ba8bf133 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:52.416051 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8266c-21ac-4276-9311-9a44ba8bf133 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:52.417619 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8266c-21ac-4276-9311-9a44ba8bf133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:52.421608 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8266c-21ac-4276-9311-9a44ba8bf133 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:52.442010 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1390/2783] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:56:52.443215 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8266c-21ac-4276-9311-9a44ba8bf133 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:52.454222 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8266c-21ac-4276-9311-9a44ba8bf133 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:52.456524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1394/2784] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:56:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:56:52.460353 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd81a5-96c2-47f9-a7f6-5636e52d966e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:52.461280 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd81a5-96c2-47f9-a7f6-5636e52d966e admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:52.461561 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd81a5-96c2-47f9-a7f6-5636e52d966e admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:52.461841 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd81a5-96c2-47f9-a7f6-5636e52d966e admin admin] PATH_INFO: `/v3/projects/5481801339524c5da2d233ff8e9debaf/users/32642b991f9c4508aee5fbb2f94a1c76/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:52.462152 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c66033-7d34-4ae5-b787-d3ac71c407ba None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:52.464062 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a2c66033-7d34-4ae5-b787-d3ac71c407ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:52.486897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c66033-7d34-4ae5-b787-d3ac71c407ba None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:52.487938 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd81a5-96c2-47f9-a7f6-5636e52d966e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5481801339524c5da2d233ff8e9debaf, user_id=32642b991f9c4508aee5fbb2f94a1c76, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:52.493723 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd81a5-96c2-47f9-a7f6-5636e52d966e admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:52.494033 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a8576-e4de-4e1f-91c7-2b175499a1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:52.494914 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a8576-e4de-4e1f-91c7-2b175499a1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:52.495215 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a8576-e4de-4e1f-91c7-2b175499a1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:52.495562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a8576-e4de-4e1f-91c7-2b175499a1e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:52.496252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a8576-e4de-4e1f-91c7-2b175499a1e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:52.499182 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a8576-e4de-4e1f-91c7-2b175499a1e1 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:52.522214 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1391/2785] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:56:52 2022] PUT /identity/v3/projects/5481801339524c5da2d233ff8e9debaf/users/32642b991f9c4508aee5fbb2f94a1c76/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:56:52.530616 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33395330-f03b-4068-98c2-713718d86c67 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:52.531764 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33395330-f03b-4068-98c2-713718d86c67 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:52.532807 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33395330-f03b-4068-98c2-713718d86c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:52.543341 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1395/2786] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 20:56:52 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 20:56:52.544879 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a8576-e4de-4e1f-91c7-2b175499a1e1 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:52.563556 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-33395330-f03b-4068-98c2-713718d86c67 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:56:52.565695 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-33395330-f03b-4068-98c2-713718d86c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:52.602404 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:52.654268 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1392/2787] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:56:52.655147 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a8576-e4de-4e1f-91c7-2b175499a1e1 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:52.663467 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c23860-79d3-4458-84a0-a4801bb22602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:52.664190 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c23860-79d3-4458-84a0-a4801bb22602 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:52.664477 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c23860-79d3-4458-84a0-a4801bb22602 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:52.664785 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c23860-79d3-4458-84a0-a4801bb22602 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:52.665537 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c23860-79d3-4458-84a0-a4801bb22602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:52.667038 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33395330-f03b-4068-98c2-713718d86c67 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:52.668625 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c23860-79d3-4458-84a0-a4801bb22602 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:52.669958 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-33395330-f03b-4068-98c2-713718d86c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:56:52.697531 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1396/2788] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 20:56:52 2022] POST /identity/v3/users => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 20:56:52.704275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c23860-79d3-4458-84a0-a4801bb22602 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:52.725221 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c23860-79d3-4458-84a0-a4801bb22602 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:52.731205 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fd956-2981-4879-b0c8-067e1a4985e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:52.732102 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fd956-2981-4879-b0c8-067e1a4985e6 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:52.732497 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fd956-2981-4879-b0c8-067e1a4985e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:52.733436 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fd956-2981-4879-b0c8-067e1a4985e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:52.734332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fd956-2981-4879-b0c8-067e1a4985e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:52.736161 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4fd956-2981-4879-b0c8-067e1a4985e6 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:52.747596 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1397/2789] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:56:52.755636 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fd956-2981-4879-b0c8-067e1a4985e6 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:52.767057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33395330-f03b-4068-98c2-713718d86c67 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:52.773175 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd17f5b-97f8-49f5-9d16-6290a6189ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:52.773943 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd17f5b-97f8-49f5-9d16-6290a6189ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:52.774327 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd17f5b-97f8-49f5-9d16-6290a6189ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:52.774780 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd17f5b-97f8-49f5-9d16-6290a6189ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:52.778080 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fd956-2981-4879-b0c8-067e1a4985e6 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:52.787894 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb229dd0-9613-437e-bd74-74c804d4025d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:52.788809 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb229dd0-9613-437e-bd74-74c804d4025d admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:52.789095 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb229dd0-9613-437e-bd74-74c804d4025d admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:52.789353 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb229dd0-9613-437e-bd74-74c804d4025d admin admin] PATH_INFO: `/v3/projects/c2647879a4d64bb19ba9eb88c99f26b5/users/bb88138b69724b7d80144cec1bb1f40b/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:52.794980 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd17f5b-97f8-49f5-9d16-6290a6189ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:52.796529 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd17f5b-97f8-49f5-9d16-6290a6189ac0 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:52.813937 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb229dd0-9613-437e-bd74-74c804d4025d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2647879a4d64bb19ba9eb88c99f26b5, user_id=bb88138b69724b7d80144cec1bb1f40b, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:52.816466 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1393/2790] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:56:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:56:52.818934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb229dd0-9613-437e-bd74-74c804d4025d admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:52.842086 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1398/2791] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:56:52 2022] PUT /identity/v3/projects/c2647879a4d64bb19ba9eb88c99f26b5/users/bb88138b69724b7d80144cec1bb1f40b/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:56:52.848278 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd17f5b-97f8-49f5-9d16-6290a6189ac0 service neutron] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:52.862379 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd17f5b-97f8-49f5-9d16-6290a6189ac0 service neutron] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:52.956610 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5e153-b2fb-4987-afb7-cca79add85e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:52.957776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5e153-b2fb-4987-afb7-cca79add85e1 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:52.957970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5e153-b2fb-4987-afb7-cca79add85e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:52.958349 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5e153-b2fb-4987-afb7-cca79add85e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:52.959863 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5e153-b2fb-4987-afb7-cca79add85e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:52.961815 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5e153-b2fb-4987-afb7-cca79add85e1 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:52.970328 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:56:52.982003 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb229dd0-9613-437e-bd74-74c804d4025d admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:56:52.982941 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1394/2792] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 20:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 20:56:52.993569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb229dd0-9613-437e-bd74-74c804d4025d admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:56:52.999063 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b546fc3-a27f-473b-a889-3214cd22f3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:56:53.000164 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b546fc3-a27f-473b-a889-3214cd22f3ed admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:56:53.000478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b546fc3-a27f-473b-a889-3214cd22f3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:56:53.000774 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b546fc3-a27f-473b-a889-3214cd22f3ed admin admin] PATH_INFO: `/v3/projects/c2647879a4d64bb19ba9eb88c99f26b5/users/bb88138b69724b7d80144cec1bb1f40b/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:56:53.003194 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b546fc3-a27f-473b-a889-3214cd22f3ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2647879a4d64bb19ba9eb88c99f26b5, user_id=bb88138b69724b7d80144cec1bb1f40b, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:56:53.005975 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b546fc3-a27f-473b-a889-3214cd22f3ed admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:56:53.023709 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1399/2793] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 20:56:52 2022] PUT /identity/v3/projects/c2647879a4d64bb19ba9eb88c99f26b5/users/bb88138b69724b7d80144cec1bb1f40b/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:57:00.312821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e9691-fb72-4d01-8d0b-85bc6f34387c None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:57:00.313735 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e9691-fb72-4d01-8d0b-85bc6f34387c None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:57:00.313735 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e9691-fb72-4d01-8d0b-85bc6f34387c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:57:00.353730 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-f26e9691-fb72-4d01-8d0b-85bc6f34387c None None] MFA Rules not processed for user `32642b991f9c4508aee5fbb2f94a1c76`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:57:00.355136 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-f26e9691-fb72-4d01-8d0b-85bc6f34387c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:57:00.449619 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1395/2794] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:57:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 20:57:00.476957 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b546fc3-a27f-473b-a889-3214cd22f3ed admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:57:00.479655 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-0b546fc3-a27f-473b-a889-3214cd22f3ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:57:00.642425 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b546fc3-a27f-473b-a889-3214cd22f3ed admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:57:00.656687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0fca5-e47c-4d0f-9977-c7e0f2a696d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:57:00.657926 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0fca5-e47c-4d0f-9977-c7e0f2a696d9 service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:57:00.658383 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0fca5-e47c-4d0f-9977-c7e0f2a696d9 service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:57:00.658837 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0fca5-e47c-4d0f-9977-c7e0f2a696d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:57:00.687284 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0fca5-e47c-4d0f-9977-c7e0f2a696d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:57:00.688815 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0fca5-e47c-4d0f-9977-c7e0f2a696d9 service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:57:00.719811 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1400/2795] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:57:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:57:01.035415 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57e2c2-3241-40e2-bb96-4f53b84af978 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:57:01.035883 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57e2c2-3241-40e2-bb96-4f53b84af978 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:57:01.036263 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57e2c2-3241-40e2-bb96-4f53b84af978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:57:01.097664 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-0f57e2c2-3241-40e2-bb96-4f53b84af978 None None] MFA Rules not processed for user `bb88138b69724b7d80144cec1bb1f40b`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:57:01.099028 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-0f57e2c2-3241-40e2-bb96-4f53b84af978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:57:01.205186 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1396/2796] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:57:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:57:01.219055 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0fca5-e47c-4d0f-9977-c7e0f2a696d9 service nova] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:57:01.220737 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-d1b0fca5-e47c-4d0f-9977-c7e0f2a696d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:57:01.272936 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:01.290139 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0fca5-e47c-4d0f-9977-c7e0f2a696d9 service nova] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:57:01.295569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f945217-567b-4069-aa46-0c5cda56c1c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d9a41e10cb64ee9972debaf856503d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:57:01.296507 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f945217-567b-4069-aa46-0c5cda56c1c3 service glance] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:57:01.297032 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f945217-567b-4069-aa46-0c5cda56c1c3 service glance] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:57:01.297546 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f945217-567b-4069-aa46-0c5cda56c1c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:57:01.381323 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f945217-567b-4069-aa46-0c5cda56c1c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:57:01.383109 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f945217-567b-4069-aa46-0c5cda56c1c3 service glance] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:57:01.394893 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1401/2797] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:57:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:57:01.525636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56aa8f-f12f-4fee-b316-1ec16109023f None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:57:01.526130 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56aa8f-f12f-4fee-b316-1ec16109023f None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:57:01.526230 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56aa8f-f12f-4fee-b316-1ec16109023f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:57:01.595153 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-ba56aa8f-f12f-4fee-b316-1ec16109023f None None] MFA Rules not processed for user `c8f314167aa94d81955ac761a5a28504`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:57:01.596533 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-ba56aa8f-f12f-4fee-b316-1ec16109023f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:57:01.666680 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1397/2798] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jul 19 20:57:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:57:01.721288 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f945217-567b-4069-aa46-0c5cda56c1c3 service glance] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:57:01.722958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3f945217-567b-4069-aa46-0c5cda56c1c3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:57:01.827013 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f945217-567b-4069-aa46-0c5cda56c1c3 service glance] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:57:01.832748 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035eb39d-a4cc-4de1-bb22-0559b1ea9eeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7987846276ad4ccd90899128ceb1354e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:57:01.833784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035eb39d-a4cc-4de1-bb22-0559b1ea9eeb service swift] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:57:01.834308 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035eb39d-a4cc-4de1-bb22-0559b1ea9eeb service swift] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:57:01.834798 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035eb39d-a4cc-4de1-bb22-0559b1ea9eeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:57:01.850897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035eb39d-a4cc-4de1-bb22-0559b1ea9eeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:57:01.852975 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035eb39d-a4cc-4de1-bb22-0559b1ea9eeb service swift] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:57:01.864916 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1402/2799] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jul 19 20:57:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 20:57:03.903392 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f4b24-45f5-4850-a2af-7e1927717088 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:57:03.903960 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f4b24-45f5-4850-a2af-7e1927717088 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:57:03.907095 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f4b24-45f5-4850-a2af-7e1927717088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:57:03.941351 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-760f4b24-45f5-4850-a2af-7e1927717088 None None] MFA Rules not processed for user `32642b991f9c4508aee5fbb2f94a1c76`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:57:03.942777 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-760f4b24-45f5-4850-a2af-7e1927717088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:57:03.961524 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1398/2800] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:57:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:57:04.488981 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035eb39d-a4cc-4de1-bb22-0559b1ea9eeb service swift] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:57:04.605182 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035eb39d-a4cc-4de1-bb22-0559b1ea9eeb service swift] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:57:04.612856 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92458e26-a337-412e-ba75-bc41e236c85c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:57:04.613639 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92458e26-a337-412e-ba75-bc41e236c85c service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:57:04.613861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92458e26-a337-412e-ba75-bc41e236c85c service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:57:04.614606 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92458e26-a337-412e-ba75-bc41e236c85c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:57:04.617812 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-92458e26-a337-412e-ba75-bc41e236c85c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:57:04.638200 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92458e26-a337-412e-ba75-bc41e236c85c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:57:04.640530 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92458e26-a337-412e-ba75-bc41e236c85c service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:57:04.681444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1403/2801] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:57:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 20:57:13.940149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=98 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:13.948363 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6481a9-2992-45fb-80bf-ebd87dd75d8f None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:57:13.948662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6481a9-2992-45fb-80bf-ebd87dd75d8f None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:57:13.949047 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6481a9-2992-45fb-80bf-ebd87dd75d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:57:13.977802 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-5a6481a9-2992-45fb-80bf-ebd87dd75d8f None None] MFA Rules not processed for user `5235248d8a96401f96e797262017f5df`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:57:13.979790 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-5a6481a9-2992-45fb-80bf-ebd87dd75d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:57:13.992108 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1399/2802] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:57:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:57:14.658678 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=88 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:16.629171 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41f5ee-927a-4aeb-bbd1-aaa1f216abcf None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:57:16.629776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41f5ee-927a-4aeb-bbd1-aaa1f216abcf None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:57:16.629776 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41f5ee-927a-4aeb-bbd1-aaa1f216abcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:57:16.647587 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-bc41f5ee-927a-4aeb-bbd1-aaa1f216abcf None None] MFA Rules not processed for user `c8f314167aa94d81955ac761a5a28504`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:57:16.648899 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-bc41f5ee-927a-4aeb-bbd1-aaa1f216abcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:57:16.656240 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1404/2803] 10.222.0.77 () {58 vars in 1009 bytes} [Tue Jul 19 20:57:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:57:16.668282 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6481a9-2992-45fb-80bf-ebd87dd75d8f None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:57:16.680486 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6481a9-2992-45fb-80bf-ebd87dd75d8f None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:57:16.686011 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c40a79-78d2-4dda-aa41-802f2722f77e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7987846276ad4ccd90899128ceb1354e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:57:16.686666 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c40a79-78d2-4dda-aa41-802f2722f77e service swift] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:57:16.686955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c40a79-78d2-4dda-aa41-802f2722f77e service swift] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:57:16.687317 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c40a79-78d2-4dda-aa41-802f2722f77e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:57:16.699158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c40a79-78d2-4dda-aa41-802f2722f77e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:57:16.700770 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c40a79-78d2-4dda-aa41-802f2722f77e service swift] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:57:16.711226 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1400/2804] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jul 19 20:57:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 20:57:26.642534 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:26.707169 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=9 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:57:38.868159 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41f5ee-927a-4aeb-bbd1-aaa1f216abcf None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:57:38.881443 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41f5ee-927a-4aeb-bbd1-aaa1f216abcf None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:57:38.886921 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af687d-edc8-4b43-b644-11246eef4449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:57:38.887813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af687d-edc8-4b43-b644-11246eef4449 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:57:38.888345 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af687d-edc8-4b43-b644-11246eef4449 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:57:38.889845 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af687d-edc8-4b43-b644-11246eef4449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:57:38.903922 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af687d-edc8-4b43-b644-11246eef4449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:57:38.905382 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af687d-edc8-4b43-b644-11246eef4449 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:57:38.918576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1405/2805] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:57:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:57:48.911604 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=6 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:06.433717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94d1c4-e585-449a-a359-b3ecc5e09f07 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:58:06.434354 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94d1c4-e585-449a-a359-b3ecc5e09f07 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:58:06.434354 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94d1c4-e585-449a-a359-b3ecc5e09f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:58:06.452994 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-4b94d1c4-e585-449a-a359-b3ecc5e09f07 None None] MFA Rules not processed for user `32642b991f9c4508aee5fbb2f94a1c76`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:58:06.454233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-4b94d1c4-e585-449a-a359-b3ecc5e09f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:58:06.461532 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1401/2806] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:58:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:58:16.425431 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af687d-edc8-4b43-b644-11246eef4449 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:58:16.434794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af687d-edc8-4b43-b644-11246eef4449 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:58:16.438479 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5231fc-f3f2-4e4d-94b5-75765a357792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:58:16.439119 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5231fc-f3f2-4e4d-94b5-75765a357792 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:58:16.439440 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5231fc-f3f2-4e4d-94b5-75765a357792 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:58:16.439720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5231fc-f3f2-4e4d-94b5-75765a357792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:58:16.441510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-4d5231fc-f3f2-4e4d-94b5-75765a357792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:58:16.446742 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:16.456955 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5231fc-f3f2-4e4d-94b5-75765a357792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:58:16.458661 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5231fc-f3f2-4e4d-94b5-75765a357792 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:58:16.469963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1406/2807] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:58:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:58:16.954692 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94d1c4-e585-449a-a359-b3ecc5e09f07 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:58:16.969237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94d1c4-e585-449a-a359-b3ecc5e09f07 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:58:16.973506 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146a057-e468-4e66-b1d7-4e8a75c320a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:58:16.974205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146a057-e468-4e66-b1d7-4e8a75c320a6 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:58:16.974520 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146a057-e468-4e66-b1d7-4e8a75c320a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:58:16.974795 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146a057-e468-4e66-b1d7-4e8a75c320a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:58:16.977250 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9146a057-e468-4e66-b1d7-4e8a75c320a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:58:16.993917 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146a057-e468-4e66-b1d7-4e8a75c320a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:58:16.995425 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146a057-e468-4e66-b1d7-4e8a75c320a6 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:58:17.010586 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1402/2808] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:58:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:58:26.464836 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=6 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:58:27.003667 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=6 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:06.117641 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5231fc-f3f2-4e4d-94b5-75765a357792 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:59:06.118771 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-4d5231fc-f3f2-4e4d-94b5-75765a357792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:59:06.134874 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5231fc-f3f2-4e4d-94b5-75765a357792 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:59:06.144142 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033611f-ae76-4501-b227-44e01659042f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:59:06.145073 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033611f-ae76-4501-b227-44e01659042f service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:59:06.145249 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033611f-ae76-4501-b227-44e01659042f service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:59:06.145411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033611f-ae76-4501-b227-44e01659042f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:59:06.148013 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-6033611f-ae76-4501-b227-44e01659042f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:59:06.164335 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033611f-ae76-4501-b227-44e01659042f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:59:06.166319 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033611f-ae76-4501-b227-44e01659042f service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:59:06.190635 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1407/2809] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:59:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:59:11.934286 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146a057-e468-4e66-b1d7-4e8a75c320a6 service neutron] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:59:11.935857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-9146a057-e468-4e66-b1d7-4e8a75c320a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:59:11.947387 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146a057-e468-4e66-b1d7-4e8a75c320a6 service neutron] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:59:11.951931 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b323ea-0f1f-416d-8088-50e09f7dfe7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:59:11.952886 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b323ea-0f1f-416d-8088-50e09f7dfe7f service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:59:11.953344 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b323ea-0f1f-416d-8088-50e09f7dfe7f service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:59:11.953981 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b323ea-0f1f-416d-8088-50e09f7dfe7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:59:11.957438 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-91b323ea-0f1f-416d-8088-50e09f7dfe7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:59:11.976820 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b323ea-0f1f-416d-8088-50e09f7dfe7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:59:11.979514 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b323ea-0f1f-416d-8088-50e09f7dfe7f service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:59:11.997749 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1403/2810] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:59:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:59:16.173780 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=6 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:17.125515 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2ebed-c903-4eab-a63b-4fd08d79a3a9 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:59:17.125805 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2ebed-c903-4eab-a63b-4fd08d79a3a9 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:59:17.126085 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2ebed-c903-4eab-a63b-4fd08d79a3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:59:17.144749 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-43f2ebed-c903-4eab-a63b-4fd08d79a3a9 None None] MFA Rules not processed for user `32642b991f9c4508aee5fbb2f94a1c76`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:59:17.145965 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-43f2ebed-c903-4eab-a63b-4fd08d79a3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:59:17.153064 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1408/2811] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 20:59:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:59:17.785531 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b323ea-0f1f-416d-8088-50e09f7dfe7f service neutron] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:59:17.787077 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-91b323ea-0f1f-416d-8088-50e09f7dfe7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:59:17.861073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b323ea-0f1f-416d-8088-50e09f7dfe7f service neutron] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:59:17.866574 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece46d2-1966-4e4c-a6d3-d31548a65206 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04843ec31eb84585944c7a2b9cd1c0cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:59:17.867242 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece46d2-1966-4e4c-a6d3-d31548a65206 service placement] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:59:17.867588 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece46d2-1966-4e4c-a6d3-d31548a65206 service placement] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:59:17.867873 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece46d2-1966-4e4c-a6d3-d31548a65206 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:59:17.869757 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-2ece46d2-1966-4e4c-a6d3-d31548a65206 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:59:17.883595 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece46d2-1966-4e4c-a6d3-d31548a65206 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:59:17.885889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece46d2-1966-4e4c-a6d3-d31548a65206 service placement] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:59:17.897905 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1404/2812] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:59:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:59:25.928618 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2ebed-c903-4eab-a63b-4fd08d79a3a9 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:59:25.942895 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2ebed-c903-4eab-a63b-4fd08d79a3a9 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:59:25.948610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7700bd5-0131-428a-abc7-1ce87a2f9472 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:59:25.949309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7700bd5-0131-428a-abc7-1ce87a2f9472 service nova] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:59:25.949593 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7700bd5-0131-428a-abc7-1ce87a2f9472 service nova] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:59:25.949865 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7700bd5-0131-428a-abc7-1ce87a2f9472 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:59:25.951741 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-f7700bd5-0131-428a-abc7-1ce87a2f9472 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:59:25.967843 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7700bd5-0131-428a-abc7-1ce87a2f9472 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:59:25.969558 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7700bd5-0131-428a-abc7-1ce87a2f9472 service nova] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:59:25.984088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1409/2813] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:59:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:59:27.893017 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=38 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:29.735297 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece46d2-1966-4e4c-a6d3-d31548a65206 service placement] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:59:29.747943 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece46d2-1966-4e4c-a6d3-d31548a65206 service placement] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:59:29.753538 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f622e2-455b-4be3-8b7d-59be085813e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dbbb8f7b3f2449fb9c64ca3815b6c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:59:29.754194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f622e2-455b-4be3-8b7d-59be085813e2 service nova] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:59:29.754482 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f622e2-455b-4be3-8b7d-59be085813e2 service nova] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:59:29.754765 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f622e2-455b-4be3-8b7d-59be085813e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:59:29.756623 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-24f622e2-455b-4be3-8b7d-59be085813e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:59:29.769939 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f622e2-455b-4be3-8b7d-59be085813e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:59:29.771560 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f622e2-455b-4be3-8b7d-59be085813e2 service nova] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:59:29.783789 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1405/2814] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:59:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:59:35.979035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=9 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:39.778731 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=6 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:41.915054 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44e92d-f8bd-46fb-b29b-35061ebadd12 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:59:41.915623 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44e92d-f8bd-46fb-b29b-35061ebadd12 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:59:41.915623 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44e92d-f8bd-46fb-b29b-35061ebadd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:59:41.981458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-9a44e92d-f8bd-46fb-b29b-35061ebadd12 None None] MFA Rules not processed for user `c8f314167aa94d81955ac761a5a28504`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 20:59:41.983167 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-9a44e92d-f8bd-46fb-b29b-35061ebadd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:59:42.005078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1410/2815] 10.222.0.77 () {58 vars in 967 bytes} [Tue Jul 19 20:59:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 20:59:42.062590 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f622e2-455b-4be3-8b7d-59be085813e2 service nova] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:59:42.089263 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f622e2-455b-4be3-8b7d-59be085813e2 service nova] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:59:42.095482 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f0fbe-3faf-4dac-8a3d-4ab90ab65027 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7987846276ad4ccd90899128ceb1354e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:59:42.096222 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f0fbe-3faf-4dac-8a3d-4ab90ab65027 service swift] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:59:42.096581 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f0fbe-3faf-4dac-8a3d-4ab90ab65027 service swift] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:59:42.096866 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f0fbe-3faf-4dac-8a3d-4ab90ab65027 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:59:42.107589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f0fbe-3faf-4dac-8a3d-4ab90ab65027 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:59:42.109198 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f0fbe-3faf-4dac-8a3d-4ab90ab65027 service swift] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:59:42.118170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1406/2816] 10.222.0.77 () {60 vars in 1384 bytes} [Tue Jul 19 20:59:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 20:59:49.384108 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44e92d-f8bd-46fb-b29b-35061ebadd12 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:59:49.387093 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-9a44e92d-f8bd-46fb-b29b-35061ebadd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:59:49.404441 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44e92d-f8bd-46fb-b29b-35061ebadd12 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:59:49.410258 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d28da-7f45-41ad-8a15-c64972bce3c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04843ec31eb84585944c7a2b9cd1c0cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:59:49.411214 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d28da-7f45-41ad-8a15-c64972bce3c0 service placement] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:59:49.411801 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d28da-7f45-41ad-8a15-c64972bce3c0 service placement] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:59:49.412252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d28da-7f45-41ad-8a15-c64972bce3c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:59:49.414237 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a25d28da-7f45-41ad-8a15-c64972bce3c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:59:49.428385 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d28da-7f45-41ad-8a15-c64972bce3c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:59:49.430388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d28da-7f45-41ad-8a15-c64972bce3c0 service placement] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:59:49.442868 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1411/2817] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 20:59:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 20:59:49.466159 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f0fbe-3faf-4dac-8a3d-4ab90ab65027 service swift] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:59:49.538460 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f0fbe-3faf-4dac-8a3d-4ab90ab65027 service swift] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:59:49.543065 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ec3cf-8791-49f5-a5a9-9c0e9811d6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:59:49.543981 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ec3cf-8791-49f5-a5a9-9c0e9811d6e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:59:49.544266 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ec3cf-8791-49f5-a5a9-9c0e9811d6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:59:49.544545 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ec3cf-8791-49f5-a5a9-9c0e9811d6e9 admin admin] PATH_INFO: `/v3/users/5235248d8a96401f96e797262017f5df` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:59:49.545746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ec3cf-8791-49f5-a5a9-9c0e9811d6e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5235248d8a96401f96e797262017f5df)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:59:49.547721 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6ec3cf-8791-49f5-a5a9-9c0e9811d6e9 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:59:49.596319 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-0d6ec3cf-8791-49f5-a5a9-9c0e9811d6e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5235248d8a96401f96e797262017f5df'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:59:49.603689 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-0d6ec3cf-8791-49f5-a5a9-9c0e9811d6e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5235248d8a96401f96e797262017f5df'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:59:49.615966 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-0d6ec3cf-8791-49f5-a5a9-9c0e9811d6e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5235248d8a96401f96e797262017f5df'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:59:49.616675 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-0d6ec3cf-8791-49f5-a5a9-9c0e9811d6e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5235248d8a96401f96e797262017f5df'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:59:49.623478 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-0d6ec3cf-8791-49f5-a5a9-9c0e9811d6e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5235248d8a96401f96e797262017f5df'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:59:49.629478 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1407/2818] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:59:49 2022] DELETE /identity/v3/users/5235248d8a96401f96e797262017f5df => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:59:49.818374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d28da-7f45-41ad-8a15-c64972bce3c0 service placement] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:59:49.830603 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d28da-7f45-41ad-8a15-c64972bce3c0 service placement] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:59:49.890822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1bf4e-0cef-40e4-9123-75ca7568211c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:59:49.891734 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1bf4e-0cef-40e4-9123-75ca7568211c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:59:49.892017 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1bf4e-0cef-40e4-9123-75ca7568211c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:59:49.892293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1bf4e-0cef-40e4-9123-75ca7568211c admin admin] PATH_INFO: `/v3/projects/ff2fd200c0bd4039abb7f280d43a7d76` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:59:49.893487 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1bf4e-0cef-40e4-9123-75ca7568211c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff2fd200c0bd4039abb7f280d43a7d76)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:59:49.895834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1bf4e-0cef-40e4-9123-75ca7568211c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:59:49.943176 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-ebc1bf4e-0cef-40e4-9123-75ca7568211c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff2fd200c0bd4039abb7f280d43a7d76', 'request_id': 'req-ebc1bf4e-0cef-40e4-9123-75ca7568211c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:59:49.948750 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-ebc1bf4e-0cef-40e4-9123-75ca7568211c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff2fd200c0bd4039abb7f280d43a7d76', 'request_id': 'req-ebc1bf4e-0cef-40e4-9123-75ca7568211c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:59:49.956699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-ebc1bf4e-0cef-40e4-9123-75ca7568211c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff2fd200c0bd4039abb7f280d43a7d76', 'request_id': 'req-ebc1bf4e-0cef-40e4-9123-75ca7568211c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:59:49.968619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-ebc1bf4e-0cef-40e4-9123-75ca7568211c admin admin] The token cache is being invalidate because project ff2fd200c0bd4039abb7f280d43a7d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:59:49.968907 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-ebc1bf4e-0cef-40e4-9123-75ca7568211c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:59:49.969554 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-ebc1bf4e-0cef-40e4-9123-75ca7568211c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:59:49.971108 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1412/2819] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:59:49 2022] DELETE /identity/v3/projects/ff2fd200c0bd4039abb7f280d43a7d76 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:59:49.975077 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ec3cf-8791-49f5-a5a9-9c0e9811d6e9 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:59:49.976589 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-0d6ec3cf-8791-49f5-a5a9-9c0e9811d6e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:59:49.990248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6ec3cf-8791-49f5-a5a9-9c0e9811d6e9 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:59:50.048472 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:50.057696 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2bd13-ff56-4844-8e2e-274720aad6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:59:50.058855 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2bd13-ff56-4844-8e2e-274720aad6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:59:50.059576 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2bd13-ff56-4844-8e2e-274720aad6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:59:50.060092 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2bd13-ff56-4844-8e2e-274720aad6d5 admin admin] PATH_INFO: `/v3/users/bb88138b69724b7d80144cec1bb1f40b` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:59:50.061761 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2bd13-ff56-4844-8e2e-274720aad6d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb88138b69724b7d80144cec1bb1f40b)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:59:50.064504 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2bd13-ff56-4844-8e2e-274720aad6d5 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:59:50.118258 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-15f2bd13-ff56-4844-8e2e-274720aad6d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb88138b69724b7d80144cec1bb1f40b'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:59:50.125517 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-15f2bd13-ff56-4844-8e2e-274720aad6d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb88138b69724b7d80144cec1bb1f40b'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:59:50.137958 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-15f2bd13-ff56-4844-8e2e-274720aad6d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb88138b69724b7d80144cec1bb1f40b'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:59:50.138584 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-15f2bd13-ff56-4844-8e2e-274720aad6d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb88138b69724b7d80144cec1bb1f40b'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:59:50.145529 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-15f2bd13-ff56-4844-8e2e-274720aad6d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb88138b69724b7d80144cec1bb1f40b'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:59:50.152091 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1408/2820] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 20:59:49 2022] DELETE /identity/v3/users/bb88138b69724b7d80144cec1bb1f40b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 20:59:50.336014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1bf4e-0cef-40e4-9123-75ca7568211c admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 20:59:50.337699 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ebc1bf4e-0cef-40e4-9123-75ca7568211c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 20:59:50.354606 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1bf4e-0cef-40e4-9123-75ca7568211c admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 20:59:50.394014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 20:59:50.419439 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620687a4-cc81-40a1-9b92-515e9ca5ece7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 20:59:50.420341 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620687a4-cc81-40a1-9b92-515e9ca5ece7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 20:59:50.420622 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620687a4-cc81-40a1-9b92-515e9ca5ece7 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 20:59:50.420897 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620687a4-cc81-40a1-9b92-515e9ca5ece7 admin admin] PATH_INFO: `/v3/projects/c2647879a4d64bb19ba9eb88c99f26b5` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 20:59:50.422109 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620687a4-cc81-40a1-9b92-515e9ca5ece7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2647879a4d64bb19ba9eb88c99f26b5)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 20:59:50.424048 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620687a4-cc81-40a1-9b92-515e9ca5ece7 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 20:59:50.472733 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-620687a4-cc81-40a1-9b92-515e9ca5ece7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2647879a4d64bb19ba9eb88c99f26b5', 'request_id': 'req-620687a4-cc81-40a1-9b92-515e9ca5ece7'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:59:50.479182 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-620687a4-cc81-40a1-9b92-515e9ca5ece7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2647879a4d64bb19ba9eb88c99f26b5', 'request_id': 'req-620687a4-cc81-40a1-9b92-515e9ca5ece7'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:59:50.487764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-620687a4-cc81-40a1-9b92-515e9ca5ece7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2647879a4d64bb19ba9eb88c99f26b5', 'request_id': 'req-620687a4-cc81-40a1-9b92-515e9ca5ece7'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:59:50.501532 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-620687a4-cc81-40a1-9b92-515e9ca5ece7 admin admin] The token cache is being invalidate because project c2647879a4d64bb19ba9eb88c99f26b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 20:59:50.501820 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-620687a4-cc81-40a1-9b92-515e9ca5ece7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:59:50.502490 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-620687a4-cc81-40a1-9b92-515e9ca5ece7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 20:59:50.504103 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1413/2821] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 20:59:50 2022] DELETE /identity/v3/projects/c2647879a4d64bb19ba9eb88c99f26b5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:00:00.148068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=27,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:00.498157 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=34,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:18.528640 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c54258-5a30-4778-ba35-864230c2f0ad None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:00:18.529205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c54258-5a30-4778-ba35-864230c2f0ad None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:00:18.529205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c54258-5a30-4778-ba35-864230c2f0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:00:18.547173 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-48c54258-5a30-4778-ba35-864230c2f0ad None None] MFA Rules not processed for user `32642b991f9c4508aee5fbb2f94a1c76`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:00:18.548421 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-48c54258-5a30-4778-ba35-864230c2f0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:00:18.603604 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1409/2822] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:00:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 21:00:18.932014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620687a4-cc81-40a1-9b92-515e9ca5ece7 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:00:18.933443 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-620687a4-cc81-40a1-9b92-515e9ca5ece7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:00:18.993908 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620687a4-cc81-40a1-9b92-515e9ca5ece7 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:00:19.007253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee628544-9c40-468d-8a44-c82a18e0ec9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:00:19.007253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee628544-9c40-468d-8a44-c82a18e0ec9f service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:00:19.007253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee628544-9c40-468d-8a44-c82a18e0ec9f service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:00:19.007253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee628544-9c40-468d-8a44-c82a18e0ec9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:00:19.007722 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-ee628544-9c40-468d-8a44-c82a18e0ec9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:00:19.013790 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee628544-9c40-468d-8a44-c82a18e0ec9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:00:19.015213 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee628544-9c40-468d-8a44-c82a18e0ec9f service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:00:19.023871 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1414/2823] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 21:00:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 21:00:28.596845 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=25 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:00:29.019823 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=26 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:24.398309 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c54258-5a30-4778-ba35-864230c2f0ad None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:24.400776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-48c54258-5a30-4778-ba35-864230c2f0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:24.479118 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c54258-5a30-4778-ba35-864230c2f0ad None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:24.483941 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6ffc9-b588-4b39-8a20-0923c428ca34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:24.484847 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6ffc9-b588-4b39-8a20-0923c428ca34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:24.485133 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6ffc9-b588-4b39-8a20-0923c428ca34 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:24.485410 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6ffc9-b588-4b39-8a20-0923c428ca34 admin admin] PATH_INFO: `/v3/users/32642b991f9c4508aee5fbb2f94a1c76` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:24.486659 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6ffc9-b588-4b39-8a20-0923c428ca34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32642b991f9c4508aee5fbb2f94a1c76)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:24.488628 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6ffc9-b588-4b39-8a20-0923c428ca34 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:24.544304 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-78a6ffc9-b588-4b39-8a20-0923c428ca34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32642b991f9c4508aee5fbb2f94a1c76'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:24.554088 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-78a6ffc9-b588-4b39-8a20-0923c428ca34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32642b991f9c4508aee5fbb2f94a1c76'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:24.575508 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-78a6ffc9-b588-4b39-8a20-0923c428ca34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32642b991f9c4508aee5fbb2f94a1c76'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:24.576623 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-78a6ffc9-b588-4b39-8a20-0923c428ca34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32642b991f9c4508aee5fbb2f94a1c76'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:24.589524 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-78a6ffc9-b588-4b39-8a20-0923c428ca34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32642b991f9c4508aee5fbb2f94a1c76'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:24.599920 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1410/2824] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 21:01:24 2022] DELETE /identity/v3/users/32642b991f9c4508aee5fbb2f94a1c76 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:24.811472 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee628544-9c40-468d-8a44-c82a18e0ec9f service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:24.830680 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee628544-9c40-468d-8a44-c82a18e0ec9f service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:24.925330 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ecabf-ac41-4592-b945-ee2499571c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:24.926818 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ecabf-ac41-4592-b945-ee2499571c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:24.927357 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ecabf-ac41-4592-b945-ee2499571c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:24.927861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ecabf-ac41-4592-b945-ee2499571c0c admin admin] PATH_INFO: `/v3/projects/5481801339524c5da2d233ff8e9debaf` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:24.930780 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ecabf-ac41-4592-b945-ee2499571c0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5481801339524c5da2d233ff8e9debaf)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:24.934635 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ecabf-ac41-4592-b945-ee2499571c0c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:25.001240 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-361ecabf-ac41-4592-b945-ee2499571c0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5481801339524c5da2d233ff8e9debaf', 'request_id': 'req-361ecabf-ac41-4592-b945-ee2499571c0c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:25.008334 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-361ecabf-ac41-4592-b945-ee2499571c0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5481801339524c5da2d233ff8e9debaf', 'request_id': 'req-361ecabf-ac41-4592-b945-ee2499571c0c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:25.017374 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-361ecabf-ac41-4592-b945-ee2499571c0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5481801339524c5da2d233ff8e9debaf', 'request_id': 'req-361ecabf-ac41-4592-b945-ee2499571c0c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:25.032067 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-361ecabf-ac41-4592-b945-ee2499571c0c admin admin] The token cache is being invalidate because project 5481801339524c5da2d233ff8e9debaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 21:01:25.032381 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-361ecabf-ac41-4592-b945-ee2499571c0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:25.033035 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-361ecabf-ac41-4592-b945-ee2499571c0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:25.034628 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1415/2825] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 21:01:24 2022] DELETE /identity/v3/projects/5481801339524c5da2d233ff8e9debaf => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:25.042821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ad477-b457-46fe-a432-07829f742242 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:25.043369 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ad477-b457-46fe-a432-07829f742242 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:25.043903 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ad477-b457-46fe-a432-07829f742242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:25.069036 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-aa0ad477-b457-46fe-a432-07829f742242 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:01:25.070425 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-aa0ad477-b457-46fe-a432-07829f742242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:25.161516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1411/2826] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 21:01:25.170772 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e007f-33b7-45fb-afcf-11de17ae10f7 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:25.171371 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e007f-33b7-45fb-afcf-11de17ae10f7 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:25.171750 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e007f-33b7-45fb-afcf-11de17ae10f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:25.193508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-a64e007f-33b7-45fb-afcf-11de17ae10f7 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:01:25.195332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a64e007f-33b7-45fb-afcf-11de17ae10f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:25.204286 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1416/2827] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:01:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 21:01:25.209552 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ad477-b457-46fe-a432-07829f742242 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:25.226430 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ad477-b457-46fe-a432-07829f742242 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:25.233665 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ede877-2cc2-4fed-910c-7d95277c0be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:25.234688 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ede877-2cc2-4fed-910c-7d95277c0be3 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:25.235148 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ede877-2cc2-4fed-910c-7d95277c0be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:25.235645 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ede877-2cc2-4fed-910c-7d95277c0be3 admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:25.236850 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ede877-2cc2-4fed-910c-7d95277c0be3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 21:01:25.237333 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ede877-2cc2-4fed-910c-7d95277c0be3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:25.240086 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ede877-2cc2-4fed-910c-7d95277c0be3 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:25.260562 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1412/2828] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 21:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 21:01:25.265289 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e007f-33b7-45fb-afcf-11de17ae10f7 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:25.275360 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e007f-33b7-45fb-afcf-11de17ae10f7 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:25.280432 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41910e-b05e-4008-ae35-e0254b4b4448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:25.281109 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41910e-b05e-4008-ae35-e0254b4b4448 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:25.281388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41910e-b05e-4008-ae35-e0254b4b4448 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:25.281662 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41910e-b05e-4008-ae35-e0254b4b4448 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:25.282378 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41910e-b05e-4008-ae35-e0254b4b4448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:25.284350 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea41910e-b05e-4008-ae35-e0254b4b4448 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:25.324069 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1417/2829] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 21:01:25 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 21:01:25.328405 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ede877-2cc2-4fed-910c-7d95277c0be3 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:25.339585 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ede877-2cc2-4fed-910c-7d95277c0be3 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:25.343767 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:25.408370 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0ec76-b7d1-4d08-806d-2c980381d4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:25.409511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0ec76-b7d1-4d08-806d-2c980381d4d6 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:25.410024 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0ec76-b7d1-4d08-806d-2c980381d4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:25.410456 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0ec76-b7d1-4d08-806d-2c980381d4d6 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:25.411655 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0ec76-b7d1-4d08-806d-2c980381d4d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:25.416822 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0ec76-b7d1-4d08-806d-2c980381d4d6 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:25.446568 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1413/2830] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 21:01:25 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 21:01:25.451194 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41910e-b05e-4008-ae35-e0254b4b4448 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:25.463990 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea41910e-b05e-4008-ae35-e0254b4b4448 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:25.470076 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025320ec-5912-454d-975e-2327d199c71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:25.470794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025320ec-5912-454d-975e-2327d199c71d admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:25.471191 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025320ec-5912-454d-975e-2327d199c71d admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:25.471510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025320ec-5912-454d-975e-2327d199c71d admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:25.472269 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025320ec-5912-454d-975e-2327d199c71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:25.473924 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025320ec-5912-454d-975e-2327d199c71d admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:25.487248 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1418/2831] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 21:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 21:01:25.492349 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0ec76-b7d1-4d08-806d-2c980381d4d6 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:25.503229 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0ec76-b7d1-4d08-806d-2c980381d4d6 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:25.508641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0a3d3-99ab-4a5e-9552-4a884b83b260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:25.509321 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0a3d3-99ab-4a5e-9552-4a884b83b260 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:25.509609 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0a3d3-99ab-4a5e-9552-4a884b83b260 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:25.509889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0a3d3-99ab-4a5e-9552-4a884b83b260 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:25.510636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0a3d3-99ab-4a5e-9552-4a884b83b260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:25.512296 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0a3d3-99ab-4a5e-9552-4a884b83b260 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:25.523387 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1414/2832] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 21:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 21:01:25.529679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025320ec-5912-454d-975e-2327d199c71d admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:25.540785 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025320ec-5912-454d-975e-2327d199c71d admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:25.546202 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca823b-4e03-4dea-9b82-9ad347c86d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:25.547358 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca823b-4e03-4dea-9b82-9ad347c86d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:25.547753 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca823b-4e03-4dea-9b82-9ad347c86d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:25.548149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca823b-4e03-4dea-9b82-9ad347c86d0a admin admin] PATH_INFO: `/v3/projects/a6e24b6717a945c49c1ba86b4d321ba2/users/809f02069bce401791f5bd6bb211e0b3/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:25.565337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca823b-4e03-4dea-9b82-9ad347c86d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e24b6717a945c49c1ba86b4d321ba2, user_id=809f02069bce401791f5bd6bb211e0b3, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:25.568210 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca823b-4e03-4dea-9b82-9ad347c86d0a admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:25.584998 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1419/2833] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 21:01:25 2022] PUT /identity/v3/projects/a6e24b6717a945c49c1ba86b4d321ba2/users/809f02069bce401791f5bd6bb211e0b3/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:25.596793 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912267b-9e25-47d5-ae35-f2a224184226 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:25.597093 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912267b-9e25-47d5-ae35-f2a224184226 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:25.597357 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912267b-9e25-47d5-ae35-f2a224184226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:25.628938 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-c912267b-9e25-47d5-ae35-f2a224184226 None None] MFA Rules not processed for user `809f02069bce401791f5bd6bb211e0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:01:25.630215 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-c912267b-9e25-47d5-ae35-f2a224184226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:25.713730 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1415/2834] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:01:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 21:01:25.718397 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca823b-4e03-4dea-9b82-9ad347c86d0a admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:25.740865 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:25.795786 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca823b-4e03-4dea-9b82-9ad347c86d0a admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:25.800986 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd4120-b437-45b9-ac82-91c90d94389a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:25.801679 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd4120-b437-45b9-ac82-91c90d94389a admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:25.801975 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd4120-b437-45b9-ac82-91c90d94389a admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:25.802252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd4120-b437-45b9-ac82-91c90d94389a admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:25.802981 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd4120-b437-45b9-ac82-91c90d94389a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:25.805491 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd4120-b437-45b9-ac82-91c90d94389a admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:25.833617 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1420/2835] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 21:01:25 2022] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 21:01:25.838277 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912267b-9e25-47d5-ae35-f2a224184226 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:25.850128 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912267b-9e25-47d5-ae35-f2a224184226 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:25.916068 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c2d07-393e-4bef-850b-882601f1dd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:25.916768 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c2d07-393e-4bef-850b-882601f1dd2e admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:25.917063 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c2d07-393e-4bef-850b-882601f1dd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:25.917345 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c2d07-393e-4bef-850b-882601f1dd2e admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:25.918077 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c2d07-393e-4bef-850b-882601f1dd2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:25.920096 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c2d07-393e-4bef-850b-882601f1dd2e admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:25.941616 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1416/2836] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 21:01:25 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 21:01:25.947792 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd4120-b437-45b9-ac82-91c90d94389a admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:25.960469 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd4120-b437-45b9-ac82-91c90d94389a admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:25.965395 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc253fa1-2f26-4f75-9ec0-452910de6a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:25.966088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc253fa1-2f26-4f75-9ec0-452910de6a5e admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:25.966377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc253fa1-2f26-4f75-9ec0-452910de6a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:25.966664 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc253fa1-2f26-4f75-9ec0-452910de6a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:25.967451 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc253fa1-2f26-4f75-9ec0-452910de6a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:25.969129 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc253fa1-2f26-4f75-9ec0-452910de6a5e admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:25.981583 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1421/2837] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 21:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 21:01:25.986156 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c2d07-393e-4bef-850b-882601f1dd2e admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:25.993611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:25.998597 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c2d07-393e-4bef-850b-882601f1dd2e admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:26.005611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac31a8b-3070-4ca5-803b-122cb9c44566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:26.006627 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac31a8b-3070-4ca5-803b-122cb9c44566 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:26.007487 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac31a8b-3070-4ca5-803b-122cb9c44566 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:26.007813 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac31a8b-3070-4ca5-803b-122cb9c44566 admin admin] PATH_INFO: `/v3/projects/8f65f2a0cb4243f794a255145c1a1f95/users/102cfb620b9146ba9923f4a6f86f45bc/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:26.027092 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac31a8b-3070-4ca5-803b-122cb9c44566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f65f2a0cb4243f794a255145c1a1f95, user_id=102cfb620b9146ba9923f4a6f86f45bc, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:26.030159 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac31a8b-3070-4ca5-803b-122cb9c44566 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:26.046230 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1417/2838] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 21:01:25 2022] PUT /identity/v3/projects/8f65f2a0cb4243f794a255145c1a1f95/users/102cfb620b9146ba9923f4a6f86f45bc/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:26.050696 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc253fa1-2f26-4f75-9ec0-452910de6a5e admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:26.061603 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc253fa1-2f26-4f75-9ec0-452910de6a5e admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:26.134056 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3519328-5ed2-4e63-ad47-ab65fd36ddd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:26.134822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3519328-5ed2-4e63-ad47-ab65fd36ddd9 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:26.135226 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3519328-5ed2-4e63-ad47-ab65fd36ddd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:26.135676 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3519328-5ed2-4e63-ad47-ab65fd36ddd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:26.136538 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3519328-5ed2-4e63-ad47-ab65fd36ddd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:26.138274 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3519328-5ed2-4e63-ad47-ab65fd36ddd9 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:26.149741 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1422/2839] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 21:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 21:01:26.156097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac31a8b-3070-4ca5-803b-122cb9c44566 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:26.167650 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac31a8b-3070-4ca5-803b-122cb9c44566 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:26.172586 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ffc37-e4c7-4fa5-a683-f4448d650c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:26.173547 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ffc37-e4c7-4fa5-a683-f4448d650c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:26.173954 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ffc37-e4c7-4fa5-a683-f4448d650c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:26.174352 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ffc37-e4c7-4fa5-a683-f4448d650c30 admin admin] PATH_INFO: `/v3/projects/8f65f2a0cb4243f794a255145c1a1f95/users/102cfb620b9146ba9923f4a6f86f45bc/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:26.176961 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ffc37-e4c7-4fa5-a683-f4448d650c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f65f2a0cb4243f794a255145c1a1f95, user_id=102cfb620b9146ba9923f4a6f86f45bc, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:26.179743 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ffc37-e4c7-4fa5-a683-f4448d650c30 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:26.191970 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1418/2840] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 21:01:26 2022] PUT /identity/v3/projects/8f65f2a0cb4243f794a255145c1a1f95/users/102cfb620b9146ba9923f4a6f86f45bc/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:26.204381 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cffcb3-8b6d-45fa-aeb9-7fd680006d3f None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:26.204675 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cffcb3-8b6d-45fa-aeb9-7fd680006d3f None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:26.204963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cffcb3-8b6d-45fa-aeb9-7fd680006d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:26.233769 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-54cffcb3-8b6d-45fa-aeb9-7fd680006d3f None None] MFA Rules not processed for user `102cfb620b9146ba9923f4a6f86f45bc`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:01:26.235059 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-54cffcb3-8b6d-45fa-aeb9-7fd680006d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:26.310398 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1423/2841] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:01:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 21:01:26.322934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ffc37-e4c7-4fa5-a683-f4448d650c30 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:26.324697 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-980ffc37-e4c7-4fa5-a683-f4448d650c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:26.409151 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ffc37-e4c7-4fa5-a683-f4448d650c30 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:26.414953 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f31f8-6872-4c0d-872b-88f201dbc964 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:26.416019 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f31f8-6872-4c0d-872b-88f201dbc964 service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:26.416468 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f31f8-6872-4c0d-872b-88f201dbc964 service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:26.416910 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f31f8-6872-4c0d-872b-88f201dbc964 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:26.433492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f31f8-6872-4c0d-872b-88f201dbc964 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:26.435836 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f31f8-6872-4c0d-872b-88f201dbc964 service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:26.454184 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1419/2842] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 21:01:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 21:01:26.533341 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cffcb3-8b6d-45fa-aeb9-7fd680006d3f None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:26.544232 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cffcb3-8b6d-45fa-aeb9-7fd680006d3f None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:26.548124 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55e86e-fcfe-4454-bbe4-c7628f11c434 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:26.548807 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55e86e-fcfe-4454-bbe4-c7628f11c434 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:26.549092 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55e86e-fcfe-4454-bbe4-c7628f11c434 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:26.549373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55e86e-fcfe-4454-bbe4-c7628f11c434 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:26.560524 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:26.619760 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55e86e-fcfe-4454-bbe4-c7628f11c434 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:26.621454 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55e86e-fcfe-4454-bbe4-c7628f11c434 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:26.632430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1424/2843] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 21:01:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 21:01:33.544256 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f31f8-6872-4c0d-872b-88f201dbc964 service cinder] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:33.608655 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f31f8-6872-4c0d-872b-88f201dbc964 service cinder] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:33.613620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bb750-3275-4702-b10c-c884e1866efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:33.614436 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bb750-3275-4702-b10c-c884e1866efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:33.614831 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bb750-3275-4702-b10c-c884e1866efd admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:33.615132 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bb750-3275-4702-b10c-c884e1866efd admin admin] PATH_INFO: `/v3/users/809f02069bce401791f5bd6bb211e0b3` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:33.617237 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bb750-3275-4702-b10c-c884e1866efd admin admin] RBAC: Authorizing `identity:delete_user(user_id=809f02069bce401791f5bd6bb211e0b3)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:33.619232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bb750-3275-4702-b10c-c884e1866efd admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:33.671236 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-c31bb750-3275-4702-b10c-c884e1866efd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '809f02069bce401791f5bd6bb211e0b3'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:33.680614 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-c31bb750-3275-4702-b10c-c884e1866efd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '809f02069bce401791f5bd6bb211e0b3'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:33.696246 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-c31bb750-3275-4702-b10c-c884e1866efd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '809f02069bce401791f5bd6bb211e0b3'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:33.696981 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-c31bb750-3275-4702-b10c-c884e1866efd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '809f02069bce401791f5bd6bb211e0b3'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:33.698223 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:33.707132 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-c31bb750-3275-4702-b10c-c884e1866efd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '809f02069bce401791f5bd6bb211e0b3'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:33.715167 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1420/2844] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 21:01:33 2022] DELETE /identity/v3/users/809f02069bce401791f5bd6bb211e0b3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:33.720111 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76381a15-9f3a-43f8-aef7-33efeb544669 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:33.720953 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76381a15-9f3a-43f8-aef7-33efeb544669 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:33.720953 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76381a15-9f3a-43f8-aef7-33efeb544669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:33.738011 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-76381a15-9f3a-43f8-aef7-33efeb544669 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:01:33.739233 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-76381a15-9f3a-43f8-aef7-33efeb544669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:33.809721 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1425/2845] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 21:01:33.821525 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bb750-3275-4702-b10c-c884e1866efd admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:33.822946 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-c31bb750-3275-4702-b10c-c884e1866efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:33.885761 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bb750-3275-4702-b10c-c884e1866efd admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:33.890761 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f1766-bb49-4d95-8260-cd885be5949e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:33.891616 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f1766-bb49-4d95-8260-cd885be5949e service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:33.891943 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f1766-bb49-4d95-8260-cd885be5949e service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:33.892261 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f1766-bb49-4d95-8260-cd885be5949e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:33.904958 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f1766-bb49-4d95-8260-cd885be5949e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:33.906482 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f1766-bb49-4d95-8260-cd885be5949e service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:33.917544 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1421/2846] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 21:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 21:01:34.207504 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76381a15-9f3a-43f8-aef7-33efeb544669 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:34.209125 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-76381a15-9f3a-43f8-aef7-33efeb544669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:34.225190 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76381a15-9f3a-43f8-aef7-33efeb544669 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:34.230808 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c6f94-14b2-41e6-8d6f-842087e8a11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:34.232437 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c6f94-14b2-41e6-8d6f-842087e8a11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:34.232919 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c6f94-14b2-41e6-8d6f-842087e8a11c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:34.233207 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c6f94-14b2-41e6-8d6f-842087e8a11c admin admin] PATH_INFO: `/v3/projects/a6e24b6717a945c49c1ba86b4d321ba2` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:34.234478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c6f94-14b2-41e6-8d6f-842087e8a11c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6e24b6717a945c49c1ba86b4d321ba2)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:34.236442 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c6f94-14b2-41e6-8d6f-842087e8a11c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:34.296081 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b89c6f94-14b2-41e6-8d6f-842087e8a11c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6e24b6717a945c49c1ba86b4d321ba2', 'request_id': 'req-b89c6f94-14b2-41e6-8d6f-842087e8a11c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:34.306514 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b89c6f94-14b2-41e6-8d6f-842087e8a11c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6e24b6717a945c49c1ba86b4d321ba2', 'request_id': 'req-b89c6f94-14b2-41e6-8d6f-842087e8a11c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:34.315025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b89c6f94-14b2-41e6-8d6f-842087e8a11c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6e24b6717a945c49c1ba86b4d321ba2', 'request_id': 'req-b89c6f94-14b2-41e6-8d6f-842087e8a11c'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:34.327711 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b89c6f94-14b2-41e6-8d6f-842087e8a11c admin admin] The token cache is being invalidate because project a6e24b6717a945c49c1ba86b4d321ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 21:01:34.328130 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b89c6f94-14b2-41e6-8d6f-842087e8a11c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:34.328872 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-b89c6f94-14b2-41e6-8d6f-842087e8a11c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:34.330764 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1426/2847] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 21:01:34 2022] DELETE /identity/v3/projects/a6e24b6717a945c49c1ba86b4d321ba2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:34.335120 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f1766-bb49-4d95-8260-cd885be5949e service neutron] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:34.345030 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f1766-bb49-4d95-8260-cd885be5949e service neutron] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:34.407756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030abde-cd22-4bb1-8c7c-3084d44e16e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:34.408548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030abde-cd22-4bb1-8c7c-3084d44e16e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:34.408837 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030abde-cd22-4bb1-8c7c-3084d44e16e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:34.409113 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030abde-cd22-4bb1-8c7c-3084d44e16e9 admin admin] PATH_INFO: `/v3/users/102cfb620b9146ba9923f4a6f86f45bc` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:34.410431 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030abde-cd22-4bb1-8c7c-3084d44e16e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=102cfb620b9146ba9923f4a6f86f45bc)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:34.412417 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030abde-cd22-4bb1-8c7c-3084d44e16e9 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:34.461653 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-1030abde-cd22-4bb1-8c7c-3084d44e16e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '102cfb620b9146ba9923f4a6f86f45bc'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:34.469641 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-1030abde-cd22-4bb1-8c7c-3084d44e16e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '102cfb620b9146ba9923f4a6f86f45bc'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:34.483233 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-1030abde-cd22-4bb1-8c7c-3084d44e16e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '102cfb620b9146ba9923f4a6f86f45bc'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:34.483968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-1030abde-cd22-4bb1-8c7c-3084d44e16e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '102cfb620b9146ba9923f4a6f86f45bc'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:34.490891 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-1030abde-cd22-4bb1-8c7c-3084d44e16e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '102cfb620b9146ba9923f4a6f86f45bc'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:34.497232 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1422/2848] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 21:01:34 2022] DELETE /identity/v3/users/102cfb620b9146ba9923f4a6f86f45bc => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:34.794153 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c6f94-14b2-41e6-8d6f-842087e8a11c admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:34.796218 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b89c6f94-14b2-41e6-8d6f-842087e8a11c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:34.819610 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c6f94-14b2-41e6-8d6f-842087e8a11c admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:34.861290 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:34.906492 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15612e09-c5ec-4082-ab28-87124dcfe7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:34.907888 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15612e09-c5ec-4082-ab28-87124dcfe7f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:34.908388 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15612e09-c5ec-4082-ab28-87124dcfe7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:34.908883 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15612e09-c5ec-4082-ab28-87124dcfe7f5 admin admin] PATH_INFO: `/v3/projects/8f65f2a0cb4243f794a255145c1a1f95` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:34.911078 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15612e09-c5ec-4082-ab28-87124dcfe7f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f65f2a0cb4243f794a255145c1a1f95)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:34.915441 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15612e09-c5ec-4082-ab28-87124dcfe7f5 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:34.988198 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-15612e09-c5ec-4082-ab28-87124dcfe7f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f65f2a0cb4243f794a255145c1a1f95', 'request_id': 'req-15612e09-c5ec-4082-ab28-87124dcfe7f5'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:34.994203 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-15612e09-c5ec-4082-ab28-87124dcfe7f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f65f2a0cb4243f794a255145c1a1f95', 'request_id': 'req-15612e09-c5ec-4082-ab28-87124dcfe7f5'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:35.002369 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-15612e09-c5ec-4082-ab28-87124dcfe7f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f65f2a0cb4243f794a255145c1a1f95', 'request_id': 'req-15612e09-c5ec-4082-ab28-87124dcfe7f5'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:35.016471 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-15612e09-c5ec-4082-ab28-87124dcfe7f5 admin admin] The token cache is being invalidate because project 8f65f2a0cb4243f794a255145c1a1f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 21:01:35.016804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-15612e09-c5ec-4082-ab28-87124dcfe7f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:35.017422 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-15612e09-c5ec-4082-ab28-87124dcfe7f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:35.019006 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1427/2849] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 21:01:34 2022] DELETE /identity/v3/projects/8f65f2a0cb4243f794a255145c1a1f95 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:35.025143 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda4357-a928-4512-98c0-5d3f923cf7b4 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:35.025721 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda4357-a928-4512-98c0-5d3f923cf7b4 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:35.025721 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda4357-a928-4512-98c0-5d3f923cf7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:35.046555 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-8fda4357-a928-4512-98c0-5d3f923cf7b4 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:01:35.047894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-8fda4357-a928-4512-98c0-5d3f923cf7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:35.054252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:35.120886 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1423/2850] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 21:01:35.129201 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f6246-25a1-4940-89a2-5155c7beb500 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:35.129521 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f6246-25a1-4940-89a2-5155c7beb500 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:35.129957 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f6246-25a1-4940-89a2-5155c7beb500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:35.150117 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-6b2f6246-25a1-4940-89a2-5155c7beb500 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:01:35.151389 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-6b2f6246-25a1-4940-89a2-5155c7beb500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:35.160358 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1428/2851] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 21:01:35.165717 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda4357-a928-4512-98c0-5d3f923cf7b4 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:35.176818 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda4357-a928-4512-98c0-5d3f923cf7b4 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:35.182703 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7abb4-0d20-425b-9744-5e8c9d2e027d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:35.183439 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7abb4-0d20-425b-9744-5e8c9d2e027d admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:35.183722 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7abb4-0d20-425b-9744-5e8c9d2e027d admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:35.184006 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e7abb4-0d20-425b-9744-5e8c9d2e027d admin admin] PATH_INFO: `/v3/domains` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:35.184776 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7abb4-0d20-425b-9744-5e8c9d2e027d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92087) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 21:01:35.185082 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7abb4-0d20-425b-9744-5e8c9d2e027d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:35.186759 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e7abb4-0d20-425b-9744-5e8c9d2e027d admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:35.202666 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1424/2852] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 21:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 21:01:35.208550 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f6246-25a1-4940-89a2-5155c7beb500 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:35.221314 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f6246-25a1-4940-89a2-5155c7beb500 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:35.227397 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad6c9b-0a00-4108-9ff1-b52a22088518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:35.228085 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad6c9b-0a00-4108-9ff1-b52a22088518 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:35.228368 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad6c9b-0a00-4108-9ff1-b52a22088518 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:35.228684 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad6c9b-0a00-4108-9ff1-b52a22088518 admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:35.229985 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad6c9b-0a00-4108-9ff1-b52a22088518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:35.233273 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad6c9b-0a00-4108-9ff1-b52a22088518 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:35.262702 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1429/2853] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 21:01:35 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 21:01:35.266914 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7abb4-0d20-425b-9744-5e8c9d2e027d admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:35.278372 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e7abb4-0d20-425b-9744-5e8c9d2e027d admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:35.340640 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f482c-5ade-474a-b2ae-55038cedfc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:35.341663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f482c-5ade-474a-b2ae-55038cedfc46 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:35.341936 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f482c-5ade-474a-b2ae-55038cedfc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:35.342214 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f482c-5ade-474a-b2ae-55038cedfc46 admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:35.342909 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f482c-5ade-474a-b2ae-55038cedfc46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:35.344888 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f482c-5ade-474a-b2ae-55038cedfc46 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:35.370692 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1425/2854] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 21:01:35 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 21:01:35.375102 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad6c9b-0a00-4108-9ff1-b52a22088518 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:35.386153 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad6c9b-0a00-4108-9ff1-b52a22088518 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:35.390943 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f68d0-96aa-4122-92fb-68a9e26e0091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:35.391659 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f68d0-96aa-4122-92fb-68a9e26e0091 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:35.391938 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f68d0-96aa-4122-92fb-68a9e26e0091 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:35.392208 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f68d0-96aa-4122-92fb-68a9e26e0091 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:35.392941 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f68d0-96aa-4122-92fb-68a9e26e0091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:35.394528 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f68d0-96aa-4122-92fb-68a9e26e0091 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:35.406886 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1430/2855] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 21:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 21:01:35.411289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f482c-5ade-474a-b2ae-55038cedfc46 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:35.423810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f482c-5ade-474a-b2ae-55038cedfc46 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:35.429022 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba426f-edc9-4f04-bc0c-9233778a3611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:35.429678 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba426f-edc9-4f04-bc0c-9233778a3611 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:35.429959 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba426f-edc9-4f04-bc0c-9233778a3611 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:35.430235 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba426f-edc9-4f04-bc0c-9233778a3611 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:35.430977 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba426f-edc9-4f04-bc0c-9233778a3611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:35.432573 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba426f-edc9-4f04-bc0c-9233778a3611 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:35.443540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1426/2856] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 21:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 21:01:35.448720 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f68d0-96aa-4122-92fb-68a9e26e0091 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:35.459250 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f68d0-96aa-4122-92fb-68a9e26e0091 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:35.464073 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e88ddc-623d-4e79-a619-a6c1c0af2ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:35.464967 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e88ddc-623d-4e79-a619-a6c1c0af2ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:35.465248 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e88ddc-623d-4e79-a619-a6c1c0af2ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:35.465522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e88ddc-623d-4e79-a619-a6c1c0af2ba2 admin admin] PATH_INFO: `/v3/projects/c2bb3ec48ff84e5c9e668c9be1bc5dcb/users/37957bc3ae26444e88dc2f57d29f9b24/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:35.482279 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e88ddc-623d-4e79-a619-a6c1c0af2ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2bb3ec48ff84e5c9e668c9be1bc5dcb, user_id=37957bc3ae26444e88dc2f57d29f9b24, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:35.485140 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e88ddc-623d-4e79-a619-a6c1c0af2ba2 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:35.505175 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1431/2857] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 21:01:35 2022] PUT /identity/v3/projects/c2bb3ec48ff84e5c9e668c9be1bc5dcb/users/37957bc3ae26444e88dc2f57d29f9b24/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:35.518097 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c96ea-d72e-4e65-942b-22606c5d7ca6 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:35.518394 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c96ea-d72e-4e65-942b-22606c5d7ca6 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:35.518678 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c96ea-d72e-4e65-942b-22606c5d7ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:35.546509 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-cc7c96ea-d72e-4e65-942b-22606c5d7ca6 None None] MFA Rules not processed for user `37957bc3ae26444e88dc2f57d29f9b24`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:01:35.547775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-cc7c96ea-d72e-4e65-942b-22606c5d7ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:35.618170 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1427/2858] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:01:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 21:01:35.623181 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e88ddc-623d-4e79-a619-a6c1c0af2ba2 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:35.693237 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e88ddc-623d-4e79-a619-a6c1c0af2ba2 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:35.698030 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e54cb-1d47-4cc4-8626-74ed1014e89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:35.698692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e54cb-1d47-4cc4-8626-74ed1014e89b admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:35.698972 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e54cb-1d47-4cc4-8626-74ed1014e89b admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:35.699244 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e54cb-1d47-4cc4-8626-74ed1014e89b admin admin] PATH_INFO: `/v3/projects` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:35.699962 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e54cb-1d47-4cc4-8626-74ed1014e89b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:35.701834 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e54cb-1d47-4cc4-8626-74ed1014e89b admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:35.706310 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:35.734095 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1432/2859] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 21:01:35 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 21:01:35.738668 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c96ea-d72e-4e65-942b-22606c5d7ca6 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:35.752939 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c96ea-d72e-4e65-942b-22606c5d7ca6 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:35.757114 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:35.817876 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6a7e3-0261-48d0-bf3b-287ca819a3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:35.818578 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6a7e3-0261-48d0-bf3b-287ca819a3ce admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:35.818866 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6a7e3-0261-48d0-bf3b-287ca819a3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:35.819665 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6a7e3-0261-48d0-bf3b-287ca819a3ce admin admin] PATH_INFO: `/v3/users` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:35.820393 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6a7e3-0261-48d0-bf3b-287ca819a3ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:35.822329 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6a7e3-0261-48d0-bf3b-287ca819a3ce admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:35.845117 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1428/2860] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 21:01:35 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 21:01:35.849619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e54cb-1d47-4cc4-8626-74ed1014e89b admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:35.860754 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e54cb-1d47-4cc4-8626-74ed1014e89b admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:35.865604 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dccdd-be5a-4644-8410-7ac81f30e9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:35.866281 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dccdd-be5a-4644-8410-7ac81f30e9da admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:35.866588 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dccdd-be5a-4644-8410-7ac81f30e9da admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:35.866858 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dccdd-be5a-4644-8410-7ac81f30e9da admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:35.867619 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678dccdd-be5a-4644-8410-7ac81f30e9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:35.869213 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678dccdd-be5a-4644-8410-7ac81f30e9da admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:35.880816 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1433/2861] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 21:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 21:01:35.886090 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6a7e3-0261-48d0-bf3b-287ca819a3ce admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:35.898730 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6a7e3-0261-48d0-bf3b-287ca819a3ce admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:35.904894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1c574-848f-4356-aa35-2274177474ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:35.905878 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1c574-848f-4356-aa35-2274177474ea admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:35.906162 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1c574-848f-4356-aa35-2274177474ea admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:35.906448 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1c574-848f-4356-aa35-2274177474ea admin admin] PATH_INFO: `/v3/projects/fb2db0b512b5417e851ca027c57816d1/users/e329eb6d59d44fd9a87f1ef706956a86/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:35.923406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1c574-848f-4356-aa35-2274177474ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb2db0b512b5417e851ca027c57816d1, user_id=e329eb6d59d44fd9a87f1ef706956a86, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:35.926240 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1c574-848f-4356-aa35-2274177474ea admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:35.941263 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1429/2862] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 21:01:35 2022] PUT /identity/v3/projects/fb2db0b512b5417e851ca027c57816d1/users/e329eb6d59d44fd9a87f1ef706956a86/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:35.946208 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dccdd-be5a-4644-8410-7ac81f30e9da admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:35.956225 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dccdd-be5a-4644-8410-7ac81f30e9da admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:36.014809 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d59498-0e00-405c-a5e0-ec07b0c2de8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:36.015499 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d59498-0e00-405c-a5e0-ec07b0c2de8b admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:36.015825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d59498-0e00-405c-a5e0-ec07b0c2de8b admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:36.016175 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d59498-0e00-405c-a5e0-ec07b0c2de8b admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:36.016956 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d59498-0e00-405c-a5e0-ec07b0c2de8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:36.018671 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d59498-0e00-405c-a5e0-ec07b0c2de8b admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:36.029651 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1434/2863] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 21:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 21:01:36.034163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1c574-848f-4356-aa35-2274177474ea admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:36.045115 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1c574-848f-4356-aa35-2274177474ea admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:36.049949 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd98ac-e974-4916-9590-503bbda317e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:36.050838 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd98ac-e974-4916-9590-503bbda317e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:36.051129 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd98ac-e974-4916-9590-503bbda317e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:36.051444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd98ac-e974-4916-9590-503bbda317e0 admin admin] PATH_INFO: `/v3/projects/fb2db0b512b5417e851ca027c57816d1/users/e329eb6d59d44fd9a87f1ef706956a86/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:36.053955 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd98ac-e974-4916-9590-503bbda317e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb2db0b512b5417e851ca027c57816d1, user_id=e329eb6d59d44fd9a87f1ef706956a86, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:36.056619 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd98ac-e974-4916-9590-503bbda317e0 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:36.067098 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1430/2864] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 21:01:36 2022] PUT /identity/v3/projects/fb2db0b512b5417e851ca027c57816d1/users/e329eb6d59d44fd9a87f1ef706956a86/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 21:01:36.129821 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4454792-8b33-4b81-93aa-c90f3f396b45 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:36.130138 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4454792-8b33-4b81-93aa-c90f3f396b45 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:36.130416 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4454792-8b33-4b81-93aa-c90f3f396b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:36.160828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-b4454792-8b33-4b81-93aa-c90f3f396b45 None None] MFA Rules not processed for user `e329eb6d59d44fd9a87f1ef706956a86`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:01:36.162129 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-b4454792-8b33-4b81-93aa-c90f3f396b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:36.248475 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1435/2865] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:01:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 21:01:36.261716 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd98ac-e974-4916-9590-503bbda317e0 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:36.263606 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-e8cd98ac-e974-4916-9590-503bbda317e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:36.328647 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd98ac-e974-4916-9590-503bbda317e0 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:36.332398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea07f4-2fd0-49d1-b0e4-83afd82ffba2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:36.333062 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea07f4-2fd0-49d1-b0e4-83afd82ffba2 service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:36.333346 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea07f4-2fd0-49d1-b0e4-83afd82ffba2 service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:36.333616 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea07f4-2fd0-49d1-b0e4-83afd82ffba2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:36.343563 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea07f4-2fd0-49d1-b0e4-83afd82ffba2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:36.344994 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea07f4-2fd0-49d1-b0e4-83afd82ffba2 service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:36.355623 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1431/2866] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 21:01:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 21:01:36.427509 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4454792-8b33-4b81-93aa-c90f3f396b45 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:36.490159 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:36.495478 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4454792-8b33-4b81-93aa-c90f3f396b45 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:36.501838 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519ab14-93a7-4c21-a435-8f4bad78e7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:36.502734 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519ab14-93a7-4c21-a435-8f4bad78e7fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:36.503019 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519ab14-93a7-4c21-a435-8f4bad78e7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:36.503337 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519ab14-93a7-4c21-a435-8f4bad78e7fb admin admin] PATH_INFO: `/v3/users/37957bc3ae26444e88dc2f57d29f9b24` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:36.504746 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519ab14-93a7-4c21-a435-8f4bad78e7fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=37957bc3ae26444e88dc2f57d29f9b24)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:36.506669 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519ab14-93a7-4c21-a435-8f4bad78e7fb admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:36.556127 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2519ab14-93a7-4c21-a435-8f4bad78e7fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37957bc3ae26444e88dc2f57d29f9b24'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:36.563869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2519ab14-93a7-4c21-a435-8f4bad78e7fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37957bc3ae26444e88dc2f57d29f9b24'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:36.576425 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2519ab14-93a7-4c21-a435-8f4bad78e7fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37957bc3ae26444e88dc2f57d29f9b24'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:36.584849 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2519ab14-93a7-4c21-a435-8f4bad78e7fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37957bc3ae26444e88dc2f57d29f9b24'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:36.585606 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2519ab14-93a7-4c21-a435-8f4bad78e7fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37957bc3ae26444e88dc2f57d29f9b24'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:36.592120 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1436/2867] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 21:01:36 2022] DELETE /identity/v3/users/37957bc3ae26444e88dc2f57d29f9b24 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:36.596696 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19814af-d508-4923-be27-ddc4a4fe1658 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:36.596983 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19814af-d508-4923-be27-ddc4a4fe1658 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:36.597260 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19814af-d508-4923-be27-ddc4a4fe1658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:36.616979 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-f19814af-d508-4923-be27-ddc4a4fe1658 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:01:36.618198 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-f19814af-d508-4923-be27-ddc4a4fe1658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:36.688002 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1432/2868] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 21:01:36.698251 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519ab14-93a7-4c21-a435-8f4bad78e7fb admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:36.699793 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-2519ab14-93a7-4c21-a435-8f4bad78e7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:36.764947 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519ab14-93a7-4c21-a435-8f4bad78e7fb admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:36.768856 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf40c2-787f-4eae-9f50-223f15c84ccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:36.769519 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf40c2-787f-4eae-9f50-223f15c84ccc service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:36.769803 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf40c2-787f-4eae-9f50-223f15c84ccc service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:36.770076 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf40c2-787f-4eae-9f50-223f15c84ccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:36.780790 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf40c2-787f-4eae-9f50-223f15c84ccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:36.782246 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf40c2-787f-4eae-9f50-223f15c84ccc service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:36.792692 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1437/2869] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 21:01:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 21:01:37.092134 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19814af-d508-4923-be27-ddc4a4fe1658 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:37.094231 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-f19814af-d508-4923-be27-ddc4a4fe1658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:37.103700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:37.111944 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19814af-d508-4923-be27-ddc4a4fe1658 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:37.122197 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa5ae0-4f3d-4a99-9b78-c12452bc6d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:37.123534 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa5ae0-4f3d-4a99-9b78-c12452bc6d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:37.124035 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa5ae0-4f3d-4a99-9b78-c12452bc6d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:37.124511 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa5ae0-4f3d-4a99-9b78-c12452bc6d4c admin admin] PATH_INFO: `/v3/projects/c2bb3ec48ff84e5c9e668c9be1bc5dcb` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:37.126224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa5ae0-4f3d-4a99-9b78-c12452bc6d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2bb3ec48ff84e5c9e668c9be1bc5dcb)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:37.128636 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa5ae0-4f3d-4a99-9b78-c12452bc6d4c admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:37.178713 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-2ffa5ae0-4f3d-4a99-9b78-c12452bc6d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2bb3ec48ff84e5c9e668c9be1bc5dcb', 'request_id': 'req-2ffa5ae0-4f3d-4a99-9b78-c12452bc6d4c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:37.186810 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-2ffa5ae0-4f3d-4a99-9b78-c12452bc6d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2bb3ec48ff84e5c9e668c9be1bc5dcb', 'request_id': 'req-2ffa5ae0-4f3d-4a99-9b78-c12452bc6d4c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:37.192627 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-2ffa5ae0-4f3d-4a99-9b78-c12452bc6d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2bb3ec48ff84e5c9e668c9be1bc5dcb', 'request_id': 'req-2ffa5ae0-4f3d-4a99-9b78-c12452bc6d4c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:37.204662 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-2ffa5ae0-4f3d-4a99-9b78-c12452bc6d4c admin admin] The token cache is being invalidate because project c2bb3ec48ff84e5c9e668c9be1bc5dcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 21:01:37.204956 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-2ffa5ae0-4f3d-4a99-9b78-c12452bc6d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:37.205647 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-2ffa5ae0-4f3d-4a99-9b78-c12452bc6d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:37.207224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1433/2870] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 21:01:37 2022] DELETE /identity/v3/projects/c2bb3ec48ff84e5c9e668c9be1bc5dcb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:37.212578 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf40c2-787f-4eae-9f50-223f15c84ccc service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:37.223283 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf40c2-787f-4eae-9f50-223f15c84ccc service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:37.287046 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8874b-ba84-480d-8a95-ff6794d20c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:37.288527 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8874b-ba84-480d-8a95-ff6794d20c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:37.288813 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8874b-ba84-480d-8a95-ff6794d20c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:37.289089 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8874b-ba84-480d-8a95-ff6794d20c5a admin admin] PATH_INFO: `/v3/users/e329eb6d59d44fd9a87f1ef706956a86` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:37.290451 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8874b-ba84-480d-8a95-ff6794d20c5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e329eb6d59d44fd9a87f1ef706956a86)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:37.292468 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8874b-ba84-480d-8a95-ff6794d20c5a admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:37.441410 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:37.472896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-12d8874b-ba84-480d-8a95-ff6794d20c5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e329eb6d59d44fd9a87f1ef706956a86'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:37.479898 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-12d8874b-ba84-480d-8a95-ff6794d20c5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e329eb6d59d44fd9a87f1ef706956a86'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:37.492981 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-12d8874b-ba84-480d-8a95-ff6794d20c5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e329eb6d59d44fd9a87f1ef706956a86'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:37.500891 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-12d8874b-ba84-480d-8a95-ff6794d20c5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e329eb6d59d44fd9a87f1ef706956a86'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:37.501573 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-12d8874b-ba84-480d-8a95-ff6794d20c5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e329eb6d59d44fd9a87f1ef706956a86'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:37.508289 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1438/2871] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 21:01:37 2022] DELETE /identity/v3/users/e329eb6d59d44fd9a87f1ef706956a86 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 21:01:37.813506 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa5ae0-4f3d-4a99-9b78-c12452bc6d4c admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:37.815989 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-2ffa5ae0-4f3d-4a99-9b78-c12452bc6d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:37.839389 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa5ae0-4f3d-4a99-9b78-c12452bc6d4c admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:37.921180 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7a2b1-a5e3-4b8c-bc65-124cae1cbf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:37.922117 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7a2b1-a5e3-4b8c-bc65-124cae1cbf1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:37.922410 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7a2b1-a5e3-4b8c-bc65-124cae1cbf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:37.922689 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7a2b1-a5e3-4b8c-bc65-124cae1cbf1c admin admin] PATH_INFO: `/v3/projects/fb2db0b512b5417e851ca027c57816d1` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:37.924115 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7a2b1-a5e3-4b8c-bc65-124cae1cbf1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb2db0b512b5417e851ca027c57816d1)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:37.926167 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7a2b1-a5e3-4b8c-bc65-124cae1cbf1c admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:37.982146 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-4da7a2b1-a5e3-4b8c-bc65-124cae1cbf1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb2db0b512b5417e851ca027c57816d1', 'request_id': 'req-4da7a2b1-a5e3-4b8c-bc65-124cae1cbf1c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:37.990971 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-4da7a2b1-a5e3-4b8c-bc65-124cae1cbf1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb2db0b512b5417e851ca027c57816d1', 'request_id': 'req-4da7a2b1-a5e3-4b8c-bc65-124cae1cbf1c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:37.997574 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-4da7a2b1-a5e3-4b8c-bc65-124cae1cbf1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb2db0b512b5417e851ca027c57816d1', 'request_id': 'req-4da7a2b1-a5e3-4b8c-bc65-124cae1cbf1c'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:38.009548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-4da7a2b1-a5e3-4b8c-bc65-124cae1cbf1c admin admin] The token cache is being invalidate because project fb2db0b512b5417e851ca027c57816d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 21:01:38.009837 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-4da7a2b1-a5e3-4b8c-bc65-124cae1cbf1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:38.010496 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-4da7a2b1-a5e3-4b8c-bc65-124cae1cbf1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:38.012135 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1434/2872] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 21:01:37 2022] DELETE /identity/v3/projects/fb2db0b512b5417e851ca027c57816d1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:38.017693 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e443218-b725-454b-893c-435ac049db1a None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:38.018108 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e443218-b725-454b-893c-435ac049db1a None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:38.018492 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e443218-b725-454b-893c-435ac049db1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:38.038710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-5e443218-b725-454b-893c-435ac049db1a None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:01:38.040013 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-5e443218-b725-454b-893c-435ac049db1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:38.103976 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1439/2873] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 21:01:38.112313 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98778d-4bb1-463e-b38f-27c17f0ac9ba None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:38.112942 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98778d-4bb1-463e-b38f-27c17f0ac9ba None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:38.112942 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98778d-4bb1-463e-b38f-27c17f0ac9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:38.132819 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-1f98778d-4bb1-463e-b38f-27c17f0ac9ba None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:01:38.133965 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-1f98778d-4bb1-463e-b38f-27c17f0ac9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:38.143224 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1435/2874] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 21:01:38.149284 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e443218-b725-454b-893c-435ac049db1a None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:38.158957 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e443218-b725-454b-893c-435ac049db1a None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:38.164825 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aff3d4-4a25-43f6-97a0-440432ab4947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:38.165565 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aff3d4-4a25-43f6-97a0-440432ab4947 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:38.165876 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aff3d4-4a25-43f6-97a0-440432ab4947 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:38.166200 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aff3d4-4a25-43f6-97a0-440432ab4947 admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:38.167154 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aff3d4-4a25-43f6-97a0-440432ab4947 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 21:01:38.167510 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aff3d4-4a25-43f6-97a0-440432ab4947 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:38.169172 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aff3d4-4a25-43f6-97a0-440432ab4947 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:38.182397 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1440/2875] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 21:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 21:01:38.187448 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98778d-4bb1-463e-b38f-27c17f0ac9ba None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:38.197894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98778d-4bb1-463e-b38f-27c17f0ac9ba None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:38.202756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8071ad6-da97-4b34-88a8-453cc7c79513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:38.203576 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8071ad6-da97-4b34-88a8-453cc7c79513 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:38.203746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8071ad6-da97-4b34-88a8-453cc7c79513 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:38.204019 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8071ad6-da97-4b34-88a8-453cc7c79513 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:38.204734 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8071ad6-da97-4b34-88a8-453cc7c79513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:38.206669 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8071ad6-da97-4b34-88a8-453cc7c79513 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:38.211613 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:38.236677 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1436/2876] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 21:01:38 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 21:01:38.243511 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aff3d4-4a25-43f6-97a0-440432ab4947 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:38.253578 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aff3d4-4a25-43f6-97a0-440432ab4947 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:38.314958 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92960074-fb05-4076-8352-a2cece813ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:38.315683 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92960074-fb05-4076-8352-a2cece813ade admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:38.315968 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92960074-fb05-4076-8352-a2cece813ade admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:38.316252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92960074-fb05-4076-8352-a2cece813ade admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:38.316949 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92960074-fb05-4076-8352-a2cece813ade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:38.318872 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92960074-fb05-4076-8352-a2cece813ade admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:38.341714 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1441/2877] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 21:01:38 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 21:01:38.346279 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8071ad6-da97-4b34-88a8-453cc7c79513 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:38.357430 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8071ad6-da97-4b34-88a8-453cc7c79513 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:38.362581 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2beab12-1684-4a26-9c6b-9dcdf73fe4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:38.363290 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2beab12-1684-4a26-9c6b-9dcdf73fe4ef admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:38.363599 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2beab12-1684-4a26-9c6b-9dcdf73fe4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:38.363877 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2beab12-1684-4a26-9c6b-9dcdf73fe4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:38.364620 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2beab12-1684-4a26-9c6b-9dcdf73fe4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:38.366775 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2beab12-1684-4a26-9c6b-9dcdf73fe4ef admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:38.378334 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1437/2878] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 21:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 21:01:38.383467 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92960074-fb05-4076-8352-a2cece813ade admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:38.394260 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92960074-fb05-4076-8352-a2cece813ade admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:38.399309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b3336-19a2-4bd6-9de0-0c28b267a154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:38.400025 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b3336-19a2-4bd6-9de0-0c28b267a154 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:38.400307 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b3336-19a2-4bd6-9de0-0c28b267a154 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:38.400580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b3336-19a2-4bd6-9de0-0c28b267a154 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:38.401320 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b3336-19a2-4bd6-9de0-0c28b267a154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:38.402905 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b3336-19a2-4bd6-9de0-0c28b267a154 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:38.414052 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1442/2879] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 21:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 21:01:38.418692 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2beab12-1684-4a26-9c6b-9dcdf73fe4ef admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:38.432246 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2beab12-1684-4a26-9c6b-9dcdf73fe4ef admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:38.437251 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d79578-d0d1-46f9-a0a3-791dbbcb7f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:38.438158 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d79578-d0d1-46f9-a0a3-791dbbcb7f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:38.438444 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d79578-d0d1-46f9-a0a3-791dbbcb7f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:38.438725 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d79578-d0d1-46f9-a0a3-791dbbcb7f42 admin admin] PATH_INFO: `/v3/projects/7788158c16bd4e18b7a67d5ca53e0bbf/users/070f6f9cbf7949339e81a506a8534ef6/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:38.455979 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d79578-d0d1-46f9-a0a3-791dbbcb7f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7788158c16bd4e18b7a67d5ca53e0bbf, user_id=070f6f9cbf7949339e81a506a8534ef6, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:38.458670 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d79578-d0d1-46f9-a0a3-791dbbcb7f42 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:38.474842 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1438/2880] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 21:01:38 2022] PUT /identity/v3/projects/7788158c16bd4e18b7a67d5ca53e0bbf/users/070f6f9cbf7949339e81a506a8534ef6/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:38.487784 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00863cbd-e5a6-4d29-9102-ecab493e99f5 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:38.488213 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00863cbd-e5a6-4d29-9102-ecab493e99f5 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:38.488613 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00863cbd-e5a6-4d29-9102-ecab493e99f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:38.496064 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:38.520037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-00863cbd-e5a6-4d29-9102-ecab493e99f5 None None] MFA Rules not processed for user `070f6f9cbf7949339e81a506a8534ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:01:38.521540 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-00863cbd-e5a6-4d29-9102-ecab493e99f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:38.592219 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1443/2881] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:01:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 21:01:38.597274 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d79578-d0d1-46f9-a0a3-791dbbcb7f42 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:38.668082 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d79578-d0d1-46f9-a0a3-791dbbcb7f42 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:38.672874 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7978d-2156-47c7-9de7-be3a7e1bfad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:38.673546 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7978d-2156-47c7-9de7-be3a7e1bfad3 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:38.673828 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7978d-2156-47c7-9de7-be3a7e1bfad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:38.674105 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7978d-2156-47c7-9de7-be3a7e1bfad3 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:38.674798 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7978d-2156-47c7-9de7-be3a7e1bfad3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:38.676712 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7978d-2156-47c7-9de7-be3a7e1bfad3 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:38.704548 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1439/2882] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 21:01:38 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 21:01:38.709051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00863cbd-e5a6-4d29-9102-ecab493e99f5 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:38.722316 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00863cbd-e5a6-4d29-9102-ecab493e99f5 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:38.780914 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0aa280-7d26-4159-8cab-e62144c8d249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:38.781604 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aa280-7d26-4159-8cab-e62144c8d249 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:38.781879 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aa280-7d26-4159-8cab-e62144c8d249 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:38.782149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aa280-7d26-4159-8cab-e62144c8d249 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:38.782847 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0aa280-7d26-4159-8cab-e62144c8d249 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:38.784817 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0aa280-7d26-4159-8cab-e62144c8d249 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:38.806223 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1444/2883] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 21:01:38 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 21:01:38.810428 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7978d-2156-47c7-9de7-be3a7e1bfad3 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:38.821866 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7978d-2156-47c7-9de7-be3a7e1bfad3 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:38.826720 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff1f6e-becd-4d54-8f0d-014e144f12ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:38.827516 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff1f6e-becd-4d54-8f0d-014e144f12ec admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:38.827816 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff1f6e-becd-4d54-8f0d-014e144f12ec admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:38.828151 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff1f6e-becd-4d54-8f0d-014e144f12ec admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:38.829940 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff1f6e-becd-4d54-8f0d-014e144f12ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:38.830407 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff1f6e-becd-4d54-8f0d-014e144f12ec admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:38.850896 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1440/2884] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 21:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 21:01:38.856822 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0aa280-7d26-4159-8cab-e62144c8d249 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:38.867501 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0aa280-7d26-4159-8cab-e62144c8d249 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:38.873205 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41cfc5-88ab-4ce1-bb51-ef215952c15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:38.874411 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41cfc5-88ab-4ce1-bb51-ef215952c15c admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:38.874830 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41cfc5-88ab-4ce1-bb51-ef215952c15c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:38.875287 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41cfc5-88ab-4ce1-bb51-ef215952c15c admin admin] PATH_INFO: `/v3/projects/271e6b51fbda4ec0a46c683a84769e11/users/0c41488f6a2e48c39d77d51c57666a60/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:38.902051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41cfc5-88ab-4ce1-bb51-ef215952c15c admin admin] RBAC: Authorizing `identity:create_grant(project_id=271e6b51fbda4ec0a46c683a84769e11, user_id=0c41488f6a2e48c39d77d51c57666a60, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:38.908288 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41cfc5-88ab-4ce1-bb51-ef215952c15c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:38.926252 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1445/2885] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 21:01:38 2022] PUT /identity/v3/projects/271e6b51fbda4ec0a46c683a84769e11/users/0c41488f6a2e48c39d77d51c57666a60/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 21:01:38.930880 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff1f6e-becd-4d54-8f0d-014e144f12ec admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:38.941340 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff1f6e-becd-4d54-8f0d-014e144f12ec admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:39.000252 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6679d5c-d2a2-4cb8-a7b3-19dffc14e89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:39.000938 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6679d5c-d2a2-4cb8-a7b3-19dffc14e89d admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:39.001227 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6679d5c-d2a2-4cb8-a7b3-19dffc14e89d admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:39.001510 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6679d5c-d2a2-4cb8-a7b3-19dffc14e89d admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:39.002248 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6679d5c-d2a2-4cb8-a7b3-19dffc14e89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:39.003934 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6679d5c-d2a2-4cb8-a7b3-19dffc14e89d admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:39.015842 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1441/2886] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 21:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 21:01:39.021919 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41cfc5-88ab-4ce1-bb51-ef215952c15c admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:39.040426 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41cfc5-88ab-4ce1-bb51-ef215952c15c admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:39.047795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78df600-2c38-4f22-b9ff-9a59101cdc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:39.049343 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78df600-2c38-4f22-b9ff-9a59101cdc6d admin admin] REQUEST_METHOD: `PUT` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:39.049829 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78df600-2c38-4f22-b9ff-9a59101cdc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:39.050338 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78df600-2c38-4f22-b9ff-9a59101cdc6d admin admin] PATH_INFO: `/v3/projects/271e6b51fbda4ec0a46c683a84769e11/users/0c41488f6a2e48c39d77d51c57666a60/roles/b30f01ef95004a1b84fc029830bdf053` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:39.054301 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78df600-2c38-4f22-b9ff-9a59101cdc6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=271e6b51fbda4ec0a46c683a84769e11, user_id=0c41488f6a2e48c39d77d51c57666a60, role_id=b30f01ef95004a1b84fc029830bdf053)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:39.059706 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78df600-2c38-4f22-b9ff-9a59101cdc6d admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:39.078682 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1446/2887] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 21:01:39 2022] PUT /identity/v3/projects/271e6b51fbda4ec0a46c683a84769e11/users/0c41488f6a2e48c39d77d51c57666a60/roles/b30f01ef95004a1b84fc029830bdf053 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:39.095746 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5617a1a-c67a-42ed-9936-383b6a976341 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:39.096075 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5617a1a-c67a-42ed-9936-383b6a976341 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:39.096394 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5617a1a-c67a-42ed-9936-383b6a976341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:39.125995 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-b5617a1a-c67a-42ed-9936-383b6a976341 None None] MFA Rules not processed for user `0c41488f6a2e48c39d77d51c57666a60`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:01:39.127221 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b5617a1a-c67a-42ed-9936-383b6a976341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:39.137503 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:39.224672 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1442/2888] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:01:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 21:01:39.240562 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78df600-2c38-4f22-b9ff-9a59101cdc6d admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:39.242294 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-c78df600-2c38-4f22-b9ff-9a59101cdc6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:39.325886 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:39.333869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78df600-2c38-4f22-b9ff-9a59101cdc6d admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:39.338861 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac2404-9126-470e-834a-c917c42ebdf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:39.339658 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac2404-9126-470e-834a-c917c42ebdf9 service cinder] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:39.339936 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac2404-9126-470e-834a-c917c42ebdf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:39.340218 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac2404-9126-470e-834a-c917c42ebdf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:39.416846 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac2404-9126-470e-834a-c917c42ebdf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:39.418358 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac2404-9126-470e-834a-c917c42ebdf9 service cinder] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:39.431707 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1447/2889] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 21:01:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 21:01:43.781258 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5617a1a-c67a-42ed-9936-383b6a976341 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:43.782753 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b5617a1a-c67a-42ed-9936-383b6a976341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:43.795540 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5617a1a-c67a-42ed-9936-383b6a976341 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:43.799630 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ed0af-1ec9-48ef-a9da-754b3984816d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:43.800412 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ed0af-1ec9-48ef-a9da-754b3984816d service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:43.800797 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ed0af-1ec9-48ef-a9da-754b3984816d service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:43.801165 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ed0af-1ec9-48ef-a9da-754b3984816d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:43.812137 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ed0af-1ec9-48ef-a9da-754b3984816d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:43.813582 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ed0af-1ec9-48ef-a9da-754b3984816d service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:43.824700 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1443/2890] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 21:01:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 21:01:48.928624 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac2404-9126-470e-834a-c917c42ebdf9 service cinder] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:48.997096 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac2404-9126-470e-834a-c917c42ebdf9 service cinder] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:49.001799 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb622187-8bff-46cc-9c25-d7f6846ea802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:49.002687 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb622187-8bff-46cc-9c25-d7f6846ea802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:49.002969 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb622187-8bff-46cc-9c25-d7f6846ea802 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:49.003245 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb622187-8bff-46cc-9c25-d7f6846ea802 admin admin] PATH_INFO: `/v3/users/070f6f9cbf7949339e81a506a8534ef6` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:49.004484 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb622187-8bff-46cc-9c25-d7f6846ea802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=070f6f9cbf7949339e81a506a8534ef6)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:49.006565 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb622187-8bff-46cc-9c25-d7f6846ea802 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:49.080276 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-cb622187-8bff-46cc-9c25-d7f6846ea802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '070f6f9cbf7949339e81a506a8534ef6'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:49.089117 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-cb622187-8bff-46cc-9c25-d7f6846ea802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '070f6f9cbf7949339e81a506a8534ef6'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:49.103517 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-cb622187-8bff-46cc-9c25-d7f6846ea802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '070f6f9cbf7949339e81a506a8534ef6'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:49.112430 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-cb622187-8bff-46cc-9c25-d7f6846ea802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '070f6f9cbf7949339e81a506a8534ef6'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:49.113206 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-cb622187-8bff-46cc-9c25-d7f6846ea802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '070f6f9cbf7949339e81a506a8534ef6'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:49.120106 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1448/2891] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 21:01:48 2022] DELETE /identity/v3/users/070f6f9cbf7949339e81a506a8534ef6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:49.125138 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9222aa4-a932-4627-934f-c15be7605758 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:49.125874 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9222aa4-a932-4627-934f-c15be7605758 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:49.125874 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9222aa4-a932-4627-934f-c15be7605758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:49.145215 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-b9222aa4-a932-4627-934f-c15be7605758 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:01:49.146451 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b9222aa4-a932-4627-934f-c15be7605758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:49.210922 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1444/2892] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 21:01:49.221580 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb622187-8bff-46cc-9c25-d7f6846ea802 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:49.223202 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-cb622187-8bff-46cc-9c25-d7f6846ea802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:49.246288 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:49.287976 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb622187-8bff-46cc-9c25-d7f6846ea802 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:49.291984 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa4313-77c1-4819-92af-d050126a0717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:49.292667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa4313-77c1-4819-92af-d050126a0717 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:49.292953 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa4313-77c1-4819-92af-d050126a0717 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:49.293253 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa4313-77c1-4819-92af-d050126a0717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:49.303826 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa4313-77c1-4819-92af-d050126a0717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:49.305293 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa4313-77c1-4819-92af-d050126a0717 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:49.316407 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1449/2893] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 21:01:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 21:01:49.613495 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9222aa4-a932-4627-934f-c15be7605758 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:49.615996 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-b9222aa4-a932-4627-934f-c15be7605758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:49.633070 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9222aa4-a932-4627-934f-c15be7605758 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:49.638211 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b652320-585a-4b96-b93c-f43927d954a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:49.639149 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b652320-585a-4b96-b93c-f43927d954a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:49.639468 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b652320-585a-4b96-b93c-f43927d954a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:49.639753 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b652320-585a-4b96-b93c-f43927d954a5 admin admin] PATH_INFO: `/v3/projects/7788158c16bd4e18b7a67d5ca53e0bbf` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:49.641019 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b652320-585a-4b96-b93c-f43927d954a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7788158c16bd4e18b7a67d5ca53e0bbf)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:49.642968 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b652320-585a-4b96-b93c-f43927d954a5 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:49.692528 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-2b652320-585a-4b96-b93c-f43927d954a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7788158c16bd4e18b7a67d5ca53e0bbf', 'request_id': 'req-2b652320-585a-4b96-b93c-f43927d954a5'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:49.701599 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-2b652320-585a-4b96-b93c-f43927d954a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7788158c16bd4e18b7a67d5ca53e0bbf', 'request_id': 'req-2b652320-585a-4b96-b93c-f43927d954a5'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:49.707675 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-2b652320-585a-4b96-b93c-f43927d954a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7788158c16bd4e18b7a67d5ca53e0bbf', 'request_id': 'req-2b652320-585a-4b96-b93c-f43927d954a5'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:49.720166 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-2b652320-585a-4b96-b93c-f43927d954a5 admin admin] The token cache is being invalidate because project 7788158c16bd4e18b7a67d5ca53e0bbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 21:01:49.720473 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-2b652320-585a-4b96-b93c-f43927d954a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:49.721112 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-2b652320-585a-4b96-b93c-f43927d954a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:49.722711 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1445/2894] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 21:01:49 2022] DELETE /identity/v3/projects/7788158c16bd4e18b7a67d5ca53e0bbf => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:49.727080 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa4313-77c1-4819-92af-d050126a0717 service neutron] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:49.737200 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa4313-77c1-4819-92af-d050126a0717 service neutron] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:49.804489 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b52056-ea17-49d3-a517-05ac4dddceb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:49.805429 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b52056-ea17-49d3-a517-05ac4dddceb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:49.805710 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b52056-ea17-49d3-a517-05ac4dddceb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:49.805987 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b52056-ea17-49d3-a517-05ac4dddceb1 admin admin] PATH_INFO: `/v3/users/0c41488f6a2e48c39d77d51c57666a60` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:49.807299 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b52056-ea17-49d3-a517-05ac4dddceb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c41488f6a2e48c39d77d51c57666a60)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:49.809250 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b52056-ea17-49d3-a517-05ac4dddceb1 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:49.860918 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-85b52056-ea17-49d3-a517-05ac4dddceb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c41488f6a2e48c39d77d51c57666a60'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:49.868795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-85b52056-ea17-49d3-a517-05ac4dddceb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c41488f6a2e48c39d77d51c57666a60'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:49.881331 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-85b52056-ea17-49d3-a517-05ac4dddceb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c41488f6a2e48c39d77d51c57666a60'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:49.890560 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-85b52056-ea17-49d3-a517-05ac4dddceb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c41488f6a2e48c39d77d51c57666a60'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:49.891396 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-85b52056-ea17-49d3-a517-05ac4dddceb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c41488f6a2e48c39d77d51c57666a60'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:49.898952 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1450/2895] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 21:01:49 2022] DELETE /identity/v3/users/0c41488f6a2e48c39d77d51c57666a60 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:50.210769 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b652320-585a-4b96-b93c-f43927d954a5 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:50.212541 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-2b652320-585a-4b96-b93c-f43927d954a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:50.232885 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b652320-585a-4b96-b93c-f43927d954a5 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:50.247580 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:50.303478 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed571c-d7a1-4bf1-8a17-0e5de30c894f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:50.304371 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed571c-d7a1-4bf1-8a17-0e5de30c894f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:50.304656 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed571c-d7a1-4bf1-8a17-0e5de30c894f admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:50.304930 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed571c-d7a1-4bf1-8a17-0e5de30c894f admin admin] PATH_INFO: `/v3/projects/271e6b51fbda4ec0a46c683a84769e11` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:50.306193 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed571c-d7a1-4bf1-8a17-0e5de30c894f admin admin] RBAC: Authorizing `identity:delete_project(project_id=271e6b51fbda4ec0a46c683a84769e11)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:50.308163 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed571c-d7a1-4bf1-8a17-0e5de30c894f admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:50.359343 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9aed571c-d7a1-4bf1-8a17-0e5de30c894f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '271e6b51fbda4ec0a46c683a84769e11', 'request_id': 'req-9aed571c-d7a1-4bf1-8a17-0e5de30c894f'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:50.367925 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9aed571c-d7a1-4bf1-8a17-0e5de30c894f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '271e6b51fbda4ec0a46c683a84769e11', 'request_id': 'req-9aed571c-d7a1-4bf1-8a17-0e5de30c894f'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:50.378965 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9aed571c-d7a1-4bf1-8a17-0e5de30c894f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '271e6b51fbda4ec0a46c683a84769e11', 'request_id': 'req-9aed571c-d7a1-4bf1-8a17-0e5de30c894f'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:50.394278 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9aed571c-d7a1-4bf1-8a17-0e5de30c894f admin admin] The token cache is being invalidate because project 271e6b51fbda4ec0a46c683a84769e11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 21:01:50.394547 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9aed571c-d7a1-4bf1-8a17-0e5de30c894f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:50.395246 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-9aed571c-d7a1-4bf1-8a17-0e5de30c894f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:50.397403 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1446/2896] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 21:01:50 2022] DELETE /identity/v3/projects/271e6b51fbda4ec0a46c683a84769e11 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:50.404305 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c08fc8-3b07-466a-b595-c82af1617bec None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:50.405892 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c08fc8-3b07-466a-b595-c82af1617bec None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:50.405892 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c08fc8-3b07-466a-b595-c82af1617bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:50.427009 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-61c08fc8-3b07-466a-b595-c82af1617bec None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:01:50.428370 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-61c08fc8-3b07-466a-b595-c82af1617bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:50.478870 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:50.512087 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1451/2897] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 21:01:50.521384 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b1a73-ca63-4b4a-a555-a8dbb595fa15 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:50.521790 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b1a73-ca63-4b4a-a555-a8dbb595fa15 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:50.522072 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b1a73-ca63-4b4a-a555-a8dbb595fa15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:50.541604 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-566b1a73-ca63-4b4a-a555-a8dbb595fa15 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:01:50.542834 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-566b1a73-ca63-4b4a-a555-a8dbb595fa15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:50.550984 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1447/2898] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 21:01:50.556317 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c08fc8-3b07-466a-b595-c82af1617bec None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:50.569166 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c08fc8-3b07-466a-b595-c82af1617bec None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:50.575956 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108dbae5-e0f8-4ac2-ac03-ed87b5eb4fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:50.577091 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108dbae5-e0f8-4ac2-ac03-ed87b5eb4fda admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:50.577553 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108dbae5-e0f8-4ac2-ac03-ed87b5eb4fda admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:50.578649 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108dbae5-e0f8-4ac2-ac03-ed87b5eb4fda admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:50.579923 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108dbae5-e0f8-4ac2-ac03-ed87b5eb4fda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 21:01:50.580415 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108dbae5-e0f8-4ac2-ac03-ed87b5eb4fda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:50.584363 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108dbae5-e0f8-4ac2-ac03-ed87b5eb4fda admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:50.603061 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1452/2899] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 21:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 21:01:50.607599 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b1a73-ca63-4b4a-a555-a8dbb595fa15 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:50.617964 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b1a73-ca63-4b4a-a555-a8dbb595fa15 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:50.622783 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa62619-0ab9-46cd-aadd-a927770b30d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:50.623494 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa62619-0ab9-46cd-aadd-a927770b30d9 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:50.623780 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa62619-0ab9-46cd-aadd-a927770b30d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:50.624057 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa62619-0ab9-46cd-aadd-a927770b30d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:50.624756 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa62619-0ab9-46cd-aadd-a927770b30d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:50.626666 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa62619-0ab9-46cd-aadd-a927770b30d9 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:50.655201 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1448/2900] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 21:01:50 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 21:01:50.659417 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108dbae5-e0f8-4ac2-ac03-ed87b5eb4fda admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:50.670251 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108dbae5-e0f8-4ac2-ac03-ed87b5eb4fda admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:50.731804 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d44b0-9873-4521-bc1a-13a19f49019c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:50.732546 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d44b0-9873-4521-bc1a-13a19f49019c admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:50.732896 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d44b0-9873-4521-bc1a-13a19f49019c admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:50.733267 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d44b0-9873-4521-bc1a-13a19f49019c admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:50.734046 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d44b0-9873-4521-bc1a-13a19f49019c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:50.736215 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d44b0-9873-4521-bc1a-13a19f49019c admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:50.759934 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1453/2901] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 21:01:50 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 21:01:50.764777 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa62619-0ab9-46cd-aadd-a927770b30d9 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:50.779591 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa62619-0ab9-46cd-aadd-a927770b30d9 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:50.784611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d2535-0549-4e4d-92b7-155978203fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:50.785301 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d2535-0549-4e4d-92b7-155978203fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:50.785586 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d2535-0549-4e4d-92b7-155978203fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:50.785868 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d2535-0549-4e4d-92b7-155978203fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:50.786608 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d2535-0549-4e4d-92b7-155978203fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:50.788755 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d2535-0549-4e4d-92b7-155978203fc1 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:50.800185 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1449/2902] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 21:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 21:01:50.805994 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d44b0-9873-4521-bc1a-13a19f49019c admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:50.818227 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d44b0-9873-4521-bc1a-13a19f49019c admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:50.824590 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d789415-67ab-4efc-9b13-08637826fed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:50.825280 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d789415-67ab-4efc-9b13-08637826fed3 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:50.825561 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d789415-67ab-4efc-9b13-08637826fed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:50.825837 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d789415-67ab-4efc-9b13-08637826fed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:50.826569 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d789415-67ab-4efc-9b13-08637826fed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:50.828201 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d789415-67ab-4efc-9b13-08637826fed3 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:50.839287 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1454/2903] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 21:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 21:01:50.844452 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d2535-0549-4e4d-92b7-155978203fc1 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:50.860847 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d2535-0549-4e4d-92b7-155978203fc1 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:50.867289 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb095b8e-3873-479c-b0e5-62127e9ff1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:50.868264 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb095b8e-3873-479c-b0e5-62127e9ff1de admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:50.868611 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb095b8e-3873-479c-b0e5-62127e9ff1de admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:50.868938 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb095b8e-3873-479c-b0e5-62127e9ff1de admin admin] PATH_INFO: `/v3/projects/aa621aa8f94346daa7bfe04858f35fbd/users/d83f216a27ed4c978b9e2b49514a0510/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:50.886113 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb095b8e-3873-479c-b0e5-62127e9ff1de admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa621aa8f94346daa7bfe04858f35fbd, user_id=d83f216a27ed4c978b9e2b49514a0510, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:50.888889 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb095b8e-3873-479c-b0e5-62127e9ff1de admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:50.907603 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1450/2904] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 21:01:50 2022] PUT /identity/v3/projects/aa621aa8f94346daa7bfe04858f35fbd/users/d83f216a27ed4c978b9e2b49514a0510/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:50.920987 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f59e4-4997-486f-b244-8fb8daabe076 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:50.921275 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f59e4-4997-486f-b244-8fb8daabe076 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:50.921556 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f59e4-4997-486f-b244-8fb8daabe076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:50.952546 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-dc0f59e4-4997-486f-b244-8fb8daabe076 None None] MFA Rules not processed for user `d83f216a27ed4c978b9e2b49514a0510`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:01:50.953780 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-dc0f59e4-4997-486f-b244-8fb8daabe076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:51.022149 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1455/2905] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:01:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 21:01:51.034526 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb095b8e-3873-479c-b0e5-62127e9ff1de admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:51.036318 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-bb095b8e-3873-479c-b0e5-62127e9ff1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:51.097113 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:51.112393 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb095b8e-3873-479c-b0e5-62127e9ff1de admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:51.116893 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b6585-036a-4711-b050-7c3ad7b3803c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:51.117567 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b6585-036a-4711-b050-7c3ad7b3803c service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:51.117857 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b6585-036a-4711-b050-7c3ad7b3803c service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:51.118137 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b6585-036a-4711-b050-7c3ad7b3803c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:51.128191 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b6585-036a-4711-b050-7c3ad7b3803c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:51.129706 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b6585-036a-4711-b050-7c3ad7b3803c service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:51.140140 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1451/2906] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 21:01:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 21:01:51.162963 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f59e4-4997-486f-b244-8fb8daabe076 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:51.205919 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:51.232854 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f59e4-4997-486f-b244-8fb8daabe076 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:51.238222 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0592eb-5716-4516-bf43-de981042c16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:51.239160 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0592eb-5716-4516-bf43-de981042c16f admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:51.239470 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0592eb-5716-4516-bf43-de981042c16f admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:51.239747 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0592eb-5716-4516-bf43-de981042c16f admin admin] PATH_INFO: `/v3/users/d83f216a27ed4c978b9e2b49514a0510` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:51.241783 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0592eb-5716-4516-bf43-de981042c16f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d83f216a27ed4c978b9e2b49514a0510)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:51.243794 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0592eb-5716-4516-bf43-de981042c16f admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:51.296552 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-8a0592eb-5716-4516-bf43-de981042c16f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd83f216a27ed4c978b9e2b49514a0510'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:51.303869 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-8a0592eb-5716-4516-bf43-de981042c16f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd83f216a27ed4c978b9e2b49514a0510'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:51.316351 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-8a0592eb-5716-4516-bf43-de981042c16f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd83f216a27ed4c978b9e2b49514a0510'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:51.324444 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-8a0592eb-5716-4516-bf43-de981042c16f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd83f216a27ed4c978b9e2b49514a0510'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:51.325380 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-8a0592eb-5716-4516-bf43-de981042c16f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd83f216a27ed4c978b9e2b49514a0510'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:51.332508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1456/2907] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 21:01:51 2022] DELETE /identity/v3/users/d83f216a27ed4c978b9e2b49514a0510 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:51.339145 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2c0d4-cc5f-4cf5-a9d5-86ddd0e3185a None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:51.339860 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2c0d4-cc5f-4cf5-a9d5-86ddd0e3185a None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:51.340177 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2c0d4-cc5f-4cf5-a9d5-86ddd0e3185a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:51.366457 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-2cd2c0d4-cc5f-4cf5-a9d5-86ddd0e3185a None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:01:51.367782 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-2cd2c0d4-cc5f-4cf5-a9d5-86ddd0e3185a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:51.557055 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1452/2908] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 21:01:51.567501 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0592eb-5716-4516-bf43-de981042c16f admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:51.569147 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-8a0592eb-5716-4516-bf43-de981042c16f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:51.632347 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0592eb-5716-4516-bf43-de981042c16f admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:51.635988 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f64027-12e9-457c-be91-4fa64dfd9368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:51.636650 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f64027-12e9-457c-be91-4fa64dfd9368 service neutron] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:51.636939 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f64027-12e9-457c-be91-4fa64dfd9368 service neutron] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:51.637216 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f64027-12e9-457c-be91-4fa64dfd9368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:51.647108 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f64027-12e9-457c-be91-4fa64dfd9368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:51.648570 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f64027-12e9-457c-be91-4fa64dfd9368 service neutron] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:51.659037 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1457/2909] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 21:01:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 21:01:51.994896 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2c0d4-cc5f-4cf5-a9d5-86ddd0e3185a None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:51.996502 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-2cd2c0d4-cc5f-4cf5-a9d5-86ddd0e3185a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:52.013855 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2c0d4-cc5f-4cf5-a9d5-86ddd0e3185a None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:52.019455 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea7d32-f51f-4279-ac07-be290628dbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:52.020808 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea7d32-f51f-4279-ac07-be290628dbab admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:52.021157 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea7d32-f51f-4279-ac07-be290628dbab admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:52.021493 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea7d32-f51f-4279-ac07-be290628dbab admin admin] PATH_INFO: `/v3/projects/aa621aa8f94346daa7bfe04858f35fbd` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:52.023301 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea7d32-f51f-4279-ac07-be290628dbab admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa621aa8f94346daa7bfe04858f35fbd)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:52.025234 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea7d32-f51f-4279-ac07-be290628dbab admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:52.080525 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e8ea7d32-f51f-4279-ac07-be290628dbab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa621aa8f94346daa7bfe04858f35fbd', 'request_id': 'req-e8ea7d32-f51f-4279-ac07-be290628dbab'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:52.090285 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e8ea7d32-f51f-4279-ac07-be290628dbab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa621aa8f94346daa7bfe04858f35fbd', 'request_id': 'req-e8ea7d32-f51f-4279-ac07-be290628dbab'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:52.098689 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e8ea7d32-f51f-4279-ac07-be290628dbab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa621aa8f94346daa7bfe04858f35fbd', 'request_id': 'req-e8ea7d32-f51f-4279-ac07-be290628dbab'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:52.113407 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e8ea7d32-f51f-4279-ac07-be290628dbab admin admin] The token cache is being invalidate because project aa621aa8f94346daa7bfe04858f35fbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92087) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 21:01:52.113799 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e8ea7d32-f51f-4279-ac07-be290628dbab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:52.114492 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-e8ea7d32-f51f-4279-ac07-be290628dbab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:01:52.116205 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1453/2910] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 21:01:51 2022] DELETE /identity/v3/projects/aa621aa8f94346daa7bfe04858f35fbd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:01:52.121500 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c596612-c8db-48e0-ba9b-2e56fbdfedd7 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:52.121828 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c596612-c8db-48e0-ba9b-2e56fbdfedd7 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:52.122145 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c596612-c8db-48e0-ba9b-2e56fbdfedd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:52.142061 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-9c596612-c8db-48e0-ba9b-2e56fbdfedd7 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:01:52.143311 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-9c596612-c8db-48e0-ba9b-2e56fbdfedd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:52.197367 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:52.211313 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1458/2911] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 21:01:52.217627 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3598d80-39e8-4ad1-87d8-394be5c25441 None None] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:52.217999 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3598d80-39e8-4ad1-87d8-394be5c25441 None None] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:52.218337 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3598d80-39e8-4ad1-87d8-394be5c25441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:52.238850 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.auth.core [None req-a3598d80-39e8-4ad1-87d8-394be5c25441 None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92087) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:01:52.240194 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-a3598d80-39e8-4ad1-87d8-394be5c25441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:52.248849 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1454/2912] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 21:01:52.253508 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c596612-c8db-48e0-ba9b-2e56fbdfedd7 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:52.264916 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c596612-c8db-48e0-ba9b-2e56fbdfedd7 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:52.269808 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72516f-9f58-41f5-84fd-1755f63971bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:52.270480 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72516f-9f58-41f5-84fd-1755f63971bf admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:52.270757 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72516f-9f58-41f5-84fd-1755f63971bf admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:52.271028 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72516f-9f58-41f5-84fd-1755f63971bf admin admin] PATH_INFO: `/v3/domains` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:52.272425 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72516f-9f58-41f5-84fd-1755f63971bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=92088) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 21:01:52.272795 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72516f-9f58-41f5-84fd-1755f63971bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:52.274401 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72516f-9f58-41f5-84fd-1755f63971bf admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:52.288501 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1459/2913] 10.222.0.77 () {58 vars in 1152 bytes} [Tue Jul 19 21:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 21:01:52.293197 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3598d80-39e8-4ad1-87d8-394be5c25441 None None] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:52.303791 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3598d80-39e8-4ad1-87d8-394be5c25441 None None] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:52.308826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371776df-3807-4f82-9d73-f0a895a9e962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:52.309536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371776df-3807-4f82-9d73-f0a895a9e962 admin admin] REQUEST_METHOD: `POST` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:52.309821 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371776df-3807-4f82-9d73-f0a895a9e962 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:52.310100 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371776df-3807-4f82-9d73-f0a895a9e962 admin admin] PATH_INFO: `/v3/projects` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:52.310826 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371776df-3807-4f82-9d73-f0a895a9e962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:52.312936 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371776df-3807-4f82-9d73-f0a895a9e962 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:52.344833 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1455/2914] 10.222.0.77 () {60 vars in 1152 bytes} [Tue Jul 19 21:01:52 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 21:01:52.352101 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72516f-9f58-41f5-84fd-1755f63971bf admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:52.363167 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72516f-9f58-41f5-84fd-1755f63971bf admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:52.435522 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cf0ae-d1e7-4af6-a881-1299cb4cd043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:52.436612 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cf0ae-d1e7-4af6-a881-1299cb4cd043 admin admin] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:52.437107 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cf0ae-d1e7-4af6-a881-1299cb4cd043 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:52.437602 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cf0ae-d1e7-4af6-a881-1299cb4cd043 admin admin] PATH_INFO: `/v3/users` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:52.438818 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4cf0ae-d1e7-4af6-a881-1299cb4cd043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:52.442354 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4cf0ae-d1e7-4af6-a881-1299cb4cd043 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:52.468286 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1460/2915] 10.222.0.77 () {60 vars in 1143 bytes} [Tue Jul 19 21:01:52 2022] POST /identity/v3/users => generated 283 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 21:01:52.472916 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371776df-3807-4f82-9d73-f0a895a9e962 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:52.484683 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371776df-3807-4f82-9d73-f0a895a9e962 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:52.491092 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85541c92-2d2a-45cb-b26e-3ca941258aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:52.491956 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85541c92-2d2a-45cb-b26e-3ca941258aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:52.492331 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85541c92-2d2a-45cb-b26e-3ca941258aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:52.492706 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85541c92-2d2a-45cb-b26e-3ca941258aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:52.493542 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85541c92-2d2a-45cb-b26e-3ca941258aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:52.495240 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85541c92-2d2a-45cb-b26e-3ca941258aa2 admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:52.507831 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1456/2916] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 21:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 21:01:52.514088 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cf0ae-d1e7-4af6-a881-1299cb4cd043 admin admin] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:52.530866 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4cf0ae-d1e7-4af6-a881-1299cb4cd043 admin admin] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:52.539051 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5048c1d-aa4d-4e28-a706-ceb54b9e7bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:52.540157 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5048c1d-aa4d-4e28-a706-ceb54b9e7bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:52.540626 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5048c1d-aa4d-4e28-a706-ceb54b9e7bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:52.541442 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5048c1d-aa4d-4e28-a706-ceb54b9e7bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:52.542656 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5048c1d-aa4d-4e28-a706-ceb54b9e7bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:52.545354 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5048c1d-aa4d-4e28-a706-ceb54b9e7bd1 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:52.564172 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1461/2917] 10.222.0.77 () {58 vars in 1121 bytes} [Tue Jul 19 21:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 21:01:52.568690 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85541c92-2d2a-45cb-b26e-3ca941258aa2 admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:52.579395 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85541c92-2d2a-45cb-b26e-3ca941258aa2 admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:52.585073 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96991677-6ffb-464e-8ed6-4f5b2f0e699f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:52.586126 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96991677-6ffb-464e-8ed6-4f5b2f0e699f admin admin] REQUEST_METHOD: `PUT` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:52.586406 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96991677-6ffb-464e-8ed6-4f5b2f0e699f admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:52.586687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96991677-6ffb-464e-8ed6-4f5b2f0e699f admin admin] PATH_INFO: `/v3/projects/9b2394f1d87e4e2ebd99307675cabcf2/users/14084536c5904a66b974a8459de30db0/roles/a2021efb2e4e459cbfa73f6987297bca` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:52.611783 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96991677-6ffb-464e-8ed6-4f5b2f0e699f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b2394f1d87e4e2ebd99307675cabcf2, user_id=14084536c5904a66b974a8459de30db0, role_id=a2021efb2e4e459cbfa73f6987297bca)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:52.616894 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96991677-6ffb-464e-8ed6-4f5b2f0e699f admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:52.636002 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1457/2918] 10.222.0.77 () {60 vars in 1482 bytes} [Tue Jul 19 21:01:52 2022] PUT /identity/v3/projects/9b2394f1d87e4e2ebd99307675cabcf2/users/14084536c5904a66b974a8459de30db0/roles/a2021efb2e4e459cbfa73f6987297bca => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 21:01:52.647667 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167ed0e-5eaf-4a2c-88ae-9913afa31ed3 None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:52.648284 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167ed0e-5eaf-4a2c-88ae-9913afa31ed3 None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:52.648284 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167ed0e-5eaf-4a2c-88ae-9913afa31ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:52.679957 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-a167ed0e-5eaf-4a2c-88ae-9913afa31ed3 None None] MFA Rules not processed for user `14084536c5904a66b974a8459de30db0`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:01:52.681188 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a167ed0e-5eaf-4a2c-88ae-9913afa31ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:52.764332 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1462/2919] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:01:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 21:01:52.781399 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96991677-6ffb-464e-8ed6-4f5b2f0e699f admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:01:52.783203 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-96991677-6ffb-464e-8ed6-4f5b2f0e699f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:01:52.794090 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:01:52.867576 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96991677-6ffb-464e-8ed6-4f5b2f0e699f admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:01:52.872846 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bee314-25da-4cde-a222-7dd136f463d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab64f417fe74fc585f32691aa7fb515', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:01:52.873985 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bee314-25da-4cde-a222-7dd136f463d6 service cinder] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:01:52.874482 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bee314-25da-4cde-a222-7dd136f463d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:01:52.874972 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bee314-25da-4cde-a222-7dd136f463d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:01:52.890687 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bee314-25da-4cde-a222-7dd136f463d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:01:52.893385 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bee314-25da-4cde-a222-7dd136f463d6 service cinder] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:01:52.910379 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1458/2920] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 21:01:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 21:02:02.759141 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=72,keystone:INSERT=3 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:02.902398 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=23 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:16.146377 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167ed0e-5eaf-4a2c-88ae-9913afa31ed3 None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:02:16.147827 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-a167ed0e-5eaf-4a2c-88ae-9913afa31ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:02:16.222301 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167ed0e-5eaf-4a2c-88ae-9913afa31ed3 None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:02:16.228546 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa73ae3-8154-4ed4-845f-5c0a00401700 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04843ec31eb84585944c7a2b9cd1c0cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:02:16.229209 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa73ae3-8154-4ed4-845f-5c0a00401700 service placement] REQUEST_METHOD: `GET` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:02:16.229576 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa73ae3-8154-4ed4-845f-5c0a00401700 service placement] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:02:16.229852 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa73ae3-8154-4ed4-845f-5c0a00401700 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:02:16.231748 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-dfa73ae3-8154-4ed4-845f-5c0a00401700 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:02:16.245359 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa73ae3-8154-4ed4-845f-5c0a00401700 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:02:16.246941 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa73ae3-8154-4ed4-845f-5c0a00401700 service placement] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:02:16.258152 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1463/2921] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 21:02:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 21:02:25.299856 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bee314-25da-4cde-a222-7dd136f463d6 service cinder] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:02:25.367943 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bee314-25da-4cde-a222-7dd136f463d6 service cinder] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:02:25.373006 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69908759-2356-4ec6-a814-e7856a04f09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:02:25.373896 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69908759-2356-4ec6-a814-e7856a04f09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:02:25.374179 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69908759-2356-4ec6-a814-e7856a04f09b admin admin] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:02:25.374454 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69908759-2356-4ec6-a814-e7856a04f09b admin admin] PATH_INFO: `/v3/users/14084536c5904a66b974a8459de30db0` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:02:25.375727 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69908759-2356-4ec6-a814-e7856a04f09b admin admin] RBAC: Authorizing `identity:delete_user(user_id=14084536c5904a66b974a8459de30db0)` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:02:25.377650 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69908759-2356-4ec6-a814-e7856a04f09b admin admin] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:02:25.434531 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-69908759-2356-4ec6-a814-e7856a04f09b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14084536c5904a66b974a8459de30db0'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:02:25.442701 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-69908759-2356-4ec6-a814-e7856a04f09b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14084536c5904a66b974a8459de30db0'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:02:25.455846 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-69908759-2356-4ec6-a814-e7856a04f09b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14084536c5904a66b974a8459de30db0'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:02:25.456553 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-69908759-2356-4ec6-a814-e7856a04f09b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14084536c5904a66b974a8459de30db0'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:02:25.463962 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.notifications [None req-69908759-2356-4ec6-a814-e7856a04f09b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14084536c5904a66b974a8459de30db0'} {{(pid=92087) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:02:25.470225 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1459/2922] 10.222.0.77 () {58 vars in 1223 bytes} [Tue Jul 19 21:02:25 2022] DELETE /identity/v3/users/14084536c5904a66b974a8459de30db0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:02:25.476290 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd199c5-7e4d-4a98-bcde-7974586b334b None None] REQUEST_METHOD: `POST` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:02:25.476832 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd199c5-7e4d-4a98-bcde-7974586b334b None None] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:02:25.477156 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd199c5-7e4d-4a98-bcde-7974586b334b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:02:25.497064 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.auth.core [None req-3dd199c5-7e4d-4a98-bcde-7974586b334b None None] MFA Rules not processed for user `70a97f9c967d4ba3819e7f4712b48b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=92088) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 21:02:25.498309 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3dd199c5-7e4d-4a98-bcde-7974586b334b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:02:25.560979 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1464/2923] 10.222.0.77 () {58 vars in 957 bytes} [Tue Jul 19 21:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 21:02:25.570865 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69908759-2356-4ec6-a814-e7856a04f09b admin admin] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:02:25.572315 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-69908759-2356-4ec6-a814-e7856a04f09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:02:25.630660 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69908759-2356-4ec6-a814-e7856a04f09b admin admin] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:02:25.634306 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b59504-b75d-4b33-9321-1f1ecdd22372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b2c0f24d666462aa14ea4eee0592062', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:02:25.634950 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b59504-b75d-4b33-9321-1f1ecdd22372 service neutron] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:02:25.635228 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b59504-b75d-4b33-9321-1f1ecdd22372 service neutron] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:02:25.635536 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b59504-b75d-4b33-9321-1f1ecdd22372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:02:25.644790 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b59504-b75d-4b33-9321-1f1ecdd22372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:02:25.646748 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b59504-b75d-4b33-9321-1f1ecdd22372 service neutron] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:02:25.656508 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1460/2924] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 21:02:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 21:02:25.958735 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd199c5-7e4d-4a98-bcde-7974586b334b None None] Authenticating user token {{(pid=92088) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:02:25.961014 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.fernet_utils [None req-3dd199c5-7e4d-4a98-bcde-7974586b334b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92088) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:02:25.981140 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd199c5-7e4d-4a98-bcde-7974586b334b None None] Validating token access rules against request {{(pid=92088) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:02:25.987533 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980093d-d223-4643-8a51-f6c91d49c9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70a97f9c967d4ba3819e7f4712b48b9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f4e53da4f0744609812a487b0656c7b7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92088) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:02:25.988504 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980093d-d223-4643-8a51-f6c91d49c9f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:02:25.989050 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980093d-d223-4643-8a51-f6c91d49c9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:02:25.990046 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980093d-d223-4643-8a51-f6c91d49c9f3 admin admin] PATH_INFO: `/v3/projects/9b2394f1d87e4e2ebd99307675cabcf2` {{(pid=92088) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:02:25.992033 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980093d-d223-4643-8a51-f6c91d49c9f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b2394f1d87e4e2ebd99307675cabcf2)` {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:02:25.994198 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980093d-d223-4643-8a51-f6c91d49c9f3 admin admin] RBAC: Authorization granted {{(pid=92088) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:02:26.055396 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2980093d-d223-4643-8a51-f6c91d49c9f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b2394f1d87e4e2ebd99307675cabcf2', 'request_id': 'req-2980093d-d223-4643-8a51-f6c91d49c9f3'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:02:26.061318 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2980093d-d223-4643-8a51-f6c91d49c9f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b2394f1d87e4e2ebd99307675cabcf2', 'request_id': 'req-2980093d-d223-4643-8a51-f6c91d49c9f3'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:02:26.070458 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2980093d-d223-4643-8a51-f6c91d49c9f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b2394f1d87e4e2ebd99307675cabcf2', 'request_id': 'req-2980093d-d223-4643-8a51-f6c91d49c9f3'} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:02:26.082463 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2980093d-d223-4643-8a51-f6c91d49c9f3 admin admin] The token cache is being invalidate because project 9b2394f1d87e4e2ebd99307675cabcf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=92088) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 21:02:26.082673 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2980093d-d223-4643-8a51-f6c91d49c9f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:02:26.083373 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG keystone.notifications [None req-2980093d-d223-4643-8a51-f6c91d49c9f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=92088) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 21:02:26.084970 dv-cinder-749155-8-smb devstack@keystone.service[92088]: [pid: 92088|app: 0|req: 1465/2925] 10.222.0.77 () {58 vars in 1232 bytes} [Tue Jul 19 21:02:25 2022] DELETE /identity/v3/projects/9b2394f1d87e4e2ebd99307675cabcf2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 21:02:35.652118 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:02:36.079023 dv-cinder-749155-8-smb devstack@keystone.service[92088]: DEBUG dbcounter [-] [92088] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=92088) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 21:07:18.125154 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b59504-b75d-4b33-9321-1f1ecdd22372 service neutron] Authenticating user token {{(pid=92087) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 21:07:18.126529 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-50b59504-b75d-4b33-9321-1f1ecdd22372 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:07:18.266663 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b59504-b75d-4b33-9321-1f1ecdd22372 service neutron] Validating token access rules against request {{(pid=92087) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 21:07:18.325825 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73654b0-defe-4ce3-860d-af6e2aef8b2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '04843ec31eb84585944c7a2b9cd1c0cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327868f4f62e4e4a9c5bef4acd32fb29', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=92087) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 21:07:18.326439 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73654b0-defe-4ce3-860d-af6e2aef8b2b service placement] REQUEST_METHOD: `GET` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 21:07:18.326750 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73654b0-defe-4ce3-860d-af6e2aef8b2b service placement] SCRIPT_NAME: `/identity` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 21:07:18.327022 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73654b0-defe-4ce3-860d-af6e2aef8b2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=92087) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 21:07:18.328871 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.fernet_utils [None req-a73654b0-defe-4ce3-860d-af6e2aef8b2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=92087) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 21:07:18.340245 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73654b0-defe-4ce3-860d-af6e2aef8b2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 21:07:18.341795 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73654b0-defe-4ce3-860d-af6e2aef8b2b service placement] RBAC: Authorization granted {{(pid=92087) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 21:07:18.351628 dv-cinder-749155-8-smb devstack@keystone.service[92087]: [pid: 92087|app: 0|req: 1461/2926] 10.222.0.77 () {60 vars in 1365 bytes} [Tue Jul 19 21:07:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 21:07:28.347385 dv-cinder-749155-8-smb devstack@keystone.service[92087]: DEBUG dbcounter [-] [92087] Writing DB stats keystone:SELECT=89 {{(pid=92087) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}